Jul 15 15:33:06.094587 ip-10-0-140-212 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 15 15:33:06.094597 ip-10-0-140-212 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 15 15:33:06.094604 ip-10-0-140-212 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 15 15:33:06.094909 ip-10-0-140-212 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 15 15:33:16.150555 ip-10-0-140-212 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 15 15:33:16.150571 ip-10-0-140-212 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 154e8d5528cf4816ada2576e2b935788 --
Jul 15 15:35:12.587777 ip-10-0-140-212 systemd[1]: Starting Kubernetes Kubelet...
Jul 15 15:35:13.030629 ip-10-0-140-212 kubenswrapper[2588]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 15 15:35:13.030629 ip-10-0-140-212 kubenswrapper[2588]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 15 15:35:13.030629 ip-10-0-140-212 kubenswrapper[2588]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 15 15:35:13.030629 ip-10-0-140-212 kubenswrapper[2588]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 15 15:35:13.030629 ip-10-0-140-212 kubenswrapper[2588]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 15 15:35:13.030629 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:12.993981    2588 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 15 15:35:13.030629 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:12.999288    2588 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 15 15:35:13.030629 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:12.999301    2588 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 15 15:35:13.030629 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:12.999304    2588 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 15 15:35:13.030629 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:12.999307    2588 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 15 15:35:13.030629 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:12.999310    2588 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 15 15:35:13.030629 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:12.999314    2588 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 15 15:35:13.030629 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:12.999317    2588 feature_gate.go:328] unrecognized feature gate: Example
Jul 15 15:35:13.030629 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:12.999319    2588 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 15 15:35:13.032713 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:12.999322    2588 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 15 15:35:13.032713 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:12.999327    2588 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 15 15:35:13.032713 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:12.999331    2588 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 15 15:35:13.032713 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:12.999334    2588 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 15 15:35:13.032713 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:12.999337    2588 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 15 15:35:13.032713 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:12.999339    2588 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 15 15:35:13.032713 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:12.999342    2588 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 15 15:35:13.032713 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:12.999344    2588 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 15 15:35:13.032713 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:12.999352    2588 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 15 15:35:13.032713 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:12.999354    2588 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 15 15:35:13.032713 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:12.999357    2588 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 15 15:35:13.032713 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:12.999360    2588 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 15 15:35:13.032713 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:12.999362    2588 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 15 15:35:13.032713 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:12.999365    2588 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 15 15:35:13.032713 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:12.999368    2588 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 15 15:35:13.032713 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:12.999370    2588 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 15 15:35:13.032713 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:12.999374    2588 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 15 15:35:13.032713 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:12.999378    2588 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 15 15:35:13.032713 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:12.999381    2588 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 15 15:35:13.034914 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:12.999384    2588 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 15 15:35:13.034914 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:12.999387    2588 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 15 15:35:13.034914 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:12.999391    2588 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 15 15:35:13.034914 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:12.999394    2588 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 15 15:35:13.034914 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:12.999396    2588 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 15 15:35:13.034914 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:12.999400    2588 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 15 15:35:13.034914 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:12.999403    2588 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 15 15:35:13.034914 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:12.999406    2588 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 15 15:35:13.034914 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:12.999408    2588 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 15 15:35:13.034914 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:12.999411    2588 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 15 15:35:13.034914 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:12.999413    2588 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 15 15:35:13.034914 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:12.999416    2588 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 15 15:35:13.034914 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:12.999418    2588 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 15 15:35:13.034914 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:12.999421    2588 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 15 15:35:13.034914 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:12.999423    2588 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 15 15:35:13.034914 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:12.999426    2588 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 15 15:35:13.034914 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:12.999428    2588 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 15 15:35:13.034914 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:12.999432    2588 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 15 15:35:13.034914 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:12.999435    2588 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 15 15:35:13.049941 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:12.999438    2588 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 15 15:35:13.049941 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:12.999442    2588 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 15 15:35:13.049941 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:12.999444    2588 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 15 15:35:13.049941 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:12.999447    2588 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 15 15:35:13.049941 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:12.999449    2588 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 15 15:35:13.049941 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:12.999452    2588 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 15 15:35:13.049941 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:12.999454    2588 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 15 15:35:13.049941 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:12.999457    2588 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 15 15:35:13.049941 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:12.999460    2588 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 15 15:35:13.049941 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:12.999462    2588 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 15 15:35:13.049941 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:12.999465    2588 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 15 15:35:13.049941 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:12.999467    2588 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 15 15:35:13.049941 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:12.999469    2588 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 15 15:35:13.049941 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:12.999472    2588 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 15 15:35:13.049941 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:12.999475    2588 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 15 15:35:13.049941 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:12.999477    2588 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 15 15:35:13.049941 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:12.999481    2588 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 15 15:35:13.049941 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:12.999484    2588 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 15 15:35:13.049941 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:12.999487    2588 feature_gate.go:328] unrecognized feature gate: Example2
Jul 15 15:35:13.049941 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:12.999490    2588 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 15 15:35:13.052006 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:12.999493    2588 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 15 15:35:13.052006 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:12.999496    2588 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 15 15:35:13.052006 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:12.999499    2588 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 15 15:35:13.052006 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:12.999501    2588 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 15 15:35:13.052006 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:12.999503    2588 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 15 15:35:13.052006 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:12.999518    2588 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 15 15:35:13.052006 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:12.999520    2588 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 15 15:35:13.052006 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:12.999523    2588 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 15 15:35:13.052006 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:12.999526    2588 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 15 15:35:13.052006 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:12.999529    2588 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 15 15:35:13.052006 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:12.999531    2588 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 15 15:35:13.052006 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:12.999534    2588 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 15 15:35:13.052006 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:12.999537    2588 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 15 15:35:13.052006 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:12.999540    2588 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 15 15:35:13.052006 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:12.999543    2588 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 15 15:35:13.052006 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:12.999546    2588 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 15 15:35:13.052006 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:12.999548    2588 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 15 15:35:13.052006 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:12.999551    2588 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 15 15:35:13.052006 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:12.999553    2588 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 15 15:35:13.052006 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:12.999556    2588 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 15 15:35:13.052812 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:12.999559    2588 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 15 15:35:13.052812 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:12.999561    2588 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 15 15:35:13.052812 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:12.999563    2588 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 15 15:35:13.052812 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:12.999566    2588 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 15 15:35:13.052812 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:12.999568    2588 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 15 15:35:13.052812 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:12.999571    2588 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 15 15:35:13.052812 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:12.999573    2588 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 15 15:35:13.052812 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:12.999576    2588 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 15 15:35:13.052812 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:12.999578    2588 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 15 15:35:13.052812 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:12.999581    2588 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 15 15:35:13.052812 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:12.999583    2588 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 15 15:35:13.052812 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:12.999586    2588 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 15 15:35:13.052812 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:12.999589    2588 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 15 15:35:13.052812 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.000264    2588 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 15 15:35:13.052812 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.000271    2588 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 15 15:35:13.052812 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.000275    2588 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 15 15:35:13.052812 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.000278    2588 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 15 15:35:13.052812 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.000281    2588 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 15 15:35:13.052812 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.000283    2588 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 15 15:35:13.052812 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.000286    2588 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 15 15:35:13.054985 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.000289    2588 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 15 15:35:13.054985 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.000292    2588 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 15 15:35:13.054985 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.000294    2588 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 15 15:35:13.054985 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.000297    2588 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 15 15:35:13.054985 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.000299    2588 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 15 15:35:13.054985 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.000304    2588 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 15 15:35:13.054985 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.000309    2588 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 15 15:35:13.054985 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.000312    2588 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 15 15:35:13.054985 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.000315    2588 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 15 15:35:13.054985 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.000317    2588 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 15 15:35:13.054985 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.000320    2588 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 15 15:35:13.054985 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.000322    2588 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 15 15:35:13.054985 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.000325    2588 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 15 15:35:13.054985 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.000327    2588 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 15 15:35:13.054985 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.000330    2588 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 15 15:35:13.054985 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.000333    2588 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 15 15:35:13.054985 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.000335    2588 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 15 15:35:13.054985 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.000337    2588 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 15 15:35:13.054985 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.000340    2588 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 15 15:35:13.054985 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.000342    2588 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 15 15:35:13.056916 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.000345    2588 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 15 15:35:13.056916 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.000347    2588 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 15 15:35:13.056916 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.000350    2588 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 15 15:35:13.056916 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.000352    2588 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 15 15:35:13.056916 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.000355    2588 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 15 15:35:13.056916 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.000357    2588 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 15 15:35:13.056916 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.000359    2588 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 15 15:35:13.056916 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.000363    2588 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 15 15:35:13.056916 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.000366    2588 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 15 15:35:13.056916 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.000368    2588 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 15 15:35:13.056916 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.000371    2588 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 15 15:35:13.056916 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.000374    2588 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 15 15:35:13.056916 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.000377    2588 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 15 15:35:13.056916 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.000379    2588 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 15 15:35:13.056916 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.000382    2588 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 15 15:35:13.056916 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.000384    2588 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 15 15:35:13.056916 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.000387    2588 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 15 15:35:13.056916 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.000389    2588 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 15 15:35:13.056916 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.000392    2588 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 15 15:35:13.056916 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.000395    2588 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 15 15:35:13.058064 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.000398    2588 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 15 15:35:13.058064 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.000400    2588 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 15 15:35:13.058064 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.000403    2588 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 15 15:35:13.058064 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.000406    2588 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 15 15:35:13.058064 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.000408    2588 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 15 15:35:13.058064 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.000411    2588 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 15 15:35:13.058064 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.000414    2588 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 15 15:35:13.058064 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.000417    2588 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 15 15:35:13.058064 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.000419    2588 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 15 15:35:13.058064 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.000421    2588 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 15 15:35:13.058064 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.000424    2588 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 15 15:35:13.058064 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.000426    2588 feature_gate.go:328] unrecognized feature gate: Example
Jul 15 15:35:13.058064 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.000429    2588 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 15 15:35:13.058064 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.000431    2588 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 15 15:35:13.058064 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.000434    2588 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 15 15:35:13.058064 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.000437    2588 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 15 15:35:13.058064 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.000439    2588 feature_gate.go:328] unrecognized feature gate: Example2
Jul 15 15:35:13.058064 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.000442    2588 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 15 15:35:13.058064 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.000444    2588 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 15 15:35:13.058064 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.000447    2588 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 15 15:35:13.058802 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.000449    2588 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 15 15:35:13.058802 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.000452    2588 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 15 15:35:13.058802 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.000454    2588 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 15 15:35:13.058802 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.000457    2588 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 15 15:35:13.058802 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.000459    2588 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 15 15:35:13.058802 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.000462    2588 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 15 15:35:13.058802 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.000464    2588 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 15 15:35:13.058802 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.000467    2588 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 15 15:35:13.058802 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.000470    2588 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 15 15:35:13.058802 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.000473    2588 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 15 15:35:13.058802 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.000475    2588 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 15 15:35:13.058802 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.000478    2588 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 15 15:35:13.058802 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.000481    2588 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 15 15:35:13.058802 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.000484    2588 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 15 15:35:13.058802 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.000487    2588 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 15 15:35:13.058802 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.000489    2588 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 15 15:35:13.058802 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.000492    2588 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 15 15:35:13.058802 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.000494    2588 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 15 15:35:13.058802 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.000497    2588 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 15 15:35:13.059410 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.000500    2588 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 15 15:35:13.059410 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.000502    2588 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 15 15:35:13.059410 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.000522    2588 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 15 15:35:13.059410 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.000525    2588 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 15 15:35:13.059410 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.000530    2588 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 15 15:35:13.059410 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.000533    2588 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 15 15:35:13.059410 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.000536    2588 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 15 15:35:13.059410 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.000539    2588 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 15 15:35:13.059410 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.000541    2588 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 15 15:35:13.059410 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.000544    2588 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 15 15:35:13.059410 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.000550    2588 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 15 15:35:13.059410 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.000553    2588 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 15 15:35:13.059410 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.000555    2588 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 15 15:35:13.059410 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.000939    2588 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 15 15:35:13.059410 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.000945    2588 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 15 15:35:13.059410 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.000948    2588 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 15 15:35:13.059410 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.000950    2588 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 15 15:35:13.059410 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.000953    2588 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 15 15:35:13.059410 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.000955    2588 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 15 15:35:13.060021 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.000958    2588 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 15 15:35:13.060021 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.000961    2588 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 15 15:35:13.060021 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.000963    2588 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 15 15:35:13.060021 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.000965    2588 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 15 15:35:13.060021 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.000968    2588 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 15 15:35:13.060021 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.000970    2588 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 15 15:35:13.060021 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.000974    2588 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 15 15:35:13.060021 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.000976    2588 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 15 15:35:13.060021 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.000979    2588 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 15 15:35:13.060021 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.000981    2588 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 15 15:35:13.060021 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.000984    2588 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 15 15:35:13.060021 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.000987    2588 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 15 15:35:13.060021 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.000989    2588 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 15 15:35:13.060021 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.000992    2588 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 15 15:35:13.060021 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.000994    2588 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 15 15:35:13.060021 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.000997    2588 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 15 15:35:13.060021 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.000999    2588 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 15 15:35:13.060021 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.001002    2588 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 15 15:35:13.060021 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.001004    2588 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 15 15:35:13.060021 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.001007    2588 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 15 15:35:13.060628 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.001009    2588 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 15 15:35:13.060628 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.001011    2588 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 15 15:35:13.060628 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.001014    2588 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 15 15:35:13.060628 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.001018    2588 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 15 15:35:13.060628 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.001020    2588 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 15 15:35:13.060628 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.001023    2588 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 15 15:35:13.060628 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.001027    2588 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 15 15:35:13.060628 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.001030    2588 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 15 15:35:13.060628 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.001033    2588 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 15 15:35:13.060628 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.001035    2588 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 15 15:35:13.060628 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.001037    2588 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 15 15:35:13.060628 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.001040    2588 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 15 15:35:13.060628 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.001042    2588 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 15 15:35:13.060628 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.001045    2588 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 15 15:35:13.060628 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.001047    2588 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 15 15:35:13.060628 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.001052    2588 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 15 15:35:13.060628 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.001055    2588 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 15 15:35:13.060628 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.001058    2588 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 15 15:35:13.060628 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.001061    2588 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 15 15:35:13.061244 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.001065    2588 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 15 15:35:13.061244 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.001067    2588 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 15 15:35:13.061244 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.001070    2588 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 15 15:35:13.061244 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.001072    2588 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 15 15:35:13.061244 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.001075    2588 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 15 15:35:13.061244 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.001077    2588 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 15 15:35:13.061244 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.001080    2588 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 15 15:35:13.061244 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.001082    2588 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 15 15:35:13.061244 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.001085    2588 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 15 15:35:13.061244 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.001087    2588 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 15 15:35:13.061244 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.001089    2588 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 15 15:35:13.061244 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.001093    2588 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 15 15:35:13.061244 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.001096    2588 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 15 15:35:13.061244 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.001099    2588 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 15 15:35:13.061244 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.001102    2588 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 15 15:35:13.061244 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.001104    2588 feature_gate.go:328] unrecognized feature gate: Example2
Jul 15 15:35:13.061244 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.001108    2588 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 15 15:35:13.061244 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.001111    2588 feature_gate.go:328] unrecognized feature gate: Example
Jul 15 15:35:13.061244 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.001113    2588 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 15 15:35:13.061866 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.001118    2588 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 15 15:35:13.061866 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.001121    2588 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 15 15:35:13.061866 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.001124    2588 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 15 15:35:13.061866 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.001127    2588 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 15 15:35:13.061866 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.001129    2588 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 15 15:35:13.061866 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.001131    2588 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 15 15:35:13.061866 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.001134    2588 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 15 15:35:13.061866 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.001136    2588 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 15 15:35:13.061866 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.001139    2588 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 15 15:35:13.061866 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.001141    2588 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 15 15:35:13.061866 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.001143    2588 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 15 15:35:13.061866 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.001146    2588 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 15 15:35:13.061866 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.001148    2588 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 15 15:35:13.061866 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.001151    2588 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 15 15:35:13.061866 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.001154    2588 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 15 15:35:13.061866 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.001156    2588 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 15 15:35:13.061866 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.001159    2588 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 15 15:35:13.061866 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.001161    2588 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 15 15:35:13.061866 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.001164    2588 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 15 15:35:13.061866 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.001166    2588 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 15 15:35:13.062471 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.001169    2588 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 15 15:35:13.062471 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.001171    2588 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 15 15:35:13.062471 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.001174    2588 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 15 15:35:13.062471 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.001176    2588 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 15 15:35:13.062471 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.001178    2588 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 15 15:35:13.062471 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.001181    2588 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 15 15:35:13.062471 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.001183    2588 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 15 15:35:13.062471 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.001187    2588 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 15 15:35:13.062471 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.001190    2588 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 15 15:35:13.062471 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.001194    2588 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 15 15:35:13.062471 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.001197    2588 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 15 15:35:13.062471 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.001200    2588 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 15 15:35:13.062471 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.001205    2588 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 15 15:35:13.062471 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.001207    2588 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 15 15:35:13.062471 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.001210    2588 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 15 15:35:13.062471 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.001273    2588 flags.go:64] FLAG: --address="0.0.0.0"
Jul 15 15:35:13.062471 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.001279    2588 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 15 15:35:13.062471 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.001285    2588 flags.go:64] FLAG: --anonymous-auth="true"
Jul 15 15:35:13.062471 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.001289    2588 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 15 15:35:13.062471 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.001294    2588 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 15 15:35:13.063039 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.001299    2588 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 15 15:35:13.063039 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.001305    2588 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 15 15:35:13.063039 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.001311    2588 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 15 15:35:13.063039 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.001316    2588 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 15 15:35:13.063039 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.001320    2588 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 15 15:35:13.063039 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.001324    2588 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 15 15:35:13.063039 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.001327    2588 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 15 15:35:13.063039 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.001331    2588 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 15 15:35:13.063039 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.001334    2588 flags.go:64] FLAG: --cgroup-root=""
Jul 15 15:35:13.063039 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.001337    2588 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 15 15:35:13.063039 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.001340    2588 flags.go:64] FLAG: --client-ca-file=""
Jul 15 15:35:13.063039 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.001343    2588 flags.go:64] FLAG: --cloud-provider="external"
Jul 15 15:35:13.063039 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.001346    2588 flags.go:64] FLAG: --cluster-dns="[]"
Jul 15 15:35:13.063039 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.001351    2588 flags.go:64] FLAG: --cluster-domain=""
Jul 15 15:35:13.063039 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.001353    2588 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 15 15:35:13.063039 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.001356    2588 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 15 15:35:13.063039 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.001360    2588 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 15 15:35:13.063039 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.001363    2588 flags.go:64] FLAG: --container-log-max-files="5"
Jul 15 15:35:13.063039 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.001367    2588 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 15 15:35:13.063039 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.001370    2588 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 15 15:35:13.063039 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.001373    2588 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 15 15:35:13.063039 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.001377    2588 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 15 15:35:13.063039 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.001380    2588 flags.go:64] FLAG: --contention-profiling="false"
Jul 15 15:35:13.063039 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.001383    2588 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 15 15:35:13.063668 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.001387    2588 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 15 15:35:13.063668 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.001390    2588 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 15 15:35:13.063668 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.001393    2588 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 15 15:35:13.063668 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.001397    2588 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 15 15:35:13.063668 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.001400    2588 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 15 15:35:13.063668 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.001403    2588 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 15 15:35:13.063668 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.001406    2588 flags.go:64] FLAG: --enable-load-reader="false"
Jul 15 15:35:13.063668 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.001409    2588 flags.go:64] FLAG: --enable-server="true"
Jul 15 15:35:13.063668 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.001412    2588 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 15 15:35:13.063668 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.001415    2588 flags.go:64] FLAG: --event-burst="100"
Jul 15 15:35:13.063668 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.001419    2588 flags.go:64] FLAG: --event-qps="50"
Jul 15 15:35:13.063668 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.001421    2588 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 15 15:35:13.063668 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.001424    2588 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 15 15:35:13.063668 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.001427    2588 flags.go:64] FLAG: --eviction-hard=""
Jul 15 15:35:13.063668 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.001431    2588 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 15 15:35:13.063668 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.001433    2588 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 15 15:35:13.063668 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.001440    2588 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 15 15:35:13.063668 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.001443    2588 flags.go:64] FLAG: --eviction-soft=""
Jul 15 15:35:13.063668 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.001446    2588 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 15 15:35:13.063668 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.001449    2588 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 15 15:35:13.063668 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.001452    2588 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 15 15:35:13.063668 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.001455    2588 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 15 15:35:13.063668 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.001458    2588 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 15 15:35:13.063668 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.001460    2588 flags.go:64] FLAG: --fail-swap-on="true"
Jul 15 15:35:13.063668 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.001463    2588 flags.go:64] FLAG: --feature-gates=""
Jul 15 15:35:13.064454 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.001467    2588 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 15 15:35:13.064454 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.001470    2588 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 15 15:35:13.064454 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.001473    2588 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 15 15:35:13.064454 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.001476    2588 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 15 15:35:13.064454 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.001480    2588 flags.go:64] FLAG: --healthz-port="10248"
Jul 15 15:35:13.064454 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.001483    2588 flags.go:64] FLAG: --help="false"
Jul 15 15:35:13.064454 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.001486    2588 flags.go:64] FLAG: --hostname-override="ip-10-0-140-212.ec2.internal"
Jul 15 15:35:13.064454 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.001490    2588 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 15 15:35:13.064454 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.001493    2588 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 15 15:35:13.064454 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.001495    2588 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 15 15:35:13.064454 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.001499    2588 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 15 15:35:13.064454 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.001502    2588 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 15 15:35:13.064454 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.001517    2588 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 15 15:35:13.064454 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.001520    2588 flags.go:64] FLAG: --image-service-endpoint=""
Jul 15 15:35:13.064454 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.001523    2588 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 15 15:35:13.064454 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.001525    2588 flags.go:64] FLAG: --kube-api-burst="100"
Jul 15 15:35:13.064454 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.001528    2588 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 15 15:35:13.064454 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.001531    2588 flags.go:64] FLAG: --kube-api-qps="50"
Jul 15 15:35:13.064454 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.001534    2588 flags.go:64] FLAG: --kube-reserved=""
Jul 15 15:35:13.064454 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.001538    2588 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 15 15:35:13.064454 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.001540    2588 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 15 15:35:13.064454 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.001544    2588 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 15 15:35:13.064454 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.001546    2588 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 15 15:35:13.064454 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.001549    2588 flags.go:64] FLAG: --lock-file=""
Jul 15 15:35:13.065485 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.001552    2588 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 15 15:35:13.065485 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.001555    2588 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 15 15:35:13.065485 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.001558    2588 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 15 15:35:13.065485 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.001563    2588 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 15 15:35:13.065485 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.001566    2588 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 15 15:35:13.065485 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.001569    2588 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 15 15:35:13.065485 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.001571    2588 flags.go:64] FLAG: --logging-format="text"
Jul 15 15:35:13.065485 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.001574    2588 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 15 15:35:13.065485 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.001578    2588 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 15 15:35:13.065485 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.001581    2588 flags.go:64] FLAG: --manifest-url=""
Jul 15 15:35:13.065485 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.001584    2588 flags.go:64] FLAG: --manifest-url-header=""
Jul 15 15:35:13.065485 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.001588    2588 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 15 15:35:13.065485 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.001592    2588 flags.go:64] FLAG: --max-open-files="1000000"
Jul 15 15:35:13.065485 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.001596    2588 flags.go:64] FLAG: --max-pods="110"
Jul 15 15:35:13.065485 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.001599    2588 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 15 15:35:13.065485 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.001604    2588 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 15 15:35:13.065485 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.001606    2588 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 15 15:35:13.065485 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.001609    2588 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 15 15:35:13.065485 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.001612    2588 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 15 15:35:13.065485 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.001616    2588 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 15 15:35:13.065485 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.001618    2588 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 15 15:35:13.065485 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.001625    2588 flags.go:64] FLAG: --node-status-max-images="50"
Jul 15 15:35:13.065485 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.001628    2588 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 15 15:35:13.065485 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.001631    2588 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 15 15:35:13.065485 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.001633    2588 flags.go:64] FLAG: --pod-cidr=""
Jul 15 15:35:13.066242 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.001636    2588 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926"
Jul 15 15:35:13.066242 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.001642    2588 flags.go:64] FLAG: --pod-manifest-path=""
Jul 15 15:35:13.066242 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.001644    2588 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 15 15:35:13.066242 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.001647    2588 flags.go:64] FLAG: --pods-per-core="0"
Jul 15 15:35:13.066242 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.001650    2588 flags.go:64] FLAG: --port="10250"
Jul 15 15:35:13.066242 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.001653    2588 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 15 15:35:13.066242 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.001656    2588 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-00c4447eb078b6633"
Jul 15 15:35:13.066242 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.001659    2588 flags.go:64] FLAG: --qos-reserved=""
Jul 15 15:35:13.066242 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.001663    2588 flags.go:64] FLAG: --read-only-port="10255"
Jul 15 15:35:13.066242 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.001666    2588 flags.go:64] FLAG: --register-node="true"
Jul 15 15:35:13.066242 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.001668    2588 flags.go:64] FLAG: --register-with-taints=""
Jul 15 15:35:13.066242 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.001672    2588 flags.go:64] FLAG: --registry-burst="10"
Jul 15 15:35:13.066242 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.001675    2588 flags.go:64] FLAG: --registry-qps="5"
Jul 15 15:35:13.066242 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.001677    2588 flags.go:64] FLAG: --reserved-cpus=""
Jul 15 15:35:13.066242 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.001680    2588 flags.go:64] FLAG: --reserved-memory=""
Jul 15 15:35:13.066242 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.001684    2588 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 15 15:35:13.066242 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.001686    2588 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 15 15:35:13.066242 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.001689    2588 flags.go:64] FLAG: --rotate-certificates="false"
Jul 15 15:35:13.066242 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.001692    2588 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 15 15:35:13.066242 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.001695    2588 flags.go:64] FLAG: --runonce="false"
Jul 15 15:35:13.066242 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.001699    2588 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 15 15:35:13.066242 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.001702    2588 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 15 15:35:13.066242 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.001706    2588 flags.go:64] FLAG: --seccomp-default="false"
Jul 15 15:35:13.066242 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.001709    2588 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 15 15:35:13.066242 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.001712    2588 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 15 15:35:13.286035 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.001715    2588 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 15 15:35:13.286035 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.001718    2588 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 15 15:35:13.286035 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.001721    2588 flags.go:64] FLAG: --storage-driver-password="root"
Jul 15 15:35:13.286035 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.001724    2588 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 15 15:35:13.286035 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.001727    2588 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 15 15:35:13.286035 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.001729    2588 flags.go:64] FLAG: --storage-driver-user="root"
Jul 15 15:35:13.286035 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.001732    2588 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 15 15:35:13.286035 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.001735    2588 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 15 15:35:13.286035 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.001738    2588 flags.go:64] FLAG: --system-cgroups=""
Jul 15 15:35:13.286035 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.001741    2588 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 15 15:35:13.286035 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.001746    2588 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 15 15:35:13.286035 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.001749    2588 flags.go:64] FLAG: --tls-cert-file=""
Jul 15 15:35:13.286035 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.001752    2588 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 15 15:35:13.286035 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.001756    2588 flags.go:64] FLAG: --tls-min-version=""
Jul 15 15:35:13.286035 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.001758    2588 flags.go:64] FLAG: --tls-private-key-file=""
Jul 15 15:35:13.286035 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.001761    2588 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 15 15:35:13.286035 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.001770    2588 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 15 15:35:13.286035 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.001773    2588 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 15 15:35:13.286035 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.001776    2588 flags.go:64] FLAG: --v="2"
Jul 15 15:35:13.286035 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.001779    2588 flags.go:64] FLAG: --version="false"
Jul 15 15:35:13.286035 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.001784    2588 flags.go:64] FLAG: --vmodule=""
Jul 15 15:35:13.286035 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.001787    2588 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 15 15:35:13.286035 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.001790    2588 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 15 15:35:13.286035 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.001914    2588 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 15 15:35:13.286035 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.001919    2588 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 15 15:35:13.068008 ip-10-0-140-212 systemd[1]: Started Kubernetes Kubelet.
Jul 15 15:35:13.300278 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.001921    2588 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 15 15:35:13.300278 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.001925    2588 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 15 15:35:13.300278 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.001929    2588 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 15 15:35:13.300278 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.001932    2588 feature_gate.go:328] unrecognized feature gate: Example2
Jul 15 15:35:13.300278 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.001936    2588 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 15 15:35:13.300278 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.001940    2588 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 15 15:35:13.300278 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.001942    2588 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 15 15:35:13.300278 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.001945    2588 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 15 15:35:13.300278 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.001948    2588 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 15 15:35:13.300278 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.001950    2588 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 15 15:35:13.300278 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.001953    2588 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 15 15:35:13.300278 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.001956    2588 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 15 15:35:13.300278 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.001959    2588 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 15 15:35:13.300278 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.001961    2588 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 15 15:35:13.300278 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.001964    2588 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 15 15:35:13.300278 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.001966    2588 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 15 15:35:13.300278 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.001968    2588 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 15 15:35:13.300278 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.001971    2588 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 15 15:35:13.300278 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.001974    2588 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 15 15:35:13.300278 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.001976    2588 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 15 15:35:13.301043 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.001979    2588 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 15 15:35:13.301043 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.001981    2588 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 15 15:35:13.301043 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.001984    2588 feature_gate.go:328] unrecognized feature gate: Example
Jul 15 15:35:13.301043 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.001986    2588 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 15 15:35:13.301043 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.001994    2588 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 15 15:35:13.301043 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.001997    2588 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 15 15:35:13.301043 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.001999    2588 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 15 15:35:13.301043 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.002002    2588 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 15 15:35:13.301043 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.002004    2588 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 15 15:35:13.301043 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.002007    2588 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 15 15:35:13.301043 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.002009    2588 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 15 15:35:13.301043 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.002012    2588 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 15 15:35:13.301043 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.002014    2588 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 15 15:35:13.301043 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.002017    2588 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 15 15:35:13.301043 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.002020    2588 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 15 15:35:13.301043 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.002023    2588 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 15 15:35:13.301043 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.002027    2588 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 15 15:35:13.301043 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.002029    2588 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 15 15:35:13.301043 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.002032    2588 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 15 15:35:13.301043 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.002034    2588 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 15 15:35:13.301768 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.002037    2588 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 15 15:35:13.301768 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.002040    2588 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 15 15:35:13.301768 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.002042    2588 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 15 15:35:13.301768 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.002045    2588 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 15 15:35:13.301768 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.002047    2588 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 15 15:35:13.301768 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.002050    2588 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 15 15:35:13.301768 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.002053    2588 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 15 15:35:13.301768 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.002055    2588 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 15 15:35:13.301768 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.002058    2588 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 15 15:35:13.301768 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.002060    2588 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 15 15:35:13.301768 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.002063    2588 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 15 15:35:13.301768 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.002065    2588 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 15 15:35:13.301768 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.002068    2588 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 15 15:35:13.301768 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.002070    2588 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 15 15:35:13.301768 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.002072    2588 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 15 15:35:13.301768 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.002075    2588 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 15 15:35:13.301768 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.002077    2588 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 15 15:35:13.301768 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.002087    2588 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 15 15:35:13.301768 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.002089    2588 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 15 15:35:13.302327 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.002092    2588 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 15 15:35:13.302327 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.002096    2588 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 15 15:35:13.302327 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.002099    2588 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 15 15:35:13.302327 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.002102    2588 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 15 15:35:13.302327 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.002104    2588 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 15 15:35:13.302327 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.002107    2588 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 15 15:35:13.302327 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.002109    2588 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 15 15:35:13.302327 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.002113    2588 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 15 15:35:13.302327 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.002116    2588 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 15 15:35:13.302327 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.002120    2588 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 15 15:35:13.302327 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.002124    2588 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 15 15:35:13.302327 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.002127    2588 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 15 15:35:13.302327 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.002130    2588 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 15 15:35:13.302327 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.002134    2588 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 15 15:35:13.302327 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.002138    2588 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 15 15:35:13.302327 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.002141    2588 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 15 15:35:13.302327 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.002144    2588 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 15 15:35:13.302327 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.002146    2588 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 15 15:35:13.302930 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.002149    2588 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 15 15:35:13.302930 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.002152    2588 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 15 15:35:13.302930 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.002155    2588 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 15 15:35:13.302930 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.002157    2588 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 15 15:35:13.302930 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.002160    2588 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 15 15:35:13.302930 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.002162    2588 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 15 15:35:13.302930 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.002165    2588 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 15 15:35:13.302930 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.002168    2588 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 15 15:35:13.302930 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.002170    2588 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 15 15:35:13.302930 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.002172    2588 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 15 15:35:13.302930 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.002175    2588 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 15 15:35:13.302930 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.002177    2588 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 15 15:35:13.302930 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.002180    2588 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 15 15:35:13.302930 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.002183    2588 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 15 15:35:13.302930 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.002186    2588 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 15 15:35:13.302930 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.002188    2588 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 15 15:35:13.302930 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.002191    2588 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 15 15:35:13.302930 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.002193    2588 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 15 15:35:13.302930 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.002196    2588 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 15 15:35:13.302930 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.002198    2588 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 15 15:35:13.303501 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.002204    2588 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 15 15:35:13.303501 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.009426    2588 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 15 15:35:13.303501 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.009441    2588 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 15 15:35:13.303501 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.010191    2588 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 15 15:35:13.303501 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.010199    2588 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 15 15:35:13.303501 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.010259    2588 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 15 15:35:13.303501 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.010264    2588 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 15 15:35:13.303501 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.010268    2588 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 15 15:35:13.303501 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.010271    2588 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 15 15:35:13.303501 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.010274    2588 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 15 15:35:13.303501 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.010277    2588 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 15 15:35:13.303501 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.010279    2588 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 15 15:35:13.303501 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.010282    2588 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 15 15:35:13.303501 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.010285    2588 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 15 15:35:13.304003 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.010287    2588 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 15 15:35:13.304003 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.010290    2588 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 15 15:35:13.304003 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.010293    2588 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 15 15:35:13.304003 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.010295    2588 feature_gate.go:328] unrecognized feature gate: Example2
Jul 15 15:35:13.304003 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.010298    2588 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 15 15:35:13.304003 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.010303    2588 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 15 15:35:13.304003 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.010306    2588 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 15 15:35:13.304003 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.010309    2588 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 15 15:35:13.304003 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.010312    2588 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 15 15:35:13.304003 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.010315    2588 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 15 15:35:13.304003 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.010317    2588 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 15 15:35:13.304003 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.010320    2588 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 15 15:35:13.304003 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.010324    2588 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 15 15:35:13.304003 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.010327    2588 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 15 15:35:13.304003 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.010329    2588 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 15 15:35:13.304003 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.010332    2588 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 15 15:35:13.304003 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.010334    2588 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 15 15:35:13.304003 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.010337    2588 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 15 15:35:13.304003 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.010339    2588 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 15 15:35:13.304003 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.010342    2588 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 15 15:35:13.304576 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.010345    2588 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 15 15:35:13.304576 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.010347    2588 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 15 15:35:13.304576 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.010351    2588 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 15 15:35:13.304576 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.010354    2588 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 15 15:35:13.304576 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.010356    2588 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 15 15:35:13.304576 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.010359    2588 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 15 15:35:13.304576 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.010361    2588 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 15 15:35:13.304576 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.010364    2588 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 15 15:35:13.304576 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.010367    2588 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 15 15:35:13.304576 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.010369    2588 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 15 15:35:13.304576 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.010371    2588 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 15 15:35:13.304576 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.010374    2588 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 15 15:35:13.304576 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.010377    2588 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 15 15:35:13.304576 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.010379    2588 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 15 15:35:13.304576 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.010382    2588 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 15 15:35:13.304576 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.010384    2588 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 15 15:35:13.304576 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.010387    2588 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 15 15:35:13.304576 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.010391    2588 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 15 15:35:13.304576 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.010394    2588 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 15 15:35:13.304576 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.010396    2588 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 15 15:35:13.305208 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.010399    2588 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 15 15:35:13.305208 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.010402    2588 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 15 15:35:13.305208 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.010404    2588 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 15 15:35:13.305208 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.010407    2588 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 15 15:35:13.305208 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.010410    2588 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 15 15:35:13.305208 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.010413    2588 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 15 15:35:13.305208 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.010415    2588 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 15 15:35:13.305208 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.010418    2588 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 15 15:35:13.305208 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.010421    2588 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 15 15:35:13.305208 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.010423    2588 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 15 15:35:13.305208 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.010426    2588 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 15 15:35:13.305208 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.010428    2588 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 15 15:35:13.305208 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.010431    2588 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 15 15:35:13.305208 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.010434    2588 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 15 15:35:13.305208 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.010438    2588 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 15 15:35:13.305208 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.010441    2588 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 15 15:35:13.305208 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.010443    2588 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 15 15:35:13.305208 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.010446    2588 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 15 15:35:13.305208 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.010448    2588 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 15 15:35:13.305775 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.010451    2588 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 15 15:35:13.305775 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.010455    2588 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 15 15:35:13.305775 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.010458    2588 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 15 15:35:13.305775 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.010461    2588 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 15 15:35:13.305775 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.010464    2588 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 15 15:35:13.305775 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.010467    2588 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 15 15:35:13.305775 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.010469    2588 feature_gate.go:328] unrecognized feature gate: Example
Jul 15 15:35:13.305775 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.010472    2588 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 15 15:35:13.305775 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.010474    2588 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 15 15:35:13.305775 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.010477    2588 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 15 15:35:13.305775 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.010480    2588 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 15 15:35:13.305775 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.010483    2588 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 15 15:35:13.305775 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.010486    2588 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 15 15:35:13.305775 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.010488    2588 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 15 15:35:13.305775 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.010493    2588 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 15 15:35:13.305775 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.010496    2588 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 15 15:35:13.305775 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.010499    2588 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 15 15:35:13.305775 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.010502    2588 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 15 15:35:13.305775 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.010518    2588 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 15 15:35:13.306350 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.010522    2588 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 15 15:35:13.306350 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.010525    2588 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 15 15:35:13.306350 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.010528    2588 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 15 15:35:13.306350 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.010531    2588 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 15 15:35:13.306350 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.010535    2588 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 15 15:35:13.306350 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.010540    2588 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 15 15:35:13.306350 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.010544    2588 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 15 15:35:13.306350 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.010547    2588 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 15 15:35:13.306350 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.010551    2588 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 15 15:35:13.306350 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.010554    2588 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 15 15:35:13.306350 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.010556    2588 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 15 15:35:13.306350 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.010559    2588 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 15 15:35:13.306350 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.010564    2588 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 15 15:35:13.306350 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.010674    2588 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 15 15:35:13.306350 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.010678    2588 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 15 15:35:13.306819 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.010681    2588 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 15 15:35:13.306819 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.010685    2588 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 15 15:35:13.306819 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.010688    2588 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 15 15:35:13.306819 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.010691    2588 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 15 15:35:13.306819 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.010693    2588 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 15 15:35:13.306819 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.010696    2588 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 15 15:35:13.306819 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.010698    2588 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 15 15:35:13.306819 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.010701    2588 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 15 15:35:13.306819 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.010703    2588 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 15 15:35:13.306819 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.010707    2588 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 15 15:35:13.306819 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.010709    2588 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 15 15:35:13.306819 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.010712    2588 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 15 15:35:13.306819 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.010715    2588 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 15 15:35:13.306819 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.010717    2588 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 15 15:35:13.306819 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.010720    2588 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 15 15:35:13.306819 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.010722    2588 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 15 15:35:13.306819 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.010725    2588 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 15 15:35:13.306819 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.010728    2588 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 15 15:35:13.306819 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.010730    2588 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 15 15:35:13.306819 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.010733    2588 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 15 15:35:13.307378 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.010735    2588 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 15 15:35:13.307378 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.010738    2588 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 15 15:35:13.307378 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.010740    2588 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 15 15:35:13.307378 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.010743    2588 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 15 15:35:13.307378 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.010745    2588 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 15 15:35:13.307378 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.010749    2588 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 15 15:35:13.307378 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.010752    2588 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 15 15:35:13.307378 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.010754    2588 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 15 15:35:13.307378 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.010757    2588 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 15 15:35:13.307378 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.010759    2588 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 15 15:35:13.307378 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.010762    2588 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 15 15:35:13.307378 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.010764    2588 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 15 15:35:13.307378 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.010767    2588 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 15 15:35:13.307378 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.010769    2588 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 15 15:35:13.307378 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.010772    2588 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 15 15:35:13.307378 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.010775    2588 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 15 15:35:13.307378 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.010777    2588 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 15 15:35:13.307378 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.010780    2588 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 15 15:35:13.307378 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.010782    2588 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 15 15:35:13.307897 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.010784    2588 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 15 15:35:13.307897 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.010787    2588 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 15 15:35:13.307897 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.010790    2588 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 15 15:35:13.307897 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.010793    2588 feature_gate.go:328] unrecognized feature gate: Example2
Jul 15 15:35:13.307897 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.010795    2588 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 15 15:35:13.307897 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.010798    2588 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 15 15:35:13.307897 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.010800    2588 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 15 15:35:13.307897 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.010803    2588 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 15 15:35:13.307897 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.010805    2588 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 15 15:35:13.307897 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.010808    2588 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 15 15:35:13.307897 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.010811    2588 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 15 15:35:13.307897 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.010813    2588 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 15 15:35:13.307897 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.010816    2588 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 15 15:35:13.307897 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.010818    2588 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 15 15:35:13.307897 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.010821    2588 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 15 15:35:13.307897 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.010823    2588 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 15 15:35:13.307897 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.010826    2588 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 15 15:35:13.307897 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.010828    2588 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 15 15:35:13.307897 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.010832    2588 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 15 15:35:13.307897 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.010835    2588 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 15 15:35:13.308444 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.010837    2588 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 15 15:35:13.308444 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.010840    2588 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 15 15:35:13.308444 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.010842    2588 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 15 15:35:13.308444 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.010845    2588 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 15 15:35:13.308444 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.010847    2588 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 15 15:35:13.308444 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.010850    2588 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 15 15:35:13.308444 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.010852    2588 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 15 15:35:13.308444 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.010855    2588 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 15 15:35:13.308444 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.010859    2588 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 15 15:35:13.308444 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.010862    2588 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 15 15:35:13.308444 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.010865    2588 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 15 15:35:13.308444 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.010868    2588 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 15 15:35:13.308444 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.010870    2588 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 15 15:35:13.308444 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.010873    2588 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 15 15:35:13.308444 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.010877    2588 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 15 15:35:13.308444 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.010879    2588 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 15 15:35:13.308444 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.010882    2588 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 15 15:35:13.308444 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.010885    2588 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 15 15:35:13.308444 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.010887    2588 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 15 15:35:13.308966 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.010890    2588 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 15 15:35:13.308966 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.010894    2588 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 15 15:35:13.308966 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.010897    2588 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 15 15:35:13.308966 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.010900    2588 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 15 15:35:13.308966 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.010903    2588 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 15 15:35:13.308966 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.010906    2588 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 15 15:35:13.308966 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.010909    2588 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 15 15:35:13.308966 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.010911    2588 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 15 15:35:13.308966 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.010914    2588 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 15 15:35:13.308966 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.010917    2588 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 15 15:35:13.308966 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.010921    2588 feature_gate.go:328] unrecognized feature gate: Example
Jul 15 15:35:13.308966 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.010925    2588 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 15 15:35:13.308966 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.010928    2588 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 15 15:35:13.308966 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.010930    2588 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 15 15:35:13.308966 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.010933    2588 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 15 15:35:13.308966 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.010935    2588 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 15 15:35:13.308966 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.010938    2588 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 15 15:35:13.308966 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.010940    2588 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 15 15:35:13.308966 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:13.010943    2588 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 15 15:35:13.309489 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.010947    2588 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 15 15:35:13.309489 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.011042    2588 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 15 15:35:13.309489 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.013056    2588 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 15 15:35:13.309489 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.014432    2588 server.go:1019] "Starting client certificate rotation"
Jul 15 15:35:13.309489 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.014537    2588 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 15 15:35:13.309489 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.015431    2588 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 15 15:35:13.309489 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.018217    2588 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 15 15:35:13.309489 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.020161    2588 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 15 15:35:13.309489 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.036683    2588 log.go:25] "Validated CRI v1 runtime API"
Jul 15 15:35:13.309489 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.038915    2588 log.go:25] "Validated CRI v1 image API"
Jul 15 15:35:13.309489 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.040215    2588 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 15 15:35:13.309489 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.043676    2588 fs.go:135] Filesystem UUIDs: map[550c40eb-9f4a-4a58-9a8f-66b869709c62:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 ae302bee-4d1d-40b2-984e-5d5dd91801c1:/dev/nvme0n1p3]
Jul 15 15:35:13.309857 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.043695    2588 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 15 15:35:13.309857 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.044963    2588 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 15 15:35:13.310431 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.047782    2588 manager.go:216] Machine: {Timestamp:2026-07-15 15:35:13.047318034 +0000 UTC m=+0.339216579 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3199190 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2ba01e8c3dd7a4b23d695eec491fc6 SystemUUID:ec2ba01e-8c3d-d7a4-b23d-695eec491fc6 BootID:154e8d55-28cf-4816-ada2-576e2b935788 Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:07:fc:4f:66:45 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:07:fc:4f:66:45 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:06:9a:c5:77:df:03 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 15 15:35:13.310431 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.047876    2588 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 15 15:35:13.310431 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.047941    2588 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 15 15:35:13.310431 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.050809    2588 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 15 15:35:13.310431 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.050836    2588 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-140-212.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 15 15:35:13.310431 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.051780    2588 topology_manager.go:138] "Creating topology manager with none policy"
Jul 15 15:35:13.310431 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.051790    2588 container_manager_linux.go:309] "Creating device plugin manager"
Jul 15 15:35:13.310431 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.051797    2588 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 15 15:35:13.310431 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.051807    2588 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 15 15:35:13.310431 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.053042    2588 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 15 15:35:13.310431 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.055942    2588 state_mem.go:36] "Initialized new in-memory state store"
Jul 15 15:35:13.310431 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.056061    2588 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 15 15:35:13.310431 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.056089    2588 kubelet.go:486] "Attempting to sync node with API server"
Jul 15 15:35:13.310431 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.056099    2588 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 15 15:35:13.310431 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.056111    2588 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 15 15:35:13.310431 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.056121    2588 kubelet.go:398] "Adding apiserver pod source"
Jul 15 15:35:13.310431 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.056130    2588 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 15 15:35:13.310431 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.056457    2588 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 15 15:35:13.311015 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.056474    2588 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 15 15:35:13.311015 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.060397    2588 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 15 15:35:13.311015 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.062334    2588 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 15 15:35:13.311015 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.062360    2588 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 15 15:35:13.311015 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.062497    2588 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 15 15:35:13.311015 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.062524    2588 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 15 15:35:13.311015 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.062531    2588 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 15 15:35:13.311015 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.062537    2588 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 15 15:35:13.311015 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.062544    2588 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 15 15:35:13.311015 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.062551    2588 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 15 15:35:13.311015 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.063185    2588 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 15 15:35:13.311015 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.063193    2588 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 15 15:35:13.311015 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.063199    2588 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 15 15:35:13.311015 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.063205    2588 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 15 15:35:13.311015 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.063219    2588 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 15 15:35:13.311015 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.063226    2588 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 15 15:35:13.311015 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.064042    2588 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 15 15:35:13.311015 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.064049    2588 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 15 15:35:13.311015 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.066984    2588 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-140-212.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 15 15:35:13.311015 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:35:13.066988    2588 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-140-212.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 15 15:35:13.311015 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.067102    2588 server.go:1268] "Started kubelet"
Jul 15 15:35:13.311015 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:35:13.067099    2588 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 15 15:35:13.311015 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.067179    2588 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 15 15:35:13.311015 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.067234    2588 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 15 15:35:13.311015 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.067532    2588 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 15 15:35:13.311015 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.071969    2588 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 15 15:35:13.311015 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:35:13.075157    2588 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 15 15:35:13.311015 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.075603    2588 server.go:310] "Adding debug handlers to kubelet server"
Jul 15 15:35:13.311015 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.077499    2588 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 15 15:35:13.311015 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.077561    2588 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 15 15:35:13.311015 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:35:13.077605    2588 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-212.ec2.internal\" not found"
Jul 15 15:35:13.311015 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.078038    2588 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 15 15:35:13.311015 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.078040    2588 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 15 15:35:13.311015 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.078076    2588 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 15 15:35:13.311015 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.078165    2588 reconstruct.go:97] "Volume reconstruction finished"
Jul 15 15:35:13.311015 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.078175    2588 reconciler.go:29] "Reconciler: start to sync state"
Jul 15 15:35:13.311015 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:35:13.077470    2588 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-212.ec2.internal.18c2808574951c6c  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-212.ec2.internal,UID:ip-10-0-140-212.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-140-212.ec2.internal,},FirstTimestamp:2026-07-15 15:35:13.06707262 +0000 UTC m=+0.358971135,LastTimestamp:2026-07-15 15:35:13.06707262 +0000 UTC m=+0.358971135,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-212.ec2.internal,}"
Jul 15 15:35:13.311015 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.078801    2588 factory.go:55] Registering systemd factory
Jul 15 15:35:13.311015 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.078837    2588 factory.go:223] Registration of the systemd container factory successfully
Jul 15 15:35:13.311015 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.079049    2588 factory.go:153] Registering CRI-O factory
Jul 15 15:35:13.311015 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.079063    2588 factory.go:223] Registration of the crio container factory successfully
Jul 15 15:35:15.172522 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.079112    2588 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 15 15:35:15.172522 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.079136    2588 factory.go:103] Registering Raw factory
Jul 15 15:35:15.172522 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.079152    2588 manager.go:1196] Started watching for new ooms in manager
Jul 15 15:35:15.172522 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.079563    2588 manager.go:349] Starting recovery of all containers
Jul 15 15:35:15.172522 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:35:13.087022    2588 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-140-212.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 15 15:35:15.172522 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:35:13.087242    2588 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 15 15:35:15.172522 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.089010    2588 manager.go:354] Recovery completed
Jul 15 15:35:15.172522 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.092942    2588 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 15:35:15.172522 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.095234    2588 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-212.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 15:35:15.172522 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.095266    2588 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-212.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 15:35:15.172522 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.095278    2588 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-212.ec2.internal" event="NodeHasSufficientPID"
Jul 15 15:35:15.172522 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.095773    2588 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 15 15:35:15.172522 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.095782    2588 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 15 15:35:15.172522 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.095783    2588 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 15:35:15.172522 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.095799    2588 state_mem.go:36] "Initialized new in-memory state store"
Jul 15 15:35:15.172522 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.096388    2588 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-212.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 15:35:15.172522 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.096409    2588 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-212.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 15:35:15.172522 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.096418    2588 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-212.ec2.internal" event="NodeHasSufficientPID"
Jul 15 15:35:15.172522 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.096942    2588 policy_none.go:49] "None policy: Start"
Jul 15 15:35:15.172522 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.096953    2588 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 15 15:35:15.172522 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.096977    2588 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 15 15:35:15.172522 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.097966    2588 policy_none.go:47] "Start"
Jul 15 15:35:15.172522 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.107954    2588 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-6pgvp"
Jul 15 15:35:15.172522 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:35:13.107979    2588 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-212.ec2.internal.18c2808576431554  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-212.ec2.internal,UID:ip-10-0-140-212.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-140-212.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-140-212.ec2.internal,},FirstTimestamp:2026-07-15 15:35:13.095251284 +0000 UTC m=+0.387149798,LastTimestamp:2026-07-15 15:35:13.095251284 +0000 UTC m=+0.387149798,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-212.ec2.internal,}"
Jul 15 15:35:15.172522 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:35:13.110393    2588 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-212.ec2.internal.18c280857643673d  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-212.ec2.internal,UID:ip-10-0-140-212.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-140-212.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-140-212.ec2.internal,},FirstTimestamp:2026-07-15 15:35:13.095272253 +0000 UTC m=+0.387170770,LastTimestamp:2026-07-15 15:35:13.095272253 +0000 UTC m=+0.387170770,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-212.ec2.internal,}"
Jul 15 15:35:15.172522 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.111828    2588 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-6pgvp"
Jul 15 15:35:15.172522 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.146064    2588 manager.go:337] "Starting Device Plugin manager"
Jul 15 15:35:15.172522 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:35:13.146243    2588 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 15 15:35:15.172522 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.146273    2588 server.go:87] "Starting device plugin registration server"
Jul 15 15:35:15.172522 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.146451    2588 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 15 15:35:15.172522 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.146460    2588 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 15 15:35:15.172522 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.146578    2588 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 15 15:35:15.173771 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.146685    2588 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 15 15:35:15.173771 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.146694    2588 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 15 15:35:15.173771 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:35:13.147057    2588 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 15 15:35:15.173771 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:35:13.147096    2588 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-140-212.ec2.internal\" not found"
Jul 15 15:35:15.173771 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.246864    2588 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 15:35:15.173771 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.248221    2588 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-212.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 15:35:15.173771 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.248246    2588 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-212.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 15:35:15.173771 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.248256    2588 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-212.ec2.internal" event="NodeHasSufficientPID"
Jul 15 15:35:15.173771 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.248285    2588 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-140-212.ec2.internal"
Jul 15 15:35:15.173771 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.257609    2588 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-140-212.ec2.internal"
Jul 15 15:35:15.173771 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:35:13.257626    2588 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-140-212.ec2.internal\": node \"ip-10-0-140-212.ec2.internal\" not found"
Jul 15 15:35:15.173771 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.262932    2588 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 15 15:35:15.173771 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.264123    2588 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 15 15:35:15.173771 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.264152    2588 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 15 15:35:15.173771 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.264168    2588 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 15 15:35:15.173771 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:35:13.264197    2588 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 15 15:35:15.173771 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.269782    2588 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 15 15:35:15.173771 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:35:13.286021    2588 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-212.ec2.internal\" not found"
Jul 15 15:35:15.173771 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.364713    2588 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-212.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-140-212.ec2.internal"]
Jul 15 15:35:15.173771 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.364784    2588 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 15:35:15.173771 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.365709    2588 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-212.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 15:35:15.173771 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.365732    2588 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-212.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 15:35:15.173771 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.365744    2588 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-212.ec2.internal" event="NodeHasSufficientPID"
Jul 15 15:35:15.173771 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.367071    2588 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 15:35:15.173771 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.367182    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-212.ec2.internal"
Jul 15 15:35:15.173771 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.367206    2588 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 15:35:15.173771 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.367786    2588 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-212.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 15:35:15.173771 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.367798    2588 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-212.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 15:35:15.173771 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.367808    2588 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-212.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 15:35:15.173771 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.367817    2588 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-212.ec2.internal" event="NodeHasSufficientPID"
Jul 15 15:35:15.173771 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.367821    2588 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-212.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 15:35:15.173771 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.367831    2588 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-212.ec2.internal" event="NodeHasSufficientPID"
Jul 15 15:35:15.173771 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.368922    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-212.ec2.internal"
Jul 15 15:35:15.173771 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.368948    2588 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 15:35:15.173771 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.369621    2588 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-212.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 15:35:15.173771 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.369644    2588 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-212.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 15:35:15.173771 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:13.369654    2588 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-212.ec2.internal" event="NodeHasSufficientPID"
Jul 15 15:35:15.173771 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:15.019281    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/f3408ae23f1a053500507023d7c42ba8-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-212.ec2.internal\" (UID: \"f3408ae23f1a053500507023d7c42ba8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-212.ec2.internal"
Jul 15 15:35:15.175135 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:15.019302    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f3408ae23f1a053500507023d7c42ba8-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-212.ec2.internal\" (UID: \"f3408ae23f1a053500507023d7c42ba8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-212.ec2.internal"
Jul 15 15:35:15.175135 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:15.019319    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/83cd7df02ad08b5cd140b5486992b652-config\") pod \"kube-apiserver-proxy-ip-10-0-140-212.ec2.internal\" (UID: \"83cd7df02ad08b5cd140b5486992b652\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-212.ec2.internal"
Jul 15 15:35:15.175135 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:35:15.027436    2588 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-212.ec2.internal\" not found"
Jul 15 15:35:15.175135 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:35:15.029833    2588 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-212.ec2.internal\" not found" node="ip-10-0-140-212.ec2.internal"
Jul 15 15:35:15.175135 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:35:15.033380    2588 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-212.ec2.internal\" not found" node="ip-10-0-140-212.ec2.internal"
Jul 15 15:35:15.175135 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:15.120032    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/f3408ae23f1a053500507023d7c42ba8-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-212.ec2.internal\" (UID: \"f3408ae23f1a053500507023d7c42ba8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-212.ec2.internal"
Jul 15 15:35:15.175135 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:15.120052    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f3408ae23f1a053500507023d7c42ba8-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-212.ec2.internal\" (UID: \"f3408ae23f1a053500507023d7c42ba8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-212.ec2.internal"
Jul 15 15:35:15.175135 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:15.120074    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/83cd7df02ad08b5cd140b5486992b652-config\") pod \"kube-apiserver-proxy-ip-10-0-140-212.ec2.internal\" (UID: \"83cd7df02ad08b5cd140b5486992b652\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-212.ec2.internal"
Jul 15 15:35:15.175135 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:15.120121    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/83cd7df02ad08b5cd140b5486992b652-config\") pod \"kube-apiserver-proxy-ip-10-0-140-212.ec2.internal\" (UID: \"83cd7df02ad08b5cd140b5486992b652\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-212.ec2.internal"
Jul 15 15:35:15.175135 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:15.120131    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/f3408ae23f1a053500507023d7c42ba8-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-212.ec2.internal\" (UID: \"f3408ae23f1a053500507023d7c42ba8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-212.ec2.internal"
Jul 15 15:35:15.175135 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:15.120142    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f3408ae23f1a053500507023d7c42ba8-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-212.ec2.internal\" (UID: \"f3408ae23f1a053500507023d7c42ba8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-212.ec2.internal"
Jul 15 15:35:15.175135 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:35:15.127930    2588 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-212.ec2.internal\" not found"
Jul 15 15:35:15.406797 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:35:15.228919    2588 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-212.ec2.internal\" not found"
Jul 15 15:35:15.406797 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:35:15.329374    2588 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-212.ec2.internal\" not found"
Jul 15 15:35:15.406797 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:15.332524    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-212.ec2.internal"
Jul 15 15:35:15.406797 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:15.336212    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-212.ec2.internal"
Jul 15 15:35:15.631069 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:35:15.430165    2588 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-212.ec2.internal\" not found"
Jul 15 15:35:15.631069 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:35:15.530628    2588 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-212.ec2.internal\" not found"
Jul 15 15:35:15.631265 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:35:15.631113    2588 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-212.ec2.internal\" not found"
Jul 15 15:35:15.846316 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:15.653380    2588 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 15 15:35:15.846316 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:15.653504    2588 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 15 15:35:15.846316 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:15.684287    2588 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 15 15:35:15.846316 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:15.714304    2588 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 15 15:35:15.846316 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:35:15.731944    2588 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-212.ec2.internal\" not found"
Jul 15 15:35:15.846316 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:15.755089    2588 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-14 15:30:14 +0000 UTC" deadline="2028-01-20 04:11:46.913535074 +0000 UTC"
Jul 15 15:35:15.846316 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:15.755111    2588 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13284h36m31.158426568s"
Jul 15 15:35:15.846316 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:35:15.832667    2588 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-212.ec2.internal\" not found"
Jul 15 15:35:16.017672 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:15.897851    2588 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 15:35:16.017672 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:15.899359    2588 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-212.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 15:35:16.017672 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:15.899392    2588 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-212.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 15:35:16.017672 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:15.899406    2588 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-212.ec2.internal" event="NodeHasSufficientPID"
Jul 15 15:35:16.017672 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:35:15.933512    2588 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-212.ec2.internal\" not found"
Jul 15 15:35:16.017672 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:15.996555    2588 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 15 15:35:16.017672 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:16.013746    2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3408ae23f1a053500507023d7c42ba8.slice/crio-1323cfc2e5a4dc56985037f8bf6002cb59484af70ae23fee65e35b269fe5d385 WatchSource:0}: Error finding container 1323cfc2e5a4dc56985037f8bf6002cb59484af70ae23fee65e35b269fe5d385: Status 404 returned error can't find the container with id 1323cfc2e5a4dc56985037f8bf6002cb59484af70ae23fee65e35b269fe5d385
Jul 15 15:35:16.017672 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:16.014083    2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83cd7df02ad08b5cd140b5486992b652.slice/crio-4bdd34521a689d31b22dd1b82e6a0fee25f3d097d702b3b55e4c6e60b32a1b93 WatchSource:0}: Error finding container 4bdd34521a689d31b22dd1b82e6a0fee25f3d097d702b3b55e4c6e60b32a1b93: Status 404 returned error can't find the container with id 4bdd34521a689d31b22dd1b82e6a0fee25f3d097d702b3b55e4c6e60b32a1b93
Jul 15 15:35:16.018178 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.017972    2588 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-212.ec2.internal"
Jul 15 15:35:16.020583 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.019923    2588 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 15 15:35:16.258026 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.033017    2588 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 15 15:35:16.258026 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.034617    2588 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-212.ec2.internal"
Jul 15 15:35:16.258026 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.041418    2588 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 15 15:35:16.765943 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.697238    2588 apiserver.go:52] "Watching apiserver"
Jul 15 15:35:16.765943 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.706389    2588 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 15 15:35:16.765943 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.707743    2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-nhrz9","kube-system/kube-apiserver-proxy-ip-10-0-140-212.ec2.internal","openshift-cluster-node-tuning-operator/tuned-wkp76","openshift-dns/node-resolver-wmcfh","openshift-multus/multus-additional-cni-plugins-qpqrs","openshift-multus/network-metrics-daemon-5xbsg","openshift-network-diagnostics/network-check-target-fgm54","openshift-network-operator/iptables-alerter-rx8tl","kube-system/global-pull-secret-syncer-n4kpw","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m9jzh","openshift-image-registry/node-ca-f7bpr","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-212.ec2.internal","openshift-multus/multus-vh644","openshift-ovn-kubernetes/ovnkube-node-dthn7"]
Jul 15 15:35:16.765943 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.712294    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-wmcfh"
Jul 15 15:35:16.765943 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.714461    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-nhrz9"
Jul 15 15:35:16.765943 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.715263    2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 15 15:35:16.765943 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.715299    2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-lmcwq\""
Jul 15 15:35:16.765943 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.715424    2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 15 15:35:16.765943 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.716627    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fgm54"
Jul 15 15:35:16.765943 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.716909    2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-rkldf\""
Jul 15 15:35:16.765943 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.717084    2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 15 15:35:16.765943 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.717201    2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 15 15:35:16.765943 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.721684    2588 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 15 15:35:16.765943 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:35:16.721675    2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fgm54" podUID="0383c465-26ac-4666-9180-4298272af4c7"
Jul 15 15:35:16.765943 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.721816    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-wkp76"
Jul 15 15:35:16.765943 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.722175    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-qpqrs"
Jul 15 15:35:16.765943 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.723373    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5xbsg"
Jul 15 15:35:16.765943 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:35:16.723443    2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5xbsg" podUID="0b8fbcd1-d8ee-49e6-bdf0-6818a2754992"
Jul 15 15:35:16.765943 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.724816    2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 15 15:35:16.765943 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.725267    2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 15 15:35:16.765943 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.725335    2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 15 15:35:16.765943 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.725474    2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 15 15:35:16.765943 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.725481    2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-7j9bx\""
Jul 15 15:35:16.765943 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.725527    2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-hgtrw\""
Jul 15 15:35:16.765943 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.725706    2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 15 15:35:16.765943 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.725742    2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 15 15:35:16.765943 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.725849    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-rx8tl"
Jul 15 15:35:16.765943 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.726619    2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 15 15:35:16.765943 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.727932    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n4kpw"
Jul 15 15:35:16.765943 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:35:16.727980    2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n4kpw" podUID="542b7772-fe16-4f43-b9fb-e0d1538c5134"
Jul 15 15:35:16.767716 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.728200    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/788849c2-e862-481a-a2bb-e34e76030cc3-etc-sysconfig\") pod \"tuned-wkp76\" (UID: \"788849c2-e862-481a-a2bb-e34e76030cc3\") " pod="openshift-cluster-node-tuning-operator/tuned-wkp76"
Jul 15 15:35:16.767716 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.728226    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/788849c2-e862-481a-a2bb-e34e76030cc3-etc-kubernetes\") pod \"tuned-wkp76\" (UID: \"788849c2-e862-481a-a2bb-e34e76030cc3\") " pod="openshift-cluster-node-tuning-operator/tuned-wkp76"
Jul 15 15:35:16.767716 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.728244    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/788849c2-e862-481a-a2bb-e34e76030cc3-etc-sysctl-conf\") pod \"tuned-wkp76\" (UID: \"788849c2-e862-481a-a2bb-e34e76030cc3\") " pod="openshift-cluster-node-tuning-operator/tuned-wkp76"
Jul 15 15:35:16.767716 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.728259    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/788849c2-e862-481a-a2bb-e34e76030cc3-sys\") pod \"tuned-wkp76\" (UID: \"788849c2-e862-481a-a2bb-e34e76030cc3\") " pod="openshift-cluster-node-tuning-operator/tuned-wkp76"
Jul 15 15:35:16.767716 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.728281    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/788849c2-e862-481a-a2bb-e34e76030cc3-etc-sysctl-d\") pod \"tuned-wkp76\" (UID: \"788849c2-e862-481a-a2bb-e34e76030cc3\") " pod="openshift-cluster-node-tuning-operator/tuned-wkp76"
Jul 15 15:35:16.767716 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.728324    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/788849c2-e862-481a-a2bb-e34e76030cc3-run\") pod \"tuned-wkp76\" (UID: \"788849c2-e862-481a-a2bb-e34e76030cc3\") " pod="openshift-cluster-node-tuning-operator/tuned-wkp76"
Jul 15 15:35:16.767716 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.728380    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/788849c2-e862-481a-a2bb-e34e76030cc3-host\") pod \"tuned-wkp76\" (UID: \"788849c2-e862-481a-a2bb-e34e76030cc3\") " pod="openshift-cluster-node-tuning-operator/tuned-wkp76"
Jul 15 15:35:16.767716 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.728404    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/788849c2-e862-481a-a2bb-e34e76030cc3-etc-tuned\") pod \"tuned-wkp76\" (UID: \"788849c2-e862-481a-a2bb-e34e76030cc3\") " pod="openshift-cluster-node-tuning-operator/tuned-wkp76"
Jul 15 15:35:16.767716 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.728423    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/788849c2-e862-481a-a2bb-e34e76030cc3-tmp\") pod \"tuned-wkp76\" (UID: \"788849c2-e862-481a-a2bb-e34e76030cc3\") " pod="openshift-cluster-node-tuning-operator/tuned-wkp76"
Jul 15 15:35:16.767716 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.728440    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r4qxg\" (UniqueName: \"kubernetes.io/projected/788849c2-e862-481a-a2bb-e34e76030cc3-kube-api-access-r4qxg\") pod \"tuned-wkp76\" (UID: \"788849c2-e862-481a-a2bb-e34e76030cc3\") " pod="openshift-cluster-node-tuning-operator/tuned-wkp76"
Jul 15 15:35:16.767716 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.728457    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6d4c5bcd-e4af-48c1-a49c-00ebbf891ff1-hosts-file\") pod \"node-resolver-wmcfh\" (UID: \"6d4c5bcd-e4af-48c1-a49c-00ebbf891ff1\") " pod="openshift-dns/node-resolver-wmcfh"
Jul 15 15:35:16.767716 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.728468    2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 15 15:35:16.767716 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.728470    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/788849c2-e862-481a-a2bb-e34e76030cc3-var-lib-kubelet\") pod \"tuned-wkp76\" (UID: \"788849c2-e862-481a-a2bb-e34e76030cc3\") " pod="openshift-cluster-node-tuning-operator/tuned-wkp76"
Jul 15 15:35:16.767716 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.728517    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2mnhf\" (UniqueName: \"kubernetes.io/projected/6d4c5bcd-e4af-48c1-a49c-00ebbf891ff1-kube-api-access-2mnhf\") pod \"node-resolver-wmcfh\" (UID: \"6d4c5bcd-e4af-48c1-a49c-00ebbf891ff1\") " pod="openshift-dns/node-resolver-wmcfh"
Jul 15 15:35:16.767716 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.728553    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/71307173-3bbb-4ef7-9730-88a17f2552b0-agent-certs\") pod \"konnectivity-agent-nhrz9\" (UID: \"71307173-3bbb-4ef7-9730-88a17f2552b0\") " pod="kube-system/konnectivity-agent-nhrz9"
Jul 15 15:35:16.767716 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.728575    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/788849c2-e862-481a-a2bb-e34e76030cc3-etc-modprobe-d\") pod \"tuned-wkp76\" (UID: \"788849c2-e862-481a-a2bb-e34e76030cc3\") " pod="openshift-cluster-node-tuning-operator/tuned-wkp76"
Jul 15 15:35:16.767716 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.728595    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/788849c2-e862-481a-a2bb-e34e76030cc3-etc-systemd\") pod \"tuned-wkp76\" (UID: \"788849c2-e862-481a-a2bb-e34e76030cc3\") " pod="openshift-cluster-node-tuning-operator/tuned-wkp76"
Jul 15 15:35:16.768388 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.728633    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/788849c2-e862-481a-a2bb-e34e76030cc3-lib-modules\") pod \"tuned-wkp76\" (UID: \"788849c2-e862-481a-a2bb-e34e76030cc3\") " pod="openshift-cluster-node-tuning-operator/tuned-wkp76"
Jul 15 15:35:16.768388 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.728673    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6d4c5bcd-e4af-48c1-a49c-00ebbf891ff1-tmp-dir\") pod \"node-resolver-wmcfh\" (UID: \"6d4c5bcd-e4af-48c1-a49c-00ebbf891ff1\") " pod="openshift-dns/node-resolver-wmcfh"
Jul 15 15:35:16.768388 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.728701    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/71307173-3bbb-4ef7-9730-88a17f2552b0-konnectivity-ca\") pod \"konnectivity-agent-nhrz9\" (UID: \"71307173-3bbb-4ef7-9730-88a17f2552b0\") " pod="kube-system/konnectivity-agent-nhrz9"
Jul 15 15:35:16.768388 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.728730    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wh2pb\" (UniqueName: \"kubernetes.io/projected/0383c465-26ac-4666-9180-4298272af4c7-kube-api-access-wh2pb\") pod \"network-check-target-fgm54\" (UID: \"0383c465-26ac-4666-9180-4298272af4c7\") " pod="openshift-network-diagnostics/network-check-target-fgm54"
Jul 15 15:35:16.768388 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.729472    2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 15 15:35:16.768388 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.729516    2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 15 15:35:16.768388 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.729550    2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-crbn5\""
Jul 15 15:35:16.768388 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.730196    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m9jzh"
Jul 15 15:35:16.768388 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.732594    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-f7bpr"
Jul 15 15:35:16.768388 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.734913    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-vh644"
Jul 15 15:35:16.768388 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.737386    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-dthn7"
Jul 15 15:35:16.768388 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.748506    2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 15 15:35:16.768388 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.748555    2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 15 15:35:16.768388 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.748641    2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-gz9fs\""
Jul 15 15:35:16.768388 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.748675    2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 15 15:35:16.768388 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.748827    2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 15 15:35:16.768388 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.749065    2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 15 15:35:16.768388 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.749113    2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 15 15:35:16.768388 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.749230    2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 15 15:35:16.768388 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.749394    2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 15 15:35:16.768388 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.749430    2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 15 15:35:16.768388 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.749515    2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-dvc7d\""
Jul 15 15:35:16.768388 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.749548    2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-q82vz\""
Jul 15 15:35:16.768388 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.749900    2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 15 15:35:16.768388 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.749918    2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-fj8dk\""
Jul 15 15:35:16.768388 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.749989    2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 15 15:35:16.768388 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.750132    2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 15 15:35:16.768388 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.750162    2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 15 15:35:16.768388 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.750813    2588 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 15 15:35:16.768388 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.757691    2588 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-6gxgl"
Jul 15 15:35:16.768388 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.766414    2588 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-6gxgl"
Jul 15 15:35:16.919197 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.819065    2588 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 15 15:35:16.919197 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.829822    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/788849c2-e862-481a-a2bb-e34e76030cc3-etc-modprobe-d\") pod \"tuned-wkp76\" (UID: \"788849c2-e862-481a-a2bb-e34e76030cc3\") " pod="openshift-cluster-node-tuning-operator/tuned-wkp76"
Jul 15 15:35:16.919197 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.829868    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-twfhr\" (UniqueName: \"kubernetes.io/projected/0b8fbcd1-d8ee-49e6-bdf0-6818a2754992-kube-api-access-twfhr\") pod \"network-metrics-daemon-5xbsg\" (UID: \"0b8fbcd1-d8ee-49e6-bdf0-6818a2754992\") " pod="openshift-multus/network-metrics-daemon-5xbsg"
Jul 15 15:35:16.919197 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.829912    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6dwn5\" (UniqueName: \"kubernetes.io/projected/be0dcd2c-0e4a-47d0-a26e-b178256de470-kube-api-access-6dwn5\") pod \"iptables-alerter-rx8tl\" (UID: \"be0dcd2c-0e4a-47d0-a26e-b178256de470\") " pod="openshift-network-operator/iptables-alerter-rx8tl"
Jul 15 15:35:16.919197 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.829933    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e7a6e261-bdc8-4f06-883e-34d9d91b4434-sys-fs\") pod \"aws-ebs-csi-driver-node-m9jzh\" (UID: \"e7a6e261-bdc8-4f06-883e-34d9d91b4434\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m9jzh"
Jul 15 15:35:16.919197 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.829957    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/71307173-3bbb-4ef7-9730-88a17f2552b0-konnectivity-ca\") pod \"konnectivity-agent-nhrz9\" (UID: \"71307173-3bbb-4ef7-9730-88a17f2552b0\") " pod="kube-system/konnectivity-agent-nhrz9"
Jul 15 15:35:16.919197 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.829977    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/788849c2-e862-481a-a2bb-e34e76030cc3-etc-sysconfig\") pod \"tuned-wkp76\" (UID: \"788849c2-e862-481a-a2bb-e34e76030cc3\") " pod="openshift-cluster-node-tuning-operator/tuned-wkp76"
Jul 15 15:35:16.919197 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.829982    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/788849c2-e862-481a-a2bb-e34e76030cc3-etc-modprobe-d\") pod \"tuned-wkp76\" (UID: \"788849c2-e862-481a-a2bb-e34e76030cc3\") " pod="openshift-cluster-node-tuning-operator/tuned-wkp76"
Jul 15 15:35:16.919197 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.829997    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/788849c2-e862-481a-a2bb-e34e76030cc3-etc-sysctl-conf\") pod \"tuned-wkp76\" (UID: \"788849c2-e862-481a-a2bb-e34e76030cc3\") " pod="openshift-cluster-node-tuning-operator/tuned-wkp76"
Jul 15 15:35:16.919197 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.830033    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/788849c2-e862-481a-a2bb-e34e76030cc3-host\") pod \"tuned-wkp76\" (UID: \"788849c2-e862-481a-a2bb-e34e76030cc3\") " pod="openshift-cluster-node-tuning-operator/tuned-wkp76"
Jul 15 15:35:16.919197 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.830071    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/788849c2-e862-481a-a2bb-e34e76030cc3-etc-sysconfig\") pod \"tuned-wkp76\" (UID: \"788849c2-e862-481a-a2bb-e34e76030cc3\") " pod="openshift-cluster-node-tuning-operator/tuned-wkp76"
Jul 15 15:35:16.919197 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.830112    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/788849c2-e862-481a-a2bb-e34e76030cc3-host\") pod \"tuned-wkp76\" (UID: \"788849c2-e862-481a-a2bb-e34e76030cc3\") " pod="openshift-cluster-node-tuning-operator/tuned-wkp76"
Jul 15 15:35:16.919197 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.830138    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e7a6e261-bdc8-4f06-883e-34d9d91b4434-device-dir\") pod \"aws-ebs-csi-driver-node-m9jzh\" (UID: \"e7a6e261-bdc8-4f06-883e-34d9d91b4434\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m9jzh"
Jul 15 15:35:16.919197 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.830167    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e7a6e261-bdc8-4f06-883e-34d9d91b4434-etc-selinux\") pod \"aws-ebs-csi-driver-node-m9jzh\" (UID: \"e7a6e261-bdc8-4f06-883e-34d9d91b4434\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m9jzh"
Jul 15 15:35:16.919197 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.830188    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d64071a5-5f14-450d-99d6-f9295b7b0edc-os-release\") pod \"multus-additional-cni-plugins-qpqrs\" (UID: \"d64071a5-5f14-450d-99d6-f9295b7b0edc\") " pod="openshift-multus/multus-additional-cni-plugins-qpqrs"
Jul 15 15:35:16.919197 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.830213    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d64071a5-5f14-450d-99d6-f9295b7b0edc-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-qpqrs\" (UID: \"d64071a5-5f14-450d-99d6-f9295b7b0edc\") " pod="openshift-multus/multus-additional-cni-plugins-qpqrs"
Jul 15 15:35:16.919197 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.830241    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/788849c2-e862-481a-a2bb-e34e76030cc3-etc-sysctl-d\") pod \"tuned-wkp76\" (UID: \"788849c2-e862-481a-a2bb-e34e76030cc3\") " pod="openshift-cluster-node-tuning-operator/tuned-wkp76"
Jul 15 15:35:16.920952 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.830279    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/baf9a41e-5bae-4ec3-acbe-9d3f88e05149-multus-socket-dir-parent\") pod \"multus-vh644\" (UID: \"baf9a41e-5bae-4ec3-acbe-9d3f88e05149\") " pod="openshift-multus/multus-vh644"
Jul 15 15:35:16.920952 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.830318    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/542b7772-fe16-4f43-b9fb-e0d1538c5134-dbus\") pod \"global-pull-secret-syncer-n4kpw\" (UID: \"542b7772-fe16-4f43-b9fb-e0d1538c5134\") " pod="kube-system/global-pull-secret-syncer-n4kpw"
Jul 15 15:35:16.920952 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.830367    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ec82e02f-7632-41be-8e7d-8c9d59c569b6-env-overrides\") pod \"ovnkube-node-dthn7\" (UID: \"ec82e02f-7632-41be-8e7d-8c9d59c569b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-dthn7"
Jul 15 15:35:16.920952 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.830391    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/788849c2-e862-481a-a2bb-e34e76030cc3-lib-modules\") pod \"tuned-wkp76\" (UID: \"788849c2-e862-481a-a2bb-e34e76030cc3\") " pod="openshift-cluster-node-tuning-operator/tuned-wkp76"
Jul 15 15:35:16.920952 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.830414    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ec82e02f-7632-41be-8e7d-8c9d59c569b6-host-slash\") pod \"ovnkube-node-dthn7\" (UID: \"ec82e02f-7632-41be-8e7d-8c9d59c569b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-dthn7"
Jul 15 15:35:16.920952 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.830414    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/788849c2-e862-481a-a2bb-e34e76030cc3-etc-sysctl-d\") pod \"tuned-wkp76\" (UID: \"788849c2-e862-481a-a2bb-e34e76030cc3\") " pod="openshift-cluster-node-tuning-operator/tuned-wkp76"
Jul 15 15:35:16.920952 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.830439    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ec82e02f-7632-41be-8e7d-8c9d59c569b6-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-dthn7\" (UID: \"ec82e02f-7632-41be-8e7d-8c9d59c569b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-dthn7"
Jul 15 15:35:16.920952 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.830497    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/788849c2-e862-481a-a2bb-e34e76030cc3-lib-modules\") pod \"tuned-wkp76\" (UID: \"788849c2-e862-481a-a2bb-e34e76030cc3\") " pod="openshift-cluster-node-tuning-operator/tuned-wkp76"
Jul 15 15:35:16.920952 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.830501    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d64071a5-5f14-450d-99d6-f9295b7b0edc-tuning-conf-dir\") pod \"multus-additional-cni-plugins-qpqrs\" (UID: \"d64071a5-5f14-450d-99d6-f9295b7b0edc\") " pod="openshift-multus/multus-additional-cni-plugins-qpqrs"
Jul 15 15:35:16.920952 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.830538    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d64071a5-5f14-450d-99d6-f9295b7b0edc-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-qpqrs\" (UID: \"d64071a5-5f14-450d-99d6-f9295b7b0edc\") " pod="openshift-multus/multus-additional-cni-plugins-qpqrs"
Jul 15 15:35:16.920952 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.830560    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/788849c2-e862-481a-a2bb-e34e76030cc3-sys\") pod \"tuned-wkp76\" (UID: \"788849c2-e862-481a-a2bb-e34e76030cc3\") " pod="openshift-cluster-node-tuning-operator/tuned-wkp76"
Jul 15 15:35:16.920952 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.830585    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/baf9a41e-5bae-4ec3-acbe-9d3f88e05149-multus-conf-dir\") pod \"multus-vh644\" (UID: \"baf9a41e-5bae-4ec3-acbe-9d3f88e05149\") " pod="openshift-multus/multus-vh644"
Jul 15 15:35:16.920952 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.830610    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/788849c2-e862-481a-a2bb-e34e76030cc3-etc-tuned\") pod \"tuned-wkp76\" (UID: \"788849c2-e862-481a-a2bb-e34e76030cc3\") " pod="openshift-cluster-node-tuning-operator/tuned-wkp76"
Jul 15 15:35:16.920952 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.830614    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/788849c2-e862-481a-a2bb-e34e76030cc3-sys\") pod \"tuned-wkp76\" (UID: \"788849c2-e862-481a-a2bb-e34e76030cc3\") " pod="openshift-cluster-node-tuning-operator/tuned-wkp76"
Jul 15 15:35:16.920952 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.830633    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/788849c2-e862-481a-a2bb-e34e76030cc3-tmp\") pod \"tuned-wkp76\" (UID: \"788849c2-e862-481a-a2bb-e34e76030cc3\") " pod="openshift-cluster-node-tuning-operator/tuned-wkp76"
Jul 15 15:35:16.920952 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.830657    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ec82e02f-7632-41be-8e7d-8c9d59c569b6-systemd-units\") pod \"ovnkube-node-dthn7\" (UID: \"ec82e02f-7632-41be-8e7d-8c9d59c569b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-dthn7"
Jul 15 15:35:16.920952 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.830664    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/71307173-3bbb-4ef7-9730-88a17f2552b0-konnectivity-ca\") pod \"konnectivity-agent-nhrz9\" (UID: \"71307173-3bbb-4ef7-9730-88a17f2552b0\") " pod="kube-system/konnectivity-agent-nhrz9"
Jul 15 15:35:16.922155 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.830680    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e7a6e261-bdc8-4f06-883e-34d9d91b4434-kubelet-dir\") pod \"aws-ebs-csi-driver-node-m9jzh\" (UID: \"e7a6e261-bdc8-4f06-883e-34d9d91b4434\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m9jzh"
Jul 15 15:35:16.922155 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.830703    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kkpfd\" (UniqueName: \"kubernetes.io/projected/e7a6e261-bdc8-4f06-883e-34d9d91b4434-kube-api-access-kkpfd\") pod \"aws-ebs-csi-driver-node-m9jzh\" (UID: \"e7a6e261-bdc8-4f06-883e-34d9d91b4434\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m9jzh"
Jul 15 15:35:16.922155 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.830745    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/788849c2-e862-481a-a2bb-e34e76030cc3-etc-sysctl-conf\") pod \"tuned-wkp76\" (UID: \"788849c2-e862-481a-a2bb-e34e76030cc3\") " pod="openshift-cluster-node-tuning-operator/tuned-wkp76"
Jul 15 15:35:16.922155 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.830753    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6d4c5bcd-e4af-48c1-a49c-00ebbf891ff1-hosts-file\") pod \"node-resolver-wmcfh\" (UID: \"6d4c5bcd-e4af-48c1-a49c-00ebbf891ff1\") " pod="openshift-dns/node-resolver-wmcfh"
Jul 15 15:35:16.922155 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.830786    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/788849c2-e862-481a-a2bb-e34e76030cc3-var-lib-kubelet\") pod \"tuned-wkp76\" (UID: \"788849c2-e862-481a-a2bb-e34e76030cc3\") " pod="openshift-cluster-node-tuning-operator/tuned-wkp76"
Jul 15 15:35:16.922155 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.830811    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ec82e02f-7632-41be-8e7d-8c9d59c569b6-log-socket\") pod \"ovnkube-node-dthn7\" (UID: \"ec82e02f-7632-41be-8e7d-8c9d59c569b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-dthn7"
Jul 15 15:35:16.922155 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.830845    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ec82e02f-7632-41be-8e7d-8c9d59c569b6-host-cni-bin\") pod \"ovnkube-node-dthn7\" (UID: \"ec82e02f-7632-41be-8e7d-8c9d59c569b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-dthn7"
Jul 15 15:35:16.922155 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.830860    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/788849c2-e862-481a-a2bb-e34e76030cc3-var-lib-kubelet\") pod \"tuned-wkp76\" (UID: \"788849c2-e862-481a-a2bb-e34e76030cc3\") " pod="openshift-cluster-node-tuning-operator/tuned-wkp76"
Jul 15 15:35:16.922155 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.830867    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6d4c5bcd-e4af-48c1-a49c-00ebbf891ff1-hosts-file\") pod \"node-resolver-wmcfh\" (UID: \"6d4c5bcd-e4af-48c1-a49c-00ebbf891ff1\") " pod="openshift-dns/node-resolver-wmcfh"
Jul 15 15:35:16.922155 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.830878    2588 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 15 15:35:16.922155 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.830901    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ec82e02f-7632-41be-8e7d-8c9d59c569b6-ovnkube-script-lib\") pod \"ovnkube-node-dthn7\" (UID: \"ec82e02f-7632-41be-8e7d-8c9d59c569b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-dthn7"
Jul 15 15:35:16.922155 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.830924    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0b8fbcd1-d8ee-49e6-bdf0-6818a2754992-metrics-certs\") pod \"network-metrics-daemon-5xbsg\" (UID: \"0b8fbcd1-d8ee-49e6-bdf0-6818a2754992\") " pod="openshift-multus/network-metrics-daemon-5xbsg"
Jul 15 15:35:16.922155 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.830945    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/be0dcd2c-0e4a-47d0-a26e-b178256de470-iptables-alerter-script\") pod \"iptables-alerter-rx8tl\" (UID: \"be0dcd2c-0e4a-47d0-a26e-b178256de470\") " pod="openshift-network-operator/iptables-alerter-rx8tl"
Jul 15 15:35:16.922155 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.830964    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e7a6e261-bdc8-4f06-883e-34d9d91b4434-socket-dir\") pod \"aws-ebs-csi-driver-node-m9jzh\" (UID: \"e7a6e261-bdc8-4f06-883e-34d9d91b4434\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m9jzh"
Jul 15 15:35:16.922155 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.830986    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2mnhf\" (UniqueName: \"kubernetes.io/projected/6d4c5bcd-e4af-48c1-a49c-00ebbf891ff1-kube-api-access-2mnhf\") pod \"node-resolver-wmcfh\" (UID: \"6d4c5bcd-e4af-48c1-a49c-00ebbf891ff1\") " pod="openshift-dns/node-resolver-wmcfh"
Jul 15 15:35:16.922155 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.831009    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/71307173-3bbb-4ef7-9730-88a17f2552b0-agent-certs\") pod \"konnectivity-agent-nhrz9\" (UID: \"71307173-3bbb-4ef7-9730-88a17f2552b0\") " pod="kube-system/konnectivity-agent-nhrz9"
Jul 15 15:35:16.922155 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.831032    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/788849c2-e862-481a-a2bb-e34e76030cc3-etc-systemd\") pod \"tuned-wkp76\" (UID: \"788849c2-e862-481a-a2bb-e34e76030cc3\") " pod="openshift-cluster-node-tuning-operator/tuned-wkp76"
Jul 15 15:35:16.923214 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.831096    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/baf9a41e-5bae-4ec3-acbe-9d3f88e05149-host-run-k8s-cni-cncf-io\") pod \"multus-vh644\" (UID: \"baf9a41e-5bae-4ec3-acbe-9d3f88e05149\") " pod="openshift-multus/multus-vh644"
Jul 15 15:35:16.923214 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.831182    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/baf9a41e-5bae-4ec3-acbe-9d3f88e05149-host-var-lib-cni-multus\") pod \"multus-vh644\" (UID: \"baf9a41e-5bae-4ec3-acbe-9d3f88e05149\") " pod="openshift-multus/multus-vh644"
Jul 15 15:35:16.923214 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.831197    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/788849c2-e862-481a-a2bb-e34e76030cc3-etc-systemd\") pod \"tuned-wkp76\" (UID: \"788849c2-e862-481a-a2bb-e34e76030cc3\") " pod="openshift-cluster-node-tuning-operator/tuned-wkp76"
Jul 15 15:35:16.923214 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.831217    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/baf9a41e-5bae-4ec3-acbe-9d3f88e05149-hostroot\") pod \"multus-vh644\" (UID: \"baf9a41e-5bae-4ec3-acbe-9d3f88e05149\") " pod="openshift-multus/multus-vh644"
Jul 15 15:35:16.923214 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.831256    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wh2pb\" (UniqueName: \"kubernetes.io/projected/0383c465-26ac-4666-9180-4298272af4c7-kube-api-access-wh2pb\") pod \"network-check-target-fgm54\" (UID: \"0383c465-26ac-4666-9180-4298272af4c7\") " pod="openshift-network-diagnostics/network-check-target-fgm54"
Jul 15 15:35:16.923214 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.831291    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/788849c2-e862-481a-a2bb-e34e76030cc3-etc-kubernetes\") pod \"tuned-wkp76\" (UID: \"788849c2-e862-481a-a2bb-e34e76030cc3\") " pod="openshift-cluster-node-tuning-operator/tuned-wkp76"
Jul 15 15:35:16.923214 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.831399    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/788849c2-e862-481a-a2bb-e34e76030cc3-etc-kubernetes\") pod \"tuned-wkp76\" (UID: \"788849c2-e862-481a-a2bb-e34e76030cc3\") " pod="openshift-cluster-node-tuning-operator/tuned-wkp76"
Jul 15 15:35:16.923214 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.831421    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ec82e02f-7632-41be-8e7d-8c9d59c569b6-var-lib-openvswitch\") pod \"ovnkube-node-dthn7\" (UID: \"ec82e02f-7632-41be-8e7d-8c9d59c569b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-dthn7"
Jul 15 15:35:16.923214 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.831447    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ec82e02f-7632-41be-8e7d-8c9d59c569b6-host-run-ovn-kubernetes\") pod \"ovnkube-node-dthn7\" (UID: \"ec82e02f-7632-41be-8e7d-8c9d59c569b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-dthn7"
Jul 15 15:35:16.923214 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.831462    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ec82e02f-7632-41be-8e7d-8c9d59c569b6-host-cni-netd\") pod \"ovnkube-node-dthn7\" (UID: \"ec82e02f-7632-41be-8e7d-8c9d59c569b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-dthn7"
Jul 15 15:35:16.923214 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.831478    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b8bp6\" (UniqueName: \"kubernetes.io/projected/ec82e02f-7632-41be-8e7d-8c9d59c569b6-kube-api-access-b8bp6\") pod \"ovnkube-node-dthn7\" (UID: \"ec82e02f-7632-41be-8e7d-8c9d59c569b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-dthn7"
Jul 15 15:35:16.923214 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.831500    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0bc9e977-62dc-48b4-bd53-a6ae3de45690-host\") pod \"node-ca-f7bpr\" (UID: \"0bc9e977-62dc-48b4-bd53-a6ae3de45690\") " pod="openshift-image-registry/node-ca-f7bpr"
Jul 15 15:35:16.923214 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.831522    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ec82e02f-7632-41be-8e7d-8c9d59c569b6-host-kubelet\") pod \"ovnkube-node-dthn7\" (UID: \"ec82e02f-7632-41be-8e7d-8c9d59c569b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-dthn7"
Jul 15 15:35:16.923214 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.831540    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ec82e02f-7632-41be-8e7d-8c9d59c569b6-run-openvswitch\") pod \"ovnkube-node-dthn7\" (UID: \"ec82e02f-7632-41be-8e7d-8c9d59c569b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-dthn7"
Jul 15 15:35:16.923214 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.831553    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ec82e02f-7632-41be-8e7d-8c9d59c569b6-ovnkube-config\") pod \"ovnkube-node-dthn7\" (UID: \"ec82e02f-7632-41be-8e7d-8c9d59c569b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-dthn7"
Jul 15 15:35:16.923214 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.831569    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/baf9a41e-5bae-4ec3-acbe-9d3f88e05149-multus-cni-dir\") pod \"multus-vh644\" (UID: \"baf9a41e-5bae-4ec3-acbe-9d3f88e05149\") " pod="openshift-multus/multus-vh644"
Jul 15 15:35:16.923214 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.831607    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/baf9a41e-5bae-4ec3-acbe-9d3f88e05149-host-run-multus-certs\") pod \"multus-vh644\" (UID: \"baf9a41e-5bae-4ec3-acbe-9d3f88e05149\") " pod="openshift-multus/multus-vh644"
Jul 15 15:35:16.924919 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.831644    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ec82e02f-7632-41be-8e7d-8c9d59c569b6-ovn-node-metrics-cert\") pod \"ovnkube-node-dthn7\" (UID: \"ec82e02f-7632-41be-8e7d-8c9d59c569b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-dthn7"
Jul 15 15:35:16.924919 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.831671    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e7a6e261-bdc8-4f06-883e-34d9d91b4434-registration-dir\") pod \"aws-ebs-csi-driver-node-m9jzh\" (UID: \"e7a6e261-bdc8-4f06-883e-34d9d91b4434\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m9jzh"
Jul 15 15:35:16.924919 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.831690    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/baf9a41e-5bae-4ec3-acbe-9d3f88e05149-host-run-netns\") pod \"multus-vh644\" (UID: \"baf9a41e-5bae-4ec3-acbe-9d3f88e05149\") " pod="openshift-multus/multus-vh644"
Jul 15 15:35:16.924919 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.831704    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ec82e02f-7632-41be-8e7d-8c9d59c569b6-run-ovn\") pod \"ovnkube-node-dthn7\" (UID: \"ec82e02f-7632-41be-8e7d-8c9d59c569b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-dthn7"
Jul 15 15:35:16.924919 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.831717    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/0bc9e977-62dc-48b4-bd53-a6ae3de45690-serviceca\") pod \"node-ca-f7bpr\" (UID: \"0bc9e977-62dc-48b4-bd53-a6ae3de45690\") " pod="openshift-image-registry/node-ca-f7bpr"
Jul 15 15:35:16.924919 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.831733    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/baf9a41e-5bae-4ec3-acbe-9d3f88e05149-cni-binary-copy\") pod \"multus-vh644\" (UID: \"baf9a41e-5bae-4ec3-acbe-9d3f88e05149\") " pod="openshift-multus/multus-vh644"
Jul 15 15:35:16.924919 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.831757    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/baf9a41e-5bae-4ec3-acbe-9d3f88e05149-etc-kubernetes\") pod \"multus-vh644\" (UID: \"baf9a41e-5bae-4ec3-acbe-9d3f88e05149\") " pod="openshift-multus/multus-vh644"
Jul 15 15:35:16.924919 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.831773    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xsxf7\" (UniqueName: \"kubernetes.io/projected/baf9a41e-5bae-4ec3-acbe-9d3f88e05149-kube-api-access-xsxf7\") pod \"multus-vh644\" (UID: \"baf9a41e-5bae-4ec3-acbe-9d3f88e05149\") " pod="openshift-multus/multus-vh644"
Jul 15 15:35:16.924919 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.831788    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d64071a5-5f14-450d-99d6-f9295b7b0edc-cni-binary-copy\") pod \"multus-additional-cni-plugins-qpqrs\" (UID: \"d64071a5-5f14-450d-99d6-f9295b7b0edc\") " pod="openshift-multus/multus-additional-cni-plugins-qpqrs"
Jul 15 15:35:16.924919 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.831803    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d6bkl\" (UniqueName: \"kubernetes.io/projected/d64071a5-5f14-450d-99d6-f9295b7b0edc-kube-api-access-d6bkl\") pod \"multus-additional-cni-plugins-qpqrs\" (UID: \"d64071a5-5f14-450d-99d6-f9295b7b0edc\") " pod="openshift-multus/multus-additional-cni-plugins-qpqrs"
Jul 15 15:35:16.924919 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.831828    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6d4c5bcd-e4af-48c1-a49c-00ebbf891ff1-tmp-dir\") pod \"node-resolver-wmcfh\" (UID: \"6d4c5bcd-e4af-48c1-a49c-00ebbf891ff1\") " pod="openshift-dns/node-resolver-wmcfh"
Jul 15 15:35:16.924919 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.831859    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r4qxg\" (UniqueName: \"kubernetes.io/projected/788849c2-e862-481a-a2bb-e34e76030cc3-kube-api-access-r4qxg\") pod \"tuned-wkp76\" (UID: \"788849c2-e862-481a-a2bb-e34e76030cc3\") " pod="openshift-cluster-node-tuning-operator/tuned-wkp76"
Jul 15 15:35:16.924919 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.831915    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ec82e02f-7632-41be-8e7d-8c9d59c569b6-etc-openvswitch\") pod \"ovnkube-node-dthn7\" (UID: \"ec82e02f-7632-41be-8e7d-8c9d59c569b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-dthn7"
Jul 15 15:35:16.924919 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.831946    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ec82e02f-7632-41be-8e7d-8c9d59c569b6-node-log\") pod \"ovnkube-node-dthn7\" (UID: \"ec82e02f-7632-41be-8e7d-8c9d59c569b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-dthn7"
Jul 15 15:35:16.924919 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.831973    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/baf9a41e-5bae-4ec3-acbe-9d3f88e05149-os-release\") pod \"multus-vh644\" (UID: \"baf9a41e-5bae-4ec3-acbe-9d3f88e05149\") " pod="openshift-multus/multus-vh644"
Jul 15 15:35:16.924919 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.832004    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/baf9a41e-5bae-4ec3-acbe-9d3f88e05149-multus-daemon-config\") pod \"multus-vh644\" (UID: \"baf9a41e-5bae-4ec3-acbe-9d3f88e05149\") " pod="openshift-multus/multus-vh644"
Jul 15 15:35:16.924919 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.832033    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d64071a5-5f14-450d-99d6-f9295b7b0edc-system-cni-dir\") pod \"multus-additional-cni-plugins-qpqrs\" (UID: \"d64071a5-5f14-450d-99d6-f9295b7b0edc\") " pod="openshift-multus/multus-additional-cni-plugins-qpqrs"
Jul 15 15:35:16.926152 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.832056    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d64071a5-5f14-450d-99d6-f9295b7b0edc-cnibin\") pod \"multus-additional-cni-plugins-qpqrs\" (UID: \"d64071a5-5f14-450d-99d6-f9295b7b0edc\") " pod="openshift-multus/multus-additional-cni-plugins-qpqrs"
Jul 15 15:35:16.926152 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.832086    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6d4c5bcd-e4af-48c1-a49c-00ebbf891ff1-tmp-dir\") pod \"node-resolver-wmcfh\" (UID: \"6d4c5bcd-e4af-48c1-a49c-00ebbf891ff1\") " pod="openshift-dns/node-resolver-wmcfh"
Jul 15 15:35:16.926152 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.832105    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/788849c2-e862-481a-a2bb-e34e76030cc3-run\") pod \"tuned-wkp76\" (UID: \"788849c2-e862-481a-a2bb-e34e76030cc3\") " pod="openshift-cluster-node-tuning-operator/tuned-wkp76"
Jul 15 15:35:16.926152 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.832129    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/be0dcd2c-0e4a-47d0-a26e-b178256de470-host-slash\") pod \"iptables-alerter-rx8tl\" (UID: \"be0dcd2c-0e4a-47d0-a26e-b178256de470\") " pod="openshift-network-operator/iptables-alerter-rx8tl"
Jul 15 15:35:16.926152 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.832170    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/baf9a41e-5bae-4ec3-acbe-9d3f88e05149-host-var-lib-cni-bin\") pod \"multus-vh644\" (UID: \"baf9a41e-5bae-4ec3-acbe-9d3f88e05149\") " pod="openshift-multus/multus-vh644"
Jul 15 15:35:16.926152 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.832174    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/788849c2-e862-481a-a2bb-e34e76030cc3-run\") pod \"tuned-wkp76\" (UID: \"788849c2-e862-481a-a2bb-e34e76030cc3\") " pod="openshift-cluster-node-tuning-operator/tuned-wkp76"
Jul 15 15:35:16.926152 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.832199    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/542b7772-fe16-4f43-b9fb-e0d1538c5134-kubelet-config\") pod \"global-pull-secret-syncer-n4kpw\" (UID: \"542b7772-fe16-4f43-b9fb-e0d1538c5134\") " pod="kube-system/global-pull-secret-syncer-n4kpw"
Jul 15 15:35:16.926152 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.832218    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/542b7772-fe16-4f43-b9fb-e0d1538c5134-original-pull-secret\") pod \"global-pull-secret-syncer-n4kpw\" (UID: \"542b7772-fe16-4f43-b9fb-e0d1538c5134\") " pod="kube-system/global-pull-secret-syncer-n4kpw"
Jul 15 15:35:16.926152 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.832247    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ec82e02f-7632-41be-8e7d-8c9d59c569b6-host-run-netns\") pod \"ovnkube-node-dthn7\" (UID: \"ec82e02f-7632-41be-8e7d-8c9d59c569b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-dthn7"
Jul 15 15:35:16.926152 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.832266    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ec82e02f-7632-41be-8e7d-8c9d59c569b6-run-systemd\") pod \"ovnkube-node-dthn7\" (UID: \"ec82e02f-7632-41be-8e7d-8c9d59c569b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-dthn7"
Jul 15 15:35:16.926152 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.832291    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9dl4m\" (UniqueName: \"kubernetes.io/projected/0bc9e977-62dc-48b4-bd53-a6ae3de45690-kube-api-access-9dl4m\") pod \"node-ca-f7bpr\" (UID: \"0bc9e977-62dc-48b4-bd53-a6ae3de45690\") " pod="openshift-image-registry/node-ca-f7bpr"
Jul 15 15:35:16.926152 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.832311    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/baf9a41e-5bae-4ec3-acbe-9d3f88e05149-system-cni-dir\") pod \"multus-vh644\" (UID: \"baf9a41e-5bae-4ec3-acbe-9d3f88e05149\") " pod="openshift-multus/multus-vh644"
Jul 15 15:35:16.926152 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.832326    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/baf9a41e-5bae-4ec3-acbe-9d3f88e05149-cnibin\") pod \"multus-vh644\" (UID: \"baf9a41e-5bae-4ec3-acbe-9d3f88e05149\") " pod="openshift-multus/multus-vh644"
Jul 15 15:35:16.926152 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.832362    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/baf9a41e-5bae-4ec3-acbe-9d3f88e05149-host-var-lib-kubelet\") pod \"multus-vh644\" (UID: \"baf9a41e-5bae-4ec3-acbe-9d3f88e05149\") " pod="openshift-multus/multus-vh644"
Jul 15 15:35:16.926152 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.834430    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/788849c2-e862-481a-a2bb-e34e76030cc3-etc-tuned\") pod \"tuned-wkp76\" (UID: \"788849c2-e862-481a-a2bb-e34e76030cc3\") " pod="openshift-cluster-node-tuning-operator/tuned-wkp76"
Jul 15 15:35:16.926152 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.834463    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/788849c2-e862-481a-a2bb-e34e76030cc3-tmp\") pod \"tuned-wkp76\" (UID: \"788849c2-e862-481a-a2bb-e34e76030cc3\") " pod="openshift-cluster-node-tuning-operator/tuned-wkp76"
Jul 15 15:35:16.926152 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.834721    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/71307173-3bbb-4ef7-9730-88a17f2552b0-agent-certs\") pod \"konnectivity-agent-nhrz9\" (UID: \"71307173-3bbb-4ef7-9730-88a17f2552b0\") " pod="kube-system/konnectivity-agent-nhrz9"
Jul 15 15:35:16.926152 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:35:16.838384    2588 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 15:35:16.927245 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:35:16.838407    2588 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 15:35:16.927245 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:35:16.838420    2588 projected.go:196] Error preparing data for projected volume kube-api-access-wh2pb for pod openshift-network-diagnostics/network-check-target-fgm54: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 15:35:16.927245 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:35:16.838481    2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0383c465-26ac-4666-9180-4298272af4c7-kube-api-access-wh2pb podName:0383c465-26ac-4666-9180-4298272af4c7 nodeName:}" failed. No retries permitted until 2026-07-15 15:35:17.338456314 +0000 UTC m=+2.990522068 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-wh2pb" (UniqueName: "kubernetes.io/projected/0383c465-26ac-4666-9180-4298272af4c7-kube-api-access-wh2pb") pod "network-check-target-fgm54" (UID: "0383c465-26ac-4666-9180-4298272af4c7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 15:35:16.927245 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.840997    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2mnhf\" (UniqueName: \"kubernetes.io/projected/6d4c5bcd-e4af-48c1-a49c-00ebbf891ff1-kube-api-access-2mnhf\") pod \"node-resolver-wmcfh\" (UID: \"6d4c5bcd-e4af-48c1-a49c-00ebbf891ff1\") " pod="openshift-dns/node-resolver-wmcfh"
Jul 15 15:35:16.927245 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.841658    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r4qxg\" (UniqueName: \"kubernetes.io/projected/788849c2-e862-481a-a2bb-e34e76030cc3-kube-api-access-r4qxg\") pod \"tuned-wkp76\" (UID: \"788849c2-e862-481a-a2bb-e34e76030cc3\") " pod="openshift-cluster-node-tuning-operator/tuned-wkp76"
Jul 15 15:35:16.927245 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.916431    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-212.ec2.internal" event={"ID":"83cd7df02ad08b5cd140b5486992b652","Type":"ContainerStarted","Data":"4bdd34521a689d31b22dd1b82e6a0fee25f3d097d702b3b55e4c6e60b32a1b93"}
Jul 15 15:35:16.927245 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.917641    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-212.ec2.internal" event={"ID":"f3408ae23f1a053500507023d7c42ba8","Type":"ContainerStarted","Data":"1323cfc2e5a4dc56985037f8bf6002cb59484af70ae23fee65e35b269fe5d385"}
Jul 15 15:35:17.021261 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.933137    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ec82e02f-7632-41be-8e7d-8c9d59c569b6-systemd-units\") pod \"ovnkube-node-dthn7\" (UID: \"ec82e02f-7632-41be-8e7d-8c9d59c569b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-dthn7"
Jul 15 15:35:17.021261 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.933162    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e7a6e261-bdc8-4f06-883e-34d9d91b4434-kubelet-dir\") pod \"aws-ebs-csi-driver-node-m9jzh\" (UID: \"e7a6e261-bdc8-4f06-883e-34d9d91b4434\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m9jzh"
Jul 15 15:35:17.021261 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.933182    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kkpfd\" (UniqueName: \"kubernetes.io/projected/e7a6e261-bdc8-4f06-883e-34d9d91b4434-kube-api-access-kkpfd\") pod \"aws-ebs-csi-driver-node-m9jzh\" (UID: \"e7a6e261-bdc8-4f06-883e-34d9d91b4434\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m9jzh"
Jul 15 15:35:17.021261 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.933207    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ec82e02f-7632-41be-8e7d-8c9d59c569b6-log-socket\") pod \"ovnkube-node-dthn7\" (UID: \"ec82e02f-7632-41be-8e7d-8c9d59c569b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-dthn7"
Jul 15 15:35:17.021261 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.933261    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ec82e02f-7632-41be-8e7d-8c9d59c569b6-log-socket\") pod \"ovnkube-node-dthn7\" (UID: \"ec82e02f-7632-41be-8e7d-8c9d59c569b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-dthn7"
Jul 15 15:35:17.021261 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.933295    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ec82e02f-7632-41be-8e7d-8c9d59c569b6-systemd-units\") pod \"ovnkube-node-dthn7\" (UID: \"ec82e02f-7632-41be-8e7d-8c9d59c569b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-dthn7"
Jul 15 15:35:17.021261 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.933318    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e7a6e261-bdc8-4f06-883e-34d9d91b4434-kubelet-dir\") pod \"aws-ebs-csi-driver-node-m9jzh\" (UID: \"e7a6e261-bdc8-4f06-883e-34d9d91b4434\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m9jzh"
Jul 15 15:35:17.021261 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.933368    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ec82e02f-7632-41be-8e7d-8c9d59c569b6-host-cni-bin\") pod \"ovnkube-node-dthn7\" (UID: \"ec82e02f-7632-41be-8e7d-8c9d59c569b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-dthn7"
Jul 15 15:35:17.021261 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.933389    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ec82e02f-7632-41be-8e7d-8c9d59c569b6-ovnkube-script-lib\") pod \"ovnkube-node-dthn7\" (UID: \"ec82e02f-7632-41be-8e7d-8c9d59c569b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-dthn7"
Jul 15 15:35:17.021261 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.933404    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0b8fbcd1-d8ee-49e6-bdf0-6818a2754992-metrics-certs\") pod \"network-metrics-daemon-5xbsg\" (UID: \"0b8fbcd1-d8ee-49e6-bdf0-6818a2754992\") " pod="openshift-multus/network-metrics-daemon-5xbsg"
Jul 15 15:35:17.021261 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.933419    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/be0dcd2c-0e4a-47d0-a26e-b178256de470-iptables-alerter-script\") pod \"iptables-alerter-rx8tl\" (UID: \"be0dcd2c-0e4a-47d0-a26e-b178256de470\") " pod="openshift-network-operator/iptables-alerter-rx8tl"
Jul 15 15:35:17.021261 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.933439    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e7a6e261-bdc8-4f06-883e-34d9d91b4434-socket-dir\") pod \"aws-ebs-csi-driver-node-m9jzh\" (UID: \"e7a6e261-bdc8-4f06-883e-34d9d91b4434\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m9jzh"
Jul 15 15:35:17.021261 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.933466    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/baf9a41e-5bae-4ec3-acbe-9d3f88e05149-host-run-k8s-cni-cncf-io\") pod \"multus-vh644\" (UID: \"baf9a41e-5bae-4ec3-acbe-9d3f88e05149\") " pod="openshift-multus/multus-vh644"
Jul 15 15:35:17.021261 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.933482    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ec82e02f-7632-41be-8e7d-8c9d59c569b6-host-cni-bin\") pod \"ovnkube-node-dthn7\" (UID: \"ec82e02f-7632-41be-8e7d-8c9d59c569b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-dthn7"
Jul 15 15:35:17.021261 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.933488    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/baf9a41e-5bae-4ec3-acbe-9d3f88e05149-host-var-lib-cni-multus\") pod \"multus-vh644\" (UID: \"baf9a41e-5bae-4ec3-acbe-9d3f88e05149\") " pod="openshift-multus/multus-vh644"
Jul 15 15:35:17.021261 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:35:16.933504    2588 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 15:35:17.021261 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.933523    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/baf9a41e-5bae-4ec3-acbe-9d3f88e05149-host-var-lib-cni-multus\") pod \"multus-vh644\" (UID: \"baf9a41e-5bae-4ec3-acbe-9d3f88e05149\") " pod="openshift-multus/multus-vh644"
Jul 15 15:35:17.021261 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.933526    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/baf9a41e-5bae-4ec3-acbe-9d3f88e05149-hostroot\") pod \"multus-vh644\" (UID: \"baf9a41e-5bae-4ec3-acbe-9d3f88e05149\") " pod="openshift-multus/multus-vh644"
Jul 15 15:35:17.022311 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.933551    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/baf9a41e-5bae-4ec3-acbe-9d3f88e05149-hostroot\") pod \"multus-vh644\" (UID: \"baf9a41e-5bae-4ec3-acbe-9d3f88e05149\") " pod="openshift-multus/multus-vh644"
Jul 15 15:35:17.022311 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:35:16.933582    2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b8fbcd1-d8ee-49e6-bdf0-6818a2754992-metrics-certs podName:0b8fbcd1-d8ee-49e6-bdf0-6818a2754992 nodeName:}" failed. No retries permitted until 2026-07-15 15:35:17.433547299 +0000 UTC m=+3.085613048 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0b8fbcd1-d8ee-49e6-bdf0-6818a2754992-metrics-certs") pod "network-metrics-daemon-5xbsg" (UID: "0b8fbcd1-d8ee-49e6-bdf0-6818a2754992") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 15:35:17.022311 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.933612    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ec82e02f-7632-41be-8e7d-8c9d59c569b6-var-lib-openvswitch\") pod \"ovnkube-node-dthn7\" (UID: \"ec82e02f-7632-41be-8e7d-8c9d59c569b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-dthn7"
Jul 15 15:35:17.022311 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.933636    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ec82e02f-7632-41be-8e7d-8c9d59c569b6-host-run-ovn-kubernetes\") pod \"ovnkube-node-dthn7\" (UID: \"ec82e02f-7632-41be-8e7d-8c9d59c569b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-dthn7"
Jul 15 15:35:17.022311 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.933659    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ec82e02f-7632-41be-8e7d-8c9d59c569b6-host-cni-netd\") pod \"ovnkube-node-dthn7\" (UID: \"ec82e02f-7632-41be-8e7d-8c9d59c569b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-dthn7"
Jul 15 15:35:17.022311 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.933659    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e7a6e261-bdc8-4f06-883e-34d9d91b4434-socket-dir\") pod \"aws-ebs-csi-driver-node-m9jzh\" (UID: \"e7a6e261-bdc8-4f06-883e-34d9d91b4434\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m9jzh"
Jul 15 15:35:17.022311 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.933688    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b8bp6\" (UniqueName: \"kubernetes.io/projected/ec82e02f-7632-41be-8e7d-8c9d59c569b6-kube-api-access-b8bp6\") pod \"ovnkube-node-dthn7\" (UID: \"ec82e02f-7632-41be-8e7d-8c9d59c569b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-dthn7"
Jul 15 15:35:17.022311 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.933713    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0bc9e977-62dc-48b4-bd53-a6ae3de45690-host\") pod \"node-ca-f7bpr\" (UID: \"0bc9e977-62dc-48b4-bd53-a6ae3de45690\") " pod="openshift-image-registry/node-ca-f7bpr"
Jul 15 15:35:17.022311 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.933727    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/baf9a41e-5bae-4ec3-acbe-9d3f88e05149-host-run-k8s-cni-cncf-io\") pod \"multus-vh644\" (UID: \"baf9a41e-5bae-4ec3-acbe-9d3f88e05149\") " pod="openshift-multus/multus-vh644"
Jul 15 15:35:17.022311 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.933735    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ec82e02f-7632-41be-8e7d-8c9d59c569b6-host-kubelet\") pod \"ovnkube-node-dthn7\" (UID: \"ec82e02f-7632-41be-8e7d-8c9d59c569b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-dthn7"
Jul 15 15:35:17.022311 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.933758    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ec82e02f-7632-41be-8e7d-8c9d59c569b6-run-openvswitch\") pod \"ovnkube-node-dthn7\" (UID: \"ec82e02f-7632-41be-8e7d-8c9d59c569b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-dthn7"
Jul 15 15:35:17.022311 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.933763    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ec82e02f-7632-41be-8e7d-8c9d59c569b6-var-lib-openvswitch\") pod \"ovnkube-node-dthn7\" (UID: \"ec82e02f-7632-41be-8e7d-8c9d59c569b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-dthn7"
Jul 15 15:35:17.022311 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.933787    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ec82e02f-7632-41be-8e7d-8c9d59c569b6-ovnkube-config\") pod \"ovnkube-node-dthn7\" (UID: \"ec82e02f-7632-41be-8e7d-8c9d59c569b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-dthn7"
Jul 15 15:35:17.022311 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.933802    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ec82e02f-7632-41be-8e7d-8c9d59c569b6-run-openvswitch\") pod \"ovnkube-node-dthn7\" (UID: \"ec82e02f-7632-41be-8e7d-8c9d59c569b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-dthn7"
Jul 15 15:35:17.022311 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.933811    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/baf9a41e-5bae-4ec3-acbe-9d3f88e05149-multus-cni-dir\") pod \"multus-vh644\" (UID: \"baf9a41e-5bae-4ec3-acbe-9d3f88e05149\") " pod="openshift-multus/multus-vh644"
Jul 15 15:35:17.022311 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.933834    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/baf9a41e-5bae-4ec3-acbe-9d3f88e05149-host-run-multus-certs\") pod \"multus-vh644\" (UID: \"baf9a41e-5bae-4ec3-acbe-9d3f88e05149\") " pod="openshift-multus/multus-vh644"
Jul 15 15:35:17.022311 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.933840    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ec82e02f-7632-41be-8e7d-8c9d59c569b6-host-run-ovn-kubernetes\") pod \"ovnkube-node-dthn7\" (UID: \"ec82e02f-7632-41be-8e7d-8c9d59c569b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-dthn7"
Jul 15 15:35:17.023301 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.933859    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ec82e02f-7632-41be-8e7d-8c9d59c569b6-ovn-node-metrics-cert\") pod \"ovnkube-node-dthn7\" (UID: \"ec82e02f-7632-41be-8e7d-8c9d59c569b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-dthn7"
Jul 15 15:35:17.023301 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.933877    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ec82e02f-7632-41be-8e7d-8c9d59c569b6-host-cni-netd\") pod \"ovnkube-node-dthn7\" (UID: \"ec82e02f-7632-41be-8e7d-8c9d59c569b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-dthn7"
Jul 15 15:35:17.023301 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.933885    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e7a6e261-bdc8-4f06-883e-34d9d91b4434-registration-dir\") pod \"aws-ebs-csi-driver-node-m9jzh\" (UID: \"e7a6e261-bdc8-4f06-883e-34d9d91b4434\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m9jzh"
Jul 15 15:35:17.023301 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.933900    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ec82e02f-7632-41be-8e7d-8c9d59c569b6-ovnkube-script-lib\") pod \"ovnkube-node-dthn7\" (UID: \"ec82e02f-7632-41be-8e7d-8c9d59c569b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-dthn7"
Jul 15 15:35:17.023301 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.933912    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/baf9a41e-5bae-4ec3-acbe-9d3f88e05149-host-run-netns\") pod \"multus-vh644\" (UID: \"baf9a41e-5bae-4ec3-acbe-9d3f88e05149\") " pod="openshift-multus/multus-vh644"
Jul 15 15:35:17.023301 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.933935    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ec82e02f-7632-41be-8e7d-8c9d59c569b6-run-ovn\") pod \"ovnkube-node-dthn7\" (UID: \"ec82e02f-7632-41be-8e7d-8c9d59c569b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-dthn7"
Jul 15 15:35:17.023301 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.933941    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0bc9e977-62dc-48b4-bd53-a6ae3de45690-host\") pod \"node-ca-f7bpr\" (UID: \"0bc9e977-62dc-48b4-bd53-a6ae3de45690\") " pod="openshift-image-registry/node-ca-f7bpr"
Jul 15 15:35:17.023301 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.933958    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ec82e02f-7632-41be-8e7d-8c9d59c569b6-host-kubelet\") pod \"ovnkube-node-dthn7\" (UID: \"ec82e02f-7632-41be-8e7d-8c9d59c569b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-dthn7"
Jul 15 15:35:17.023301 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.933961    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/0bc9e977-62dc-48b4-bd53-a6ae3de45690-serviceca\") pod \"node-ca-f7bpr\" (UID: \"0bc9e977-62dc-48b4-bd53-a6ae3de45690\") " pod="openshift-image-registry/node-ca-f7bpr"
Jul 15 15:35:17.023301 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.933997    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/baf9a41e-5bae-4ec3-acbe-9d3f88e05149-cni-binary-copy\") pod \"multus-vh644\" (UID: \"baf9a41e-5bae-4ec3-acbe-9d3f88e05149\") " pod="openshift-multus/multus-vh644"
Jul 15 15:35:17.023301 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.934022    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/baf9a41e-5bae-4ec3-acbe-9d3f88e05149-etc-kubernetes\") pod \"multus-vh644\" (UID: \"baf9a41e-5bae-4ec3-acbe-9d3f88e05149\") " pod="openshift-multus/multus-vh644"
Jul 15 15:35:17.023301 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.934032    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/be0dcd2c-0e4a-47d0-a26e-b178256de470-iptables-alerter-script\") pod \"iptables-alerter-rx8tl\" (UID: \"be0dcd2c-0e4a-47d0-a26e-b178256de470\") " pod="openshift-network-operator/iptables-alerter-rx8tl"
Jul 15 15:35:17.023301 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.934065    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xsxf7\" (UniqueName: \"kubernetes.io/projected/baf9a41e-5bae-4ec3-acbe-9d3f88e05149-kube-api-access-xsxf7\") pod \"multus-vh644\" (UID: \"baf9a41e-5bae-4ec3-acbe-9d3f88e05149\") " pod="openshift-multus/multus-vh644"
Jul 15 15:35:17.023301 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.934100    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d64071a5-5f14-450d-99d6-f9295b7b0edc-cni-binary-copy\") pod \"multus-additional-cni-plugins-qpqrs\" (UID: \"d64071a5-5f14-450d-99d6-f9295b7b0edc\") " pod="openshift-multus/multus-additional-cni-plugins-qpqrs"
Jul 15 15:35:17.023301 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.934127    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d6bkl\" (UniqueName: \"kubernetes.io/projected/d64071a5-5f14-450d-99d6-f9295b7b0edc-kube-api-access-d6bkl\") pod \"multus-additional-cni-plugins-qpqrs\" (UID: \"d64071a5-5f14-450d-99d6-f9295b7b0edc\") " pod="openshift-multus/multus-additional-cni-plugins-qpqrs"
Jul 15 15:35:17.023301 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.934154    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ec82e02f-7632-41be-8e7d-8c9d59c569b6-etc-openvswitch\") pod \"ovnkube-node-dthn7\" (UID: \"ec82e02f-7632-41be-8e7d-8c9d59c569b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-dthn7"
Jul 15 15:35:17.023301 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.934175    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ec82e02f-7632-41be-8e7d-8c9d59c569b6-node-log\") pod \"ovnkube-node-dthn7\" (UID: \"ec82e02f-7632-41be-8e7d-8c9d59c569b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-dthn7"
Jul 15 15:35:17.023301 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.934199    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/baf9a41e-5bae-4ec3-acbe-9d3f88e05149-os-release\") pod \"multus-vh644\" (UID: \"baf9a41e-5bae-4ec3-acbe-9d3f88e05149\") " pod="openshift-multus/multus-vh644"
Jul 15 15:35:17.024493 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.934241    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/baf9a41e-5bae-4ec3-acbe-9d3f88e05149-multus-cni-dir\") pod \"multus-vh644\" (UID: \"baf9a41e-5bae-4ec3-acbe-9d3f88e05149\") " pod="openshift-multus/multus-vh644"
Jul 15 15:35:17.024493 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.934293    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/baf9a41e-5bae-4ec3-acbe-9d3f88e05149-multus-daemon-config\") pod \"multus-vh644\" (UID: \"baf9a41e-5bae-4ec3-acbe-9d3f88e05149\") " pod="openshift-multus/multus-vh644"
Jul 15 15:35:17.024493 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.934330    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d64071a5-5f14-450d-99d6-f9295b7b0edc-system-cni-dir\") pod \"multus-additional-cni-plugins-qpqrs\" (UID: \"d64071a5-5f14-450d-99d6-f9295b7b0edc\") " pod="openshift-multus/multus-additional-cni-plugins-qpqrs"
Jul 15 15:35:17.024493 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.934374    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d64071a5-5f14-450d-99d6-f9295b7b0edc-cnibin\") pod \"multus-additional-cni-plugins-qpqrs\" (UID: \"d64071a5-5f14-450d-99d6-f9295b7b0edc\") " pod="openshift-multus/multus-additional-cni-plugins-qpqrs"
Jul 15 15:35:17.024493 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.934388    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/0bc9e977-62dc-48b4-bd53-a6ae3de45690-serviceca\") pod \"node-ca-f7bpr\" (UID: \"0bc9e977-62dc-48b4-bd53-a6ae3de45690\") " pod="openshift-image-registry/node-ca-f7bpr"
Jul 15 15:35:17.024493 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.934398    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/be0dcd2c-0e4a-47d0-a26e-b178256de470-host-slash\") pod \"iptables-alerter-rx8tl\" (UID: \"be0dcd2c-0e4a-47d0-a26e-b178256de470\") " pod="openshift-network-operator/iptables-alerter-rx8tl"
Jul 15 15:35:17.024493 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.934438    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/baf9a41e-5bae-4ec3-acbe-9d3f88e05149-host-run-multus-certs\") pod \"multus-vh644\" (UID: \"baf9a41e-5bae-4ec3-acbe-9d3f88e05149\") " pod="openshift-multus/multus-vh644"
Jul 15 15:35:17.024493 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.934442    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/be0dcd2c-0e4a-47d0-a26e-b178256de470-host-slash\") pod \"iptables-alerter-rx8tl\" (UID: \"be0dcd2c-0e4a-47d0-a26e-b178256de470\") " pod="openshift-network-operator/iptables-alerter-rx8tl"
Jul 15 15:35:17.024493 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.934467    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/baf9a41e-5bae-4ec3-acbe-9d3f88e05149-host-var-lib-cni-bin\") pod \"multus-vh644\" (UID: \"baf9a41e-5bae-4ec3-acbe-9d3f88e05149\") " pod="openshift-multus/multus-vh644"
Jul 15 15:35:17.024493 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.934478    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/baf9a41e-5bae-4ec3-acbe-9d3f88e05149-etc-kubernetes\") pod \"multus-vh644\" (UID: \"baf9a41e-5bae-4ec3-acbe-9d3f88e05149\") " pod="openshift-multus/multus-vh644"
Jul 15 15:35:17.024493 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.934492    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/542b7772-fe16-4f43-b9fb-e0d1538c5134-kubelet-config\") pod \"global-pull-secret-syncer-n4kpw\" (UID: \"542b7772-fe16-4f43-b9fb-e0d1538c5134\") " pod="kube-system/global-pull-secret-syncer-n4kpw"
Jul 15 15:35:17.024493 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.934526    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/542b7772-fe16-4f43-b9fb-e0d1538c5134-original-pull-secret\") pod \"global-pull-secret-syncer-n4kpw\" (UID: \"542b7772-fe16-4f43-b9fb-e0d1538c5134\") " pod="kube-system/global-pull-secret-syncer-n4kpw"
Jul 15 15:35:17.024493 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.934549    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ec82e02f-7632-41be-8e7d-8c9d59c569b6-host-run-netns\") pod \"ovnkube-node-dthn7\" (UID: \"ec82e02f-7632-41be-8e7d-8c9d59c569b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-dthn7"
Jul 15 15:35:17.024493 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.934572    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ec82e02f-7632-41be-8e7d-8c9d59c569b6-run-systemd\") pod \"ovnkube-node-dthn7\" (UID: \"ec82e02f-7632-41be-8e7d-8c9d59c569b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-dthn7"
Jul 15 15:35:17.024493 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.934595    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9dl4m\" (UniqueName: \"kubernetes.io/projected/0bc9e977-62dc-48b4-bd53-a6ae3de45690-kube-api-access-9dl4m\") pod \"node-ca-f7bpr\" (UID: \"0bc9e977-62dc-48b4-bd53-a6ae3de45690\") " pod="openshift-image-registry/node-ca-f7bpr"
Jul 15 15:35:17.024493 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.934619    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/baf9a41e-5bae-4ec3-acbe-9d3f88e05149-system-cni-dir\") pod \"multus-vh644\" (UID: \"baf9a41e-5bae-4ec3-acbe-9d3f88e05149\") " pod="openshift-multus/multus-vh644"
Jul 15 15:35:17.024493 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.934644    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/baf9a41e-5bae-4ec3-acbe-9d3f88e05149-cnibin\") pod \"multus-vh644\" (UID: \"baf9a41e-5bae-4ec3-acbe-9d3f88e05149\") " pod="openshift-multus/multus-vh644"
Jul 15 15:35:17.024493 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.934666    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/baf9a41e-5bae-4ec3-acbe-9d3f88e05149-host-var-lib-kubelet\") pod \"multus-vh644\" (UID: \"baf9a41e-5bae-4ec3-acbe-9d3f88e05149\") " pod="openshift-multus/multus-vh644"
Jul 15 15:35:17.025540 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.934694    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-twfhr\" (UniqueName: \"kubernetes.io/projected/0b8fbcd1-d8ee-49e6-bdf0-6818a2754992-kube-api-access-twfhr\") pod \"network-metrics-daemon-5xbsg\" (UID: \"0b8fbcd1-d8ee-49e6-bdf0-6818a2754992\") " pod="openshift-multus/network-metrics-daemon-5xbsg"
Jul 15 15:35:17.025540 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.934721    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6dwn5\" (UniqueName: \"kubernetes.io/projected/be0dcd2c-0e4a-47d0-a26e-b178256de470-kube-api-access-6dwn5\") pod \"iptables-alerter-rx8tl\" (UID: \"be0dcd2c-0e4a-47d0-a26e-b178256de470\") " pod="openshift-network-operator/iptables-alerter-rx8tl"
Jul 15 15:35:17.025540 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.934744    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e7a6e261-bdc8-4f06-883e-34d9d91b4434-sys-fs\") pod \"aws-ebs-csi-driver-node-m9jzh\" (UID: \"e7a6e261-bdc8-4f06-883e-34d9d91b4434\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m9jzh"
Jul 15 15:35:17.025540 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.934761    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ec82e02f-7632-41be-8e7d-8c9d59c569b6-ovnkube-config\") pod \"ovnkube-node-dthn7\" (UID: \"ec82e02f-7632-41be-8e7d-8c9d59c569b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-dthn7"
Jul 15 15:35:17.025540 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.934775    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e7a6e261-bdc8-4f06-883e-34d9d91b4434-device-dir\") pod \"aws-ebs-csi-driver-node-m9jzh\" (UID: \"e7a6e261-bdc8-4f06-883e-34d9d91b4434\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m9jzh"
Jul 15 15:35:17.025540 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.934799    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e7a6e261-bdc8-4f06-883e-34d9d91b4434-etc-selinux\") pod \"aws-ebs-csi-driver-node-m9jzh\" (UID: \"e7a6e261-bdc8-4f06-883e-34d9d91b4434\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m9jzh"
Jul 15 15:35:17.025540 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.934900    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d64071a5-5f14-450d-99d6-f9295b7b0edc-os-release\") pod \"multus-additional-cni-plugins-qpqrs\" (UID: \"d64071a5-5f14-450d-99d6-f9295b7b0edc\") " pod="openshift-multus/multus-additional-cni-plugins-qpqrs"
Jul 15 15:35:17.025540 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.934936    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d64071a5-5f14-450d-99d6-f9295b7b0edc-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-qpqrs\" (UID: \"d64071a5-5f14-450d-99d6-f9295b7b0edc\") " pod="openshift-multus/multus-additional-cni-plugins-qpqrs"
Jul 15 15:35:17.025540 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.934964    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/baf9a41e-5bae-4ec3-acbe-9d3f88e05149-multus-socket-dir-parent\") pod \"multus-vh644\" (UID: \"baf9a41e-5bae-4ec3-acbe-9d3f88e05149\") " pod="openshift-multus/multus-vh644"
Jul 15 15:35:17.025540 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.935002    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/baf9a41e-5bae-4ec3-acbe-9d3f88e05149-os-release\") pod \"multus-vh644\" (UID: \"baf9a41e-5bae-4ec3-acbe-9d3f88e05149\") " pod="openshift-multus/multus-vh644"
Jul 15 15:35:17.025540 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.935009    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/542b7772-fe16-4f43-b9fb-e0d1538c5134-dbus\") pod \"global-pull-secret-syncer-n4kpw\" (UID: \"542b7772-fe16-4f43-b9fb-e0d1538c5134\") " pod="kube-system/global-pull-secret-syncer-n4kpw"
Jul 15 15:35:17.025540 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.935044    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ec82e02f-7632-41be-8e7d-8c9d59c569b6-env-overrides\") pod \"ovnkube-node-dthn7\" (UID: \"ec82e02f-7632-41be-8e7d-8c9d59c569b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-dthn7"
Jul 15 15:35:17.025540 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.935077    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ec82e02f-7632-41be-8e7d-8c9d59c569b6-host-slash\") pod \"ovnkube-node-dthn7\" (UID: \"ec82e02f-7632-41be-8e7d-8c9d59c569b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-dthn7"
Jul 15 15:35:17.025540 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.935112    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ec82e02f-7632-41be-8e7d-8c9d59c569b6-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-dthn7\" (UID: \"ec82e02f-7632-41be-8e7d-8c9d59c569b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-dthn7"
Jul 15 15:35:17.025540 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.935140    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/542b7772-fe16-4f43-b9fb-e0d1538c5134-dbus\") pod \"global-pull-secret-syncer-n4kpw\" (UID: \"542b7772-fe16-4f43-b9fb-e0d1538c5134\") " pod="kube-system/global-pull-secret-syncer-n4kpw"
Jul 15 15:35:17.025540 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.935154    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d64071a5-5f14-450d-99d6-f9295b7b0edc-tuning-conf-dir\") pod \"multus-additional-cni-plugins-qpqrs\" (UID: \"d64071a5-5f14-450d-99d6-f9295b7b0edc\") " pod="openshift-multus/multus-additional-cni-plugins-qpqrs"
Jul 15 15:35:17.025540 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.935167    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d64071a5-5f14-450d-99d6-f9295b7b0edc-cni-binary-copy\") pod \"multus-additional-cni-plugins-qpqrs\" (UID: \"d64071a5-5f14-450d-99d6-f9295b7b0edc\") " pod="openshift-multus/multus-additional-cni-plugins-qpqrs"
Jul 15 15:35:17.026599 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.935179    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d64071a5-5f14-450d-99d6-f9295b7b0edc-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-qpqrs\" (UID: \"d64071a5-5f14-450d-99d6-f9295b7b0edc\") " pod="openshift-multus/multus-additional-cni-plugins-qpqrs"
Jul 15 15:35:17.026599 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.935196    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/baf9a41e-5bae-4ec3-acbe-9d3f88e05149-cni-binary-copy\") pod \"multus-vh644\" (UID: \"baf9a41e-5bae-4ec3-acbe-9d3f88e05149\") " pod="openshift-multus/multus-vh644"
Jul 15 15:35:17.026599 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.935211    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/baf9a41e-5bae-4ec3-acbe-9d3f88e05149-multus-conf-dir\") pod \"multus-vh644\" (UID: \"baf9a41e-5bae-4ec3-acbe-9d3f88e05149\") " pod="openshift-multus/multus-vh644"
Jul 15 15:35:17.026599 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.935254    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d64071a5-5f14-450d-99d6-f9295b7b0edc-system-cni-dir\") pod \"multus-additional-cni-plugins-qpqrs\" (UID: \"d64071a5-5f14-450d-99d6-f9295b7b0edc\") " pod="openshift-multus/multus-additional-cni-plugins-qpqrs"
Jul 15 15:35:17.026599 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.935316    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d64071a5-5f14-450d-99d6-f9295b7b0edc-cnibin\") pod \"multus-additional-cni-plugins-qpqrs\" (UID: \"d64071a5-5f14-450d-99d6-f9295b7b0edc\") " pod="openshift-multus/multus-additional-cni-plugins-qpqrs"
Jul 15 15:35:17.026599 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.935319    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/baf9a41e-5bae-4ec3-acbe-9d3f88e05149-multus-conf-dir\") pod \"multus-vh644\" (UID: \"baf9a41e-5bae-4ec3-acbe-9d3f88e05149\") " pod="openshift-multus/multus-vh644"
Jul 15 15:35:17.026599 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.935407    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ec82e02f-7632-41be-8e7d-8c9d59c569b6-host-slash\") pod \"ovnkube-node-dthn7\" (UID: \"ec82e02f-7632-41be-8e7d-8c9d59c569b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-dthn7"
Jul 15 15:35:17.026599 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.935451    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ec82e02f-7632-41be-8e7d-8c9d59c569b6-etc-openvswitch\") pod \"ovnkube-node-dthn7\" (UID: \"ec82e02f-7632-41be-8e7d-8c9d59c569b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-dthn7"
Jul 15 15:35:17.026599 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.935502    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ec82e02f-7632-41be-8e7d-8c9d59c569b6-node-log\") pod \"ovnkube-node-dthn7\" (UID: \"ec82e02f-7632-41be-8e7d-8c9d59c569b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-dthn7"
Jul 15 15:35:17.026599 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.935604    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d64071a5-5f14-450d-99d6-f9295b7b0edc-tuning-conf-dir\") pod \"multus-additional-cni-plugins-qpqrs\" (UID: \"d64071a5-5f14-450d-99d6-f9295b7b0edc\") " pod="openshift-multus/multus-additional-cni-plugins-qpqrs"
Jul 15 15:35:17.026599 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.935667    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e7a6e261-bdc8-4f06-883e-34d9d91b4434-registration-dir\") pod \"aws-ebs-csi-driver-node-m9jzh\" (UID: \"e7a6e261-bdc8-4f06-883e-34d9d91b4434\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m9jzh"
Jul 15 15:35:17.026599 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.935668    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ec82e02f-7632-41be-8e7d-8c9d59c569b6-run-ovn\") pod \"ovnkube-node-dthn7\" (UID: \"ec82e02f-7632-41be-8e7d-8c9d59c569b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-dthn7"
Jul 15 15:35:17.026599 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.935698    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/baf9a41e-5bae-4ec3-acbe-9d3f88e05149-host-var-lib-cni-bin\") pod \"multus-vh644\" (UID: \"baf9a41e-5bae-4ec3-acbe-9d3f88e05149\") " pod="openshift-multus/multus-vh644"
Jul 15 15:35:17.026599 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.935713    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ec82e02f-7632-41be-8e7d-8c9d59c569b6-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-dthn7\" (UID: \"ec82e02f-7632-41be-8e7d-8c9d59c569b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-dthn7"
Jul 15 15:35:17.026599 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.935752    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/542b7772-fe16-4f43-b9fb-e0d1538c5134-kubelet-config\") pod \"global-pull-secret-syncer-n4kpw\" (UID: \"542b7772-fe16-4f43-b9fb-e0d1538c5134\") " pod="kube-system/global-pull-secret-syncer-n4kpw"
Jul 15 15:35:17.026599 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:35:16.935791    2588 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 15:35:17.026599 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.935813    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/baf9a41e-5bae-4ec3-acbe-9d3f88e05149-host-run-netns\") pod \"multus-vh644\" (UID: \"baf9a41e-5bae-4ec3-acbe-9d3f88e05149\") " pod="openshift-multus/multus-vh644"
Jul 15 15:35:17.027239 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:35:16.935860    2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/542b7772-fe16-4f43-b9fb-e0d1538c5134-original-pull-secret podName:542b7772-fe16-4f43-b9fb-e0d1538c5134 nodeName:}" failed. No retries permitted until 2026-07-15 15:35:17.435840893 +0000 UTC m=+3.087906642 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/542b7772-fe16-4f43-b9fb-e0d1538c5134-original-pull-secret") pod "global-pull-secret-syncer-n4kpw" (UID: "542b7772-fe16-4f43-b9fb-e0d1538c5134") : object "kube-system"/"original-pull-secret" not registered
Jul 15 15:35:17.027239 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.935857    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ec82e02f-7632-41be-8e7d-8c9d59c569b6-env-overrides\") pod \"ovnkube-node-dthn7\" (UID: \"ec82e02f-7632-41be-8e7d-8c9d59c569b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-dthn7"
Jul 15 15:35:17.027239 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.935866    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e7a6e261-bdc8-4f06-883e-34d9d91b4434-sys-fs\") pod \"aws-ebs-csi-driver-node-m9jzh\" (UID: \"e7a6e261-bdc8-4f06-883e-34d9d91b4434\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m9jzh"
Jul 15 15:35:17.027239 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.935896    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/baf9a41e-5bae-4ec3-acbe-9d3f88e05149-host-var-lib-kubelet\") pod \"multus-vh644\" (UID: \"baf9a41e-5bae-4ec3-acbe-9d3f88e05149\") " pod="openshift-multus/multus-vh644"
Jul 15 15:35:17.027239 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.935903    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ec82e02f-7632-41be-8e7d-8c9d59c569b6-host-run-netns\") pod \"ovnkube-node-dthn7\" (UID: \"ec82e02f-7632-41be-8e7d-8c9d59c569b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-dthn7"
Jul 15 15:35:17.027239 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.935956    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/baf9a41e-5bae-4ec3-acbe-9d3f88e05149-cnibin\") pod \"multus-vh644\" (UID: \"baf9a41e-5bae-4ec3-acbe-9d3f88e05149\") " pod="openshift-multus/multus-vh644"
Jul 15 15:35:17.027239 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.935964    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ec82e02f-7632-41be-8e7d-8c9d59c569b6-run-systemd\") pod \"ovnkube-node-dthn7\" (UID: \"ec82e02f-7632-41be-8e7d-8c9d59c569b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-dthn7"
Jul 15 15:35:17.027239 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.936013    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d64071a5-5f14-450d-99d6-f9295b7b0edc-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-qpqrs\" (UID: \"d64071a5-5f14-450d-99d6-f9295b7b0edc\") " pod="openshift-multus/multus-additional-cni-plugins-qpqrs"
Jul 15 15:35:17.027239 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.935791    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/baf9a41e-5bae-4ec3-acbe-9d3f88e05149-system-cni-dir\") pod \"multus-vh644\" (UID: \"baf9a41e-5bae-4ec3-acbe-9d3f88e05149\") " pod="openshift-multus/multus-vh644"
Jul 15 15:35:17.027239 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.936104    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e7a6e261-bdc8-4f06-883e-34d9d91b4434-device-dir\") pod \"aws-ebs-csi-driver-node-m9jzh\" (UID: \"e7a6e261-bdc8-4f06-883e-34d9d91b4434\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m9jzh"
Jul 15 15:35:17.027239 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.936103    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d64071a5-5f14-450d-99d6-f9295b7b0edc-os-release\") pod \"multus-additional-cni-plugins-qpqrs\" (UID: \"d64071a5-5f14-450d-99d6-f9295b7b0edc\") " pod="openshift-multus/multus-additional-cni-plugins-qpqrs"
Jul 15 15:35:17.027239 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.936162    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/baf9a41e-5bae-4ec3-acbe-9d3f88e05149-multus-socket-dir-parent\") pod \"multus-vh644\" (UID: \"baf9a41e-5bae-4ec3-acbe-9d3f88e05149\") " pod="openshift-multus/multus-vh644"
Jul 15 15:35:17.027239 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.936170    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e7a6e261-bdc8-4f06-883e-34d9d91b4434-etc-selinux\") pod \"aws-ebs-csi-driver-node-m9jzh\" (UID: \"e7a6e261-bdc8-4f06-883e-34d9d91b4434\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m9jzh"
Jul 15 15:35:17.027239 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.936313    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/baf9a41e-5bae-4ec3-acbe-9d3f88e05149-multus-daemon-config\") pod \"multus-vh644\" (UID: \"baf9a41e-5bae-4ec3-acbe-9d3f88e05149\") " pod="openshift-multus/multus-vh644"
Jul 15 15:35:17.027239 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.936569    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d64071a5-5f14-450d-99d6-f9295b7b0edc-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-qpqrs\" (UID: \"d64071a5-5f14-450d-99d6-f9295b7b0edc\") " pod="openshift-multus/multus-additional-cni-plugins-qpqrs"
Jul 15 15:35:17.027239 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.938380    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ec82e02f-7632-41be-8e7d-8c9d59c569b6-ovn-node-metrics-cert\") pod \"ovnkube-node-dthn7\" (UID: \"ec82e02f-7632-41be-8e7d-8c9d59c569b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-dthn7"
Jul 15 15:35:17.027239 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.955026    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9dl4m\" (UniqueName: \"kubernetes.io/projected/0bc9e977-62dc-48b4-bd53-a6ae3de45690-kube-api-access-9dl4m\") pod \"node-ca-f7bpr\" (UID: \"0bc9e977-62dc-48b4-bd53-a6ae3de45690\") " pod="openshift-image-registry/node-ca-f7bpr"
Jul 15 15:35:17.028219 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.955188    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6dwn5\" (UniqueName: \"kubernetes.io/projected/be0dcd2c-0e4a-47d0-a26e-b178256de470-kube-api-access-6dwn5\") pod \"iptables-alerter-rx8tl\" (UID: \"be0dcd2c-0e4a-47d0-a26e-b178256de470\") " pod="openshift-network-operator/iptables-alerter-rx8tl"
Jul 15 15:35:17.028219 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.956168    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d6bkl\" (UniqueName: \"kubernetes.io/projected/d64071a5-5f14-450d-99d6-f9295b7b0edc-kube-api-access-d6bkl\") pod \"multus-additional-cni-plugins-qpqrs\" (UID: \"d64071a5-5f14-450d-99d6-f9295b7b0edc\") " pod="openshift-multus/multus-additional-cni-plugins-qpqrs"
Jul 15 15:35:17.028219 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.956595    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kkpfd\" (UniqueName: \"kubernetes.io/projected/e7a6e261-bdc8-4f06-883e-34d9d91b4434-kube-api-access-kkpfd\") pod \"aws-ebs-csi-driver-node-m9jzh\" (UID: \"e7a6e261-bdc8-4f06-883e-34d9d91b4434\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m9jzh"
Jul 15 15:35:17.028219 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.956678    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b8bp6\" (UniqueName: \"kubernetes.io/projected/ec82e02f-7632-41be-8e7d-8c9d59c569b6-kube-api-access-b8bp6\") pod \"ovnkube-node-dthn7\" (UID: \"ec82e02f-7632-41be-8e7d-8c9d59c569b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-dthn7"
Jul 15 15:35:17.028219 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.957471    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xsxf7\" (UniqueName: \"kubernetes.io/projected/baf9a41e-5bae-4ec3-acbe-9d3f88e05149-kube-api-access-xsxf7\") pod \"multus-vh644\" (UID: \"baf9a41e-5bae-4ec3-acbe-9d3f88e05149\") " pod="openshift-multus/multus-vh644"
Jul 15 15:35:17.028219 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:16.958975    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-twfhr\" (UniqueName: \"kubernetes.io/projected/0b8fbcd1-d8ee-49e6-bdf0-6818a2754992-kube-api-access-twfhr\") pod \"network-metrics-daemon-5xbsg\" (UID: \"0b8fbcd1-d8ee-49e6-bdf0-6818a2754992\") " pod="openshift-multus/network-metrics-daemon-5xbsg"
Jul 15 15:35:17.028219 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:17.026823    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-wmcfh"
Jul 15 15:35:17.041165 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:17.030750    2588 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 15 15:35:17.041165 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:17.034292    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-nhrz9"
Jul 15 15:35:17.041165 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:17.040639    2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d4c5bcd_e4af_48c1_a49c_00ebbf891ff1.slice/crio-ad3e16ffaea0a0ed9a8f2926dd94e46083b0ee7876fa879b3db535bdc38b78d5 WatchSource:0}: Error finding container ad3e16ffaea0a0ed9a8f2926dd94e46083b0ee7876fa879b3db535bdc38b78d5: Status 404 returned error can't find the container with id ad3e16ffaea0a0ed9a8f2926dd94e46083b0ee7876fa879b3db535bdc38b78d5
Jul 15 15:35:17.131803 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:17.042761    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-wkp76"
Jul 15 15:35:17.131803 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:17.048058    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-qpqrs"
Jul 15 15:35:17.131803 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:17.058500    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-rx8tl"
Jul 15 15:35:17.131803 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:17.058939    2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod788849c2_e862_481a_a2bb_e34e76030cc3.slice/crio-9af96b403edef47e5a45869fc6ca02775fe2e9ce0c5ba7d33d8af7abbc166093 WatchSource:0}: Error finding container 9af96b403edef47e5a45869fc6ca02775fe2e9ce0c5ba7d33d8af7abbc166093: Status 404 returned error can't find the container with id 9af96b403edef47e5a45869fc6ca02775fe2e9ce0c5ba7d33d8af7abbc166093
Jul 15 15:35:17.131803 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:17.064877    2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd64071a5_5f14_450d_99d6_f9295b7b0edc.slice/crio-f93bc59b710160e7ef50cac530e28459576346e39037828b4eb9ce345e50d8ae WatchSource:0}: Error finding container f93bc59b710160e7ef50cac530e28459576346e39037828b4eb9ce345e50d8ae: Status 404 returned error can't find the container with id f93bc59b710160e7ef50cac530e28459576346e39037828b4eb9ce345e50d8ae
Jul 15 15:35:17.131803 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:17.064958    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m9jzh"
Jul 15 15:35:17.131803 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:17.072473    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-f7bpr"
Jul 15 15:35:17.131803 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:17.072664    2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe0dcd2c_0e4a_47d0_a26e_b178256de470.slice/crio-7316dc6bd741a7e21e1f472dc731dc0a1882d55658307aa2fc701d50cd971946 WatchSource:0}: Error finding container 7316dc6bd741a7e21e1f472dc731dc0a1882d55658307aa2fc701d50cd971946: Status 404 returned error can't find the container with id 7316dc6bd741a7e21e1f472dc731dc0a1882d55658307aa2fc701d50cd971946
Jul 15 15:35:17.131803 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:17.080850    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-vh644"
Jul 15 15:35:17.131803 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:17.082270    2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7a6e261_bdc8_4f06_883e_34d9d91b4434.slice/crio-ef0485713827ab5742099fee45a7f5e84bd5f20abe78b77d6230bafe7d0fdf94 WatchSource:0}: Error finding container ef0485713827ab5742099fee45a7f5e84bd5f20abe78b77d6230bafe7d0fdf94: Status 404 returned error can't find the container with id ef0485713827ab5742099fee45a7f5e84bd5f20abe78b77d6230bafe7d0fdf94
Jul 15 15:35:17.131803 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:17.083732    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-dthn7"
Jul 15 15:35:17.131803 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:17.088605    2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0bc9e977_62dc_48b4_bd53_a6ae3de45690.slice/crio-64e67b95063c9d35b35b148619552056d04e5921e2ecb97b8d9eb95e6deb576a WatchSource:0}: Error finding container 64e67b95063c9d35b35b148619552056d04e5921e2ecb97b8d9eb95e6deb576a: Status 404 returned error can't find the container with id 64e67b95063c9d35b35b148619552056d04e5921e2ecb97b8d9eb95e6deb576a
Jul 15 15:35:17.131803 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:17.110337    2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbaf9a41e_5bae_4ec3_acbe_9d3f88e05149.slice/crio-71e55551d47068c83a87caaca526613d80e80a0549fda2aadf1b0e05340544f2 WatchSource:0}: Error finding container 71e55551d47068c83a87caaca526613d80e80a0549fda2aadf1b0e05340544f2: Status 404 returned error can't find the container with id 71e55551d47068c83a87caaca526613d80e80a0549fda2aadf1b0e05340544f2
Jul 15 15:35:17.131803 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:17.117621    2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec82e02f_7632_41be_8e7d_8c9d59c569b6.slice/crio-102f1c12d7024b1c961882f9cc2b0c2123451bf8f07896e4e00b1d4aa37c8229 WatchSource:0}: Error finding container 102f1c12d7024b1c961882f9cc2b0c2123451bf8f07896e4e00b1d4aa37c8229: Status 404 returned error can't find the container with id 102f1c12d7024b1c961882f9cc2b0c2123451bf8f07896e4e00b1d4aa37c8229
Jul 15 15:35:17.438769 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:17.438722    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wh2pb\" (UniqueName: \"kubernetes.io/projected/0383c465-26ac-4666-9180-4298272af4c7-kube-api-access-wh2pb\") pod \"network-check-target-fgm54\" (UID: \"0383c465-26ac-4666-9180-4298272af4c7\") " pod="openshift-network-diagnostics/network-check-target-fgm54"
Jul 15 15:35:17.438920 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:17.438790    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/542b7772-fe16-4f43-b9fb-e0d1538c5134-original-pull-secret\") pod \"global-pull-secret-syncer-n4kpw\" (UID: \"542b7772-fe16-4f43-b9fb-e0d1538c5134\") " pod="kube-system/global-pull-secret-syncer-n4kpw"
Jul 15 15:35:17.438920 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:17.438837    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0b8fbcd1-d8ee-49e6-bdf0-6818a2754992-metrics-certs\") pod \"network-metrics-daemon-5xbsg\" (UID: \"0b8fbcd1-d8ee-49e6-bdf0-6818a2754992\") " pod="openshift-multus/network-metrics-daemon-5xbsg"
Jul 15 15:35:17.438920 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:35:17.438890    2588 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 15:35:17.438920 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:35:17.438909    2588 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 15:35:17.438920 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:35:17.438920    2588 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 15:35:17.438920 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:35:17.438922    2588 projected.go:196] Error preparing data for projected volume kube-api-access-wh2pb for pod openshift-network-diagnostics/network-check-target-fgm54: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 15:35:17.439208 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:35:17.438947    2588 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 15:35:17.439208 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:35:17.438983    2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0383c465-26ac-4666-9180-4298272af4c7-kube-api-access-wh2pb podName:0383c465-26ac-4666-9180-4298272af4c7 nodeName:}" failed. No retries permitted until 2026-07-15 15:35:18.438968653 +0000 UTC m=+4.091034394 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-wh2pb" (UniqueName: "kubernetes.io/projected/0383c465-26ac-4666-9180-4298272af4c7-kube-api-access-wh2pb") pod "network-check-target-fgm54" (UID: "0383c465-26ac-4666-9180-4298272af4c7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 15:35:17.439208 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:35:17.439000    2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b8fbcd1-d8ee-49e6-bdf0-6818a2754992-metrics-certs podName:0b8fbcd1-d8ee-49e6-bdf0-6818a2754992 nodeName:}" failed. No retries permitted until 2026-07-15 15:35:18.438992999 +0000 UTC m=+4.091058736 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0b8fbcd1-d8ee-49e6-bdf0-6818a2754992-metrics-certs") pod "network-metrics-daemon-5xbsg" (UID: "0b8fbcd1-d8ee-49e6-bdf0-6818a2754992") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 15:35:17.439208 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:35:17.439012    2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/542b7772-fe16-4f43-b9fb-e0d1538c5134-original-pull-secret podName:542b7772-fe16-4f43-b9fb-e0d1538c5134 nodeName:}" failed. No retries permitted until 2026-07-15 15:35:18.43900581 +0000 UTC m=+4.091071547 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/542b7772-fe16-4f43-b9fb-e0d1538c5134-original-pull-secret") pod "global-pull-secret-syncer-n4kpw" (UID: "542b7772-fe16-4f43-b9fb-e0d1538c5134") : object "kube-system"/"original-pull-secret" not registered
Jul 15 15:35:17.769429 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:17.769398    2588 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-14 15:30:16 +0000 UTC" deadline="2028-02-26 23:37:21.919817294 +0000 UTC"
Jul 15 15:35:17.769429 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:17.769424    2588 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14192h2m4.150396471s"
Jul 15 15:35:17.904492 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:17.904457    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n4kpw"
Jul 15 15:35:17.904655 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:35:17.904602    2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n4kpw" podUID="542b7772-fe16-4f43-b9fb-e0d1538c5134"
Jul 15 15:35:17.921261 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:17.921227    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dthn7" event={"ID":"ec82e02f-7632-41be-8e7d-8c9d59c569b6","Type":"ContainerStarted","Data":"102f1c12d7024b1c961882f9cc2b0c2123451bf8f07896e4e00b1d4aa37c8229"}
Jul 15 15:35:17.922473 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:17.922440    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-vh644" event={"ID":"baf9a41e-5bae-4ec3-acbe-9d3f88e05149","Type":"ContainerStarted","Data":"71e55551d47068c83a87caaca526613d80e80a0549fda2aadf1b0e05340544f2"}
Jul 15 15:35:17.923658 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:17.923603    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-f7bpr" event={"ID":"0bc9e977-62dc-48b4-bd53-a6ae3de45690","Type":"ContainerStarted","Data":"64e67b95063c9d35b35b148619552056d04e5921e2ecb97b8d9eb95e6deb576a"}
Jul 15 15:35:17.924802 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:17.924776    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m9jzh" event={"ID":"e7a6e261-bdc8-4f06-883e-34d9d91b4434","Type":"ContainerStarted","Data":"ef0485713827ab5742099fee45a7f5e84bd5f20abe78b77d6230bafe7d0fdf94"}
Jul 15 15:35:17.925914 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:17.925882    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-wkp76" event={"ID":"788849c2-e862-481a-a2bb-e34e76030cc3","Type":"ContainerStarted","Data":"9af96b403edef47e5a45869fc6ca02775fe2e9ce0c5ba7d33d8af7abbc166093"}
Jul 15 15:35:17.926925 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:17.926902    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-rx8tl" event={"ID":"be0dcd2c-0e4a-47d0-a26e-b178256de470","Type":"ContainerStarted","Data":"7316dc6bd741a7e21e1f472dc731dc0a1882d55658307aa2fc701d50cd971946"}
Jul 15 15:35:17.928023 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:17.928001    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qpqrs" event={"ID":"d64071a5-5f14-450d-99d6-f9295b7b0edc","Type":"ContainerStarted","Data":"f93bc59b710160e7ef50cac530e28459576346e39037828b4eb9ce345e50d8ae"}
Jul 15 15:35:17.929131 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:17.929109    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-nhrz9" event={"ID":"71307173-3bbb-4ef7-9730-88a17f2552b0","Type":"ContainerStarted","Data":"20999e0b9757673ea7f92f8a62be38782c4a43db104a0f42afea466517b22a13"}
Jul 15 15:35:17.930214 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:17.930192    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-wmcfh" event={"ID":"6d4c5bcd-e4af-48c1-a49c-00ebbf891ff1","Type":"ContainerStarted","Data":"ad3e16ffaea0a0ed9a8f2926dd94e46083b0ee7876fa879b3db535bdc38b78d5"}
Jul 15 15:35:18.445632 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:18.445595    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0b8fbcd1-d8ee-49e6-bdf0-6818a2754992-metrics-certs\") pod \"network-metrics-daemon-5xbsg\" (UID: \"0b8fbcd1-d8ee-49e6-bdf0-6818a2754992\") " pod="openshift-multus/network-metrics-daemon-5xbsg"
Jul 15 15:35:18.445861 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:18.445650    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wh2pb\" (UniqueName: \"kubernetes.io/projected/0383c465-26ac-4666-9180-4298272af4c7-kube-api-access-wh2pb\") pod \"network-check-target-fgm54\" (UID: \"0383c465-26ac-4666-9180-4298272af4c7\") " pod="openshift-network-diagnostics/network-check-target-fgm54"
Jul 15 15:35:18.445861 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:18.445691    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/542b7772-fe16-4f43-b9fb-e0d1538c5134-original-pull-secret\") pod \"global-pull-secret-syncer-n4kpw\" (UID: \"542b7772-fe16-4f43-b9fb-e0d1538c5134\") " pod="kube-system/global-pull-secret-syncer-n4kpw"
Jul 15 15:35:18.445861 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:35:18.445810    2588 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 15:35:18.446042 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:35:18.445874    2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/542b7772-fe16-4f43-b9fb-e0d1538c5134-original-pull-secret podName:542b7772-fe16-4f43-b9fb-e0d1538c5134 nodeName:}" failed. No retries permitted until 2026-07-15 15:35:20.445845868 +0000 UTC m=+6.097911625 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/542b7772-fe16-4f43-b9fb-e0d1538c5134-original-pull-secret") pod "global-pull-secret-syncer-n4kpw" (UID: "542b7772-fe16-4f43-b9fb-e0d1538c5134") : object "kube-system"/"original-pull-secret" not registered
Jul 15 15:35:18.446042 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:35:18.445948    2588 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 15:35:18.446042 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:35:18.445984    2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b8fbcd1-d8ee-49e6-bdf0-6818a2754992-metrics-certs podName:0b8fbcd1-d8ee-49e6-bdf0-6818a2754992 nodeName:}" failed. No retries permitted until 2026-07-15 15:35:20.445973411 +0000 UTC m=+6.098039152 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0b8fbcd1-d8ee-49e6-bdf0-6818a2754992-metrics-certs") pod "network-metrics-daemon-5xbsg" (UID: "0b8fbcd1-d8ee-49e6-bdf0-6818a2754992") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 15:35:18.446192 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:35:18.446073    2588 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 15:35:18.446192 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:35:18.446085    2588 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 15:35:18.446192 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:35:18.446097    2588 projected.go:196] Error preparing data for projected volume kube-api-access-wh2pb for pod openshift-network-diagnostics/network-check-target-fgm54: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 15:35:18.446192 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:35:18.446137    2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0383c465-26ac-4666-9180-4298272af4c7-kube-api-access-wh2pb podName:0383c465-26ac-4666-9180-4298272af4c7 nodeName:}" failed. No retries permitted until 2026-07-15 15:35:20.446124939 +0000 UTC m=+6.098190681 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-wh2pb" (UniqueName: "kubernetes.io/projected/0383c465-26ac-4666-9180-4298272af4c7-kube-api-access-wh2pb") pod "network-check-target-fgm54" (UID: "0383c465-26ac-4666-9180-4298272af4c7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 15:35:18.770148 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:18.770019    2588 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-14 15:30:16 +0000 UTC" deadline="2028-02-18 21:52:49.395121139 +0000 UTC"
Jul 15 15:35:18.770148 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:18.770058    2588 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13998h17m30.625067877s"
Jul 15 15:35:18.904686 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:18.904624    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5xbsg"
Jul 15 15:35:18.904858 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:35:18.904754    2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5xbsg" podUID="0b8fbcd1-d8ee-49e6-bdf0-6818a2754992"
Jul 15 15:35:18.905234 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:18.905031    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fgm54"
Jul 15 15:35:18.905234 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:35:18.905194    2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fgm54" podUID="0383c465-26ac-4666-9180-4298272af4c7"
Jul 15 15:35:18.958062 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:18.958025    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-212.ec2.internal" event={"ID":"83cd7df02ad08b5cd140b5486992b652","Type":"ContainerStarted","Data":"4f848b15607323cd612be6768b138702f9a3412de976f399747f2be397d39ca3"}
Jul 15 15:35:18.981929 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:18.981865    2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-212.ec2.internal" podStartSLOduration=2.981847627 podStartE2EDuration="2.981847627s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 15:35:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:35:18.98140983 +0000 UTC m=+4.633475615" watchObservedRunningTime="2026-07-15 15:35:18.981847627 +0000 UTC m=+4.633913387"
Jul 15 15:35:19.905266 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:19.904710    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n4kpw"
Jul 15 15:35:19.905266 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:35:19.904847    2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n4kpw" podUID="542b7772-fe16-4f43-b9fb-e0d1538c5134"
Jul 15 15:35:19.970862 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:19.970783    2588 generic.go:356] "Generic (PLEG): container finished" podID="f3408ae23f1a053500507023d7c42ba8" containerID="d8d44d84446915430c7292837447a0dc4055ed49e7adc201d6679d0ee1edd1ff" exitCode=0
Jul 15 15:35:19.971333 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:19.971286    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-212.ec2.internal" event={"ID":"f3408ae23f1a053500507023d7c42ba8","Type":"ContainerDied","Data":"d8d44d84446915430c7292837447a0dc4055ed49e7adc201d6679d0ee1edd1ff"}
Jul 15 15:35:20.468545 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:20.467568    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0b8fbcd1-d8ee-49e6-bdf0-6818a2754992-metrics-certs\") pod \"network-metrics-daemon-5xbsg\" (UID: \"0b8fbcd1-d8ee-49e6-bdf0-6818a2754992\") " pod="openshift-multus/network-metrics-daemon-5xbsg"
Jul 15 15:35:20.468545 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:20.467619    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wh2pb\" (UniqueName: \"kubernetes.io/projected/0383c465-26ac-4666-9180-4298272af4c7-kube-api-access-wh2pb\") pod \"network-check-target-fgm54\" (UID: \"0383c465-26ac-4666-9180-4298272af4c7\") " pod="openshift-network-diagnostics/network-check-target-fgm54"
Jul 15 15:35:20.468545 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:20.467662    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/542b7772-fe16-4f43-b9fb-e0d1538c5134-original-pull-secret\") pod \"global-pull-secret-syncer-n4kpw\" (UID: \"542b7772-fe16-4f43-b9fb-e0d1538c5134\") " pod="kube-system/global-pull-secret-syncer-n4kpw"
Jul 15 15:35:20.468545 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:35:20.467786    2588 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 15:35:20.468545 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:35:20.467848    2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/542b7772-fe16-4f43-b9fb-e0d1538c5134-original-pull-secret podName:542b7772-fe16-4f43-b9fb-e0d1538c5134 nodeName:}" failed. No retries permitted until 2026-07-15 15:35:24.467831615 +0000 UTC m=+10.119897357 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/542b7772-fe16-4f43-b9fb-e0d1538c5134-original-pull-secret") pod "global-pull-secret-syncer-n4kpw" (UID: "542b7772-fe16-4f43-b9fb-e0d1538c5134") : object "kube-system"/"original-pull-secret" not registered
Jul 15 15:35:20.468545 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:35:20.468230    2588 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 15:35:20.468545 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:35:20.468277    2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b8fbcd1-d8ee-49e6-bdf0-6818a2754992-metrics-certs podName:0b8fbcd1-d8ee-49e6-bdf0-6818a2754992 nodeName:}" failed. No retries permitted until 2026-07-15 15:35:24.468261872 +0000 UTC m=+10.120327630 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0b8fbcd1-d8ee-49e6-bdf0-6818a2754992-metrics-certs") pod "network-metrics-daemon-5xbsg" (UID: "0b8fbcd1-d8ee-49e6-bdf0-6818a2754992") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 15:35:20.468545 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:35:20.468364    2588 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 15:35:20.468545 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:35:20.468382    2588 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 15:35:20.468545 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:35:20.468394    2588 projected.go:196] Error preparing data for projected volume kube-api-access-wh2pb for pod openshift-network-diagnostics/network-check-target-fgm54: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 15:35:20.468545 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:35:20.468428    2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0383c465-26ac-4666-9180-4298272af4c7-kube-api-access-wh2pb podName:0383c465-26ac-4666-9180-4298272af4c7 nodeName:}" failed. No retries permitted until 2026-07-15 15:35:24.468417206 +0000 UTC m=+10.120482959 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-wh2pb" (UniqueName: "kubernetes.io/projected/0383c465-26ac-4666-9180-4298272af4c7-kube-api-access-wh2pb") pod "network-check-target-fgm54" (UID: "0383c465-26ac-4666-9180-4298272af4c7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 15:35:20.907546 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:20.907514    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fgm54"
Jul 15 15:35:20.907755 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:35:20.907638    2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fgm54" podUID="0383c465-26ac-4666-9180-4298272af4c7"
Jul 15 15:35:20.908247 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:20.908037    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5xbsg"
Jul 15 15:35:20.908247 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:35:20.908153    2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5xbsg" podUID="0b8fbcd1-d8ee-49e6-bdf0-6818a2754992"
Jul 15 15:35:20.980541 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:20.980497    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-212.ec2.internal" event={"ID":"f3408ae23f1a053500507023d7c42ba8","Type":"ContainerStarted","Data":"5741304c2caea94d61a632e26458a7a7f33d4e1b94cd60b21afde9bf8387faeb"}
Jul 15 15:35:21.904762 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:21.904730    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n4kpw"
Jul 15 15:35:21.904984 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:35:21.904866    2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n4kpw" podUID="542b7772-fe16-4f43-b9fb-e0d1538c5134"
Jul 15 15:35:22.906213 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:22.905462    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fgm54"
Jul 15 15:35:22.906213 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:35:22.905597    2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fgm54" podUID="0383c465-26ac-4666-9180-4298272af4c7"
Jul 15 15:35:22.906213 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:22.906016    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5xbsg"
Jul 15 15:35:22.906213 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:35:22.906123    2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5xbsg" podUID="0b8fbcd1-d8ee-49e6-bdf0-6818a2754992"
Jul 15 15:35:23.904584 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:23.904553    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n4kpw"
Jul 15 15:35:23.904764 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:35:23.904674    2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n4kpw" podUID="542b7772-fe16-4f43-b9fb-e0d1538c5134"
Jul 15 15:35:24.502332 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:24.502294    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0b8fbcd1-d8ee-49e6-bdf0-6818a2754992-metrics-certs\") pod \"network-metrics-daemon-5xbsg\" (UID: \"0b8fbcd1-d8ee-49e6-bdf0-6818a2754992\") " pod="openshift-multus/network-metrics-daemon-5xbsg"
Jul 15 15:35:24.502802 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:24.502366    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wh2pb\" (UniqueName: \"kubernetes.io/projected/0383c465-26ac-4666-9180-4298272af4c7-kube-api-access-wh2pb\") pod \"network-check-target-fgm54\" (UID: \"0383c465-26ac-4666-9180-4298272af4c7\") " pod="openshift-network-diagnostics/network-check-target-fgm54"
Jul 15 15:35:24.502802 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:24.502409    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/542b7772-fe16-4f43-b9fb-e0d1538c5134-original-pull-secret\") pod \"global-pull-secret-syncer-n4kpw\" (UID: \"542b7772-fe16-4f43-b9fb-e0d1538c5134\") " pod="kube-system/global-pull-secret-syncer-n4kpw"
Jul 15 15:35:24.502802 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:35:24.502525    2588 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 15:35:24.502802 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:35:24.502580    2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/542b7772-fe16-4f43-b9fb-e0d1538c5134-original-pull-secret podName:542b7772-fe16-4f43-b9fb-e0d1538c5134 nodeName:}" failed. No retries permitted until 2026-07-15 15:35:32.502561487 +0000 UTC m=+18.154627244 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/542b7772-fe16-4f43-b9fb-e0d1538c5134-original-pull-secret") pod "global-pull-secret-syncer-n4kpw" (UID: "542b7772-fe16-4f43-b9fb-e0d1538c5134") : object "kube-system"/"original-pull-secret" not registered
Jul 15 15:35:24.503003 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:35:24.502972    2588 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 15:35:24.503054 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:35:24.503017    2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b8fbcd1-d8ee-49e6-bdf0-6818a2754992-metrics-certs podName:0b8fbcd1-d8ee-49e6-bdf0-6818a2754992 nodeName:}" failed. No retries permitted until 2026-07-15 15:35:32.503002166 +0000 UTC m=+18.155067920 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0b8fbcd1-d8ee-49e6-bdf0-6818a2754992-metrics-certs") pod "network-metrics-daemon-5xbsg" (UID: "0b8fbcd1-d8ee-49e6-bdf0-6818a2754992") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 15:35:24.503100 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:35:24.503090    2588 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 15:35:24.503149 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:35:24.503107    2588 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 15:35:24.503149 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:35:24.503119    2588 projected.go:196] Error preparing data for projected volume kube-api-access-wh2pb for pod openshift-network-diagnostics/network-check-target-fgm54: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 15:35:24.503237 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:35:24.503152    2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0383c465-26ac-4666-9180-4298272af4c7-kube-api-access-wh2pb podName:0383c465-26ac-4666-9180-4298272af4c7 nodeName:}" failed. No retries permitted until 2026-07-15 15:35:32.50314161 +0000 UTC m=+18.155207361 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-wh2pb" (UniqueName: "kubernetes.io/projected/0383c465-26ac-4666-9180-4298272af4c7-kube-api-access-wh2pb") pod "network-check-target-fgm54" (UID: "0383c465-26ac-4666-9180-4298272af4c7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 15:35:24.909360 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:24.909316    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fgm54"
Jul 15 15:35:24.909360 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:24.909330    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5xbsg"
Jul 15 15:35:24.909568 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:35:24.909456    2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5xbsg" podUID="0b8fbcd1-d8ee-49e6-bdf0-6818a2754992"
Jul 15 15:35:24.909892 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:35:24.909848    2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fgm54" podUID="0383c465-26ac-4666-9180-4298272af4c7"
Jul 15 15:35:25.905011 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:25.904977    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n4kpw"
Jul 15 15:35:25.905556 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:35:25.905111    2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n4kpw" podUID="542b7772-fe16-4f43-b9fb-e0d1538c5134"
Jul 15 15:35:26.908011 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:26.907984    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5xbsg"
Jul 15 15:35:26.908370 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:26.908029    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fgm54"
Jul 15 15:35:26.908370 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:35:26.908121    2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5xbsg" podUID="0b8fbcd1-d8ee-49e6-bdf0-6818a2754992"
Jul 15 15:35:26.908370 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:35:26.908226    2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fgm54" podUID="0383c465-26ac-4666-9180-4298272af4c7"
Jul 15 15:35:27.904235 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:27.904202    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n4kpw"
Jul 15 15:35:27.904412 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:35:27.904359    2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n4kpw" podUID="542b7772-fe16-4f43-b9fb-e0d1538c5134"
Jul 15 15:35:28.904782 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:28.904704    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fgm54"
Jul 15 15:35:28.905219 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:35:28.904813    2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fgm54" podUID="0383c465-26ac-4666-9180-4298272af4c7"
Jul 15 15:35:28.905219 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:28.905114    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5xbsg"
Jul 15 15:35:28.905320 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:35:28.905216    2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5xbsg" podUID="0b8fbcd1-d8ee-49e6-bdf0-6818a2754992"
Jul 15 15:35:29.905005 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:29.904964    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n4kpw"
Jul 15 15:35:29.905453 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:35:29.905099    2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n4kpw" podUID="542b7772-fe16-4f43-b9fb-e0d1538c5134"
Jul 15 15:35:30.905184 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:30.905150    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5xbsg"
Jul 15 15:35:30.905626 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:30.905150    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fgm54"
Jul 15 15:35:30.905626 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:35:30.905293    2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5xbsg" podUID="0b8fbcd1-d8ee-49e6-bdf0-6818a2754992"
Jul 15 15:35:30.905626 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:35:30.905359    2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fgm54" podUID="0383c465-26ac-4666-9180-4298272af4c7"
Jul 15 15:35:31.904222 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:31.904187    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n4kpw"
Jul 15 15:35:31.904450 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:35:31.904312    2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n4kpw" podUID="542b7772-fe16-4f43-b9fb-e0d1538c5134"
Jul 15 15:35:32.571560 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:32.571523    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/542b7772-fe16-4f43-b9fb-e0d1538c5134-original-pull-secret\") pod \"global-pull-secret-syncer-n4kpw\" (UID: \"542b7772-fe16-4f43-b9fb-e0d1538c5134\") " pod="kube-system/global-pull-secret-syncer-n4kpw"
Jul 15 15:35:32.571937 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:32.571574    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0b8fbcd1-d8ee-49e6-bdf0-6818a2754992-metrics-certs\") pod \"network-metrics-daemon-5xbsg\" (UID: \"0b8fbcd1-d8ee-49e6-bdf0-6818a2754992\") " pod="openshift-multus/network-metrics-daemon-5xbsg"
Jul 15 15:35:32.571937 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:32.571594    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wh2pb\" (UniqueName: \"kubernetes.io/projected/0383c465-26ac-4666-9180-4298272af4c7-kube-api-access-wh2pb\") pod \"network-check-target-fgm54\" (UID: \"0383c465-26ac-4666-9180-4298272af4c7\") " pod="openshift-network-diagnostics/network-check-target-fgm54"
Jul 15 15:35:32.571937 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:35:32.571689    2588 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 15:35:32.571937 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:35:32.571757    2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b8fbcd1-d8ee-49e6-bdf0-6818a2754992-metrics-certs podName:0b8fbcd1-d8ee-49e6-bdf0-6818a2754992 nodeName:}" failed. No retries permitted until 2026-07-15 15:35:48.571742007 +0000 UTC m=+34.223807748 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0b8fbcd1-d8ee-49e6-bdf0-6818a2754992-metrics-certs") pod "network-metrics-daemon-5xbsg" (UID: "0b8fbcd1-d8ee-49e6-bdf0-6818a2754992") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 15:35:32.571937 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:35:32.571693    2588 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 15:35:32.571937 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:35:32.571807    2588 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 15:35:32.571937 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:35:32.571820    2588 projected.go:196] Error preparing data for projected volume kube-api-access-wh2pb for pod openshift-network-diagnostics/network-check-target-fgm54: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 15:35:32.571937 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:35:32.571689    2588 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 15:35:32.571937 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:35:32.571859    2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0383c465-26ac-4666-9180-4298272af4c7-kube-api-access-wh2pb podName:0383c465-26ac-4666-9180-4298272af4c7 nodeName:}" failed. No retries permitted until 2026-07-15 15:35:48.571846718 +0000 UTC m=+34.223912468 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-wh2pb" (UniqueName: "kubernetes.io/projected/0383c465-26ac-4666-9180-4298272af4c7-kube-api-access-wh2pb") pod "network-check-target-fgm54" (UID: "0383c465-26ac-4666-9180-4298272af4c7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 15:35:32.571937 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:35:32.571904    2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/542b7772-fe16-4f43-b9fb-e0d1538c5134-original-pull-secret podName:542b7772-fe16-4f43-b9fb-e0d1538c5134 nodeName:}" failed. No retries permitted until 2026-07-15 15:35:48.571893692 +0000 UTC m=+34.223959429 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/542b7772-fe16-4f43-b9fb-e0d1538c5134-original-pull-secret") pod "global-pull-secret-syncer-n4kpw" (UID: "542b7772-fe16-4f43-b9fb-e0d1538c5134") : object "kube-system"/"original-pull-secret" not registered
Jul 15 15:35:32.905216 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:32.905182    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fgm54"
Jul 15 15:35:32.905402 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:32.905182    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5xbsg"
Jul 15 15:35:32.905402 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:35:32.905297    2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fgm54" podUID="0383c465-26ac-4666-9180-4298272af4c7"
Jul 15 15:35:32.905402 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:35:32.905388    2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5xbsg" podUID="0b8fbcd1-d8ee-49e6-bdf0-6818a2754992"
Jul 15 15:35:33.904946 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:33.904914    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n4kpw"
Jul 15 15:35:33.905333 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:35:33.905038    2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n4kpw" podUID="542b7772-fe16-4f43-b9fb-e0d1538c5134"
Jul 15 15:35:34.905128 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:34.905095    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5xbsg"
Jul 15 15:35:34.905572 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:35:34.905205    2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5xbsg" podUID="0b8fbcd1-d8ee-49e6-bdf0-6818a2754992"
Jul 15 15:35:34.905572 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:34.905267    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fgm54"
Jul 15 15:35:34.905572 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:35:34.905399    2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fgm54" podUID="0383c465-26ac-4666-9180-4298272af4c7"
Jul 15 15:35:35.905095 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:35.905062    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n4kpw"
Jul 15 15:35:35.905240 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:35:35.905193    2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n4kpw" podUID="542b7772-fe16-4f43-b9fb-e0d1538c5134"
Jul 15 15:35:36.904773 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:36.904528    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5xbsg"
Jul 15 15:35:36.905028 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:36.904542    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fgm54"
Jul 15 15:35:36.905028 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:35:36.904896    2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5xbsg" podUID="0b8fbcd1-d8ee-49e6-bdf0-6818a2754992"
Jul 15 15:35:36.905028 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:35:36.904952    2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fgm54" podUID="0383c465-26ac-4666-9180-4298272af4c7"
Jul 15 15:35:37.012507 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:37.012476    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-f7bpr" event={"ID":"0bc9e977-62dc-48b4-bd53-a6ae3de45690","Type":"ContainerStarted","Data":"f9e8f5ef07f903671adf480a58734302d361db4a7474897a43d0d64a1b0fdaaa"}
Jul 15 15:35:37.014168 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:37.014145    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m9jzh" event={"ID":"e7a6e261-bdc8-4f06-883e-34d9d91b4434","Type":"ContainerStarted","Data":"4ef48e1e1d069deb6ef0ba27d5a64723e689b14db66e3775fc208d007f9c06b3"}
Jul 15 15:35:37.015537 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:37.015512    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-wkp76" event={"ID":"788849c2-e862-481a-a2bb-e34e76030cc3","Type":"ContainerStarted","Data":"371866d5a4a71c03e07426b35fa54a5898e6090a57f65baadaeec1ac09edcb5f"}
Jul 15 15:35:37.017162 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:37.017138    2588 generic.go:356] "Generic (PLEG): container finished" podID="d64071a5-5f14-450d-99d6-f9295b7b0edc" containerID="34f060c4a0d9b14f7ee8cfa15f574f698e31c1db9517ea4dbb81adc6d9cd47e9" exitCode=0
Jul 15 15:35:37.017259 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:37.017211    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qpqrs" event={"ID":"d64071a5-5f14-450d-99d6-f9295b7b0edc","Type":"ContainerDied","Data":"34f060c4a0d9b14f7ee8cfa15f574f698e31c1db9517ea4dbb81adc6d9cd47e9"}
Jul 15 15:35:37.018633 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:37.018603    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-nhrz9" event={"ID":"71307173-3bbb-4ef7-9730-88a17f2552b0","Type":"ContainerStarted","Data":"0ed43dcb1255dfe4c2620476c6fca5ed4b5e6a4bfdadb33e0af4f534330d3c26"}
Jul 15 15:35:37.020047 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:37.020024    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-wmcfh" event={"ID":"6d4c5bcd-e4af-48c1-a49c-00ebbf891ff1","Type":"ContainerStarted","Data":"28ef9709d4e4f2a972c0ed2dacb49f61c81f0ebb83b12098fbbb56e2f88d9985"}
Jul 15 15:35:37.022074 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:37.022060    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dthn7_ec82e02f-7632-41be-8e7d-8c9d59c569b6/ovn-acl-logging/0.log"
Jul 15 15:35:37.022380 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:37.022359    2588 generic.go:356] "Generic (PLEG): container finished" podID="ec82e02f-7632-41be-8e7d-8c9d59c569b6" containerID="2816107a528f3a2f25531a25eb154dd0e1ed36e783437b04e6c0b3d44bc1832b" exitCode=1
Jul 15 15:35:37.022433 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:37.022362    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dthn7" event={"ID":"ec82e02f-7632-41be-8e7d-8c9d59c569b6","Type":"ContainerStarted","Data":"ad50e9008587754ab0c40ae721059a002fc98ebf6ac10f83587048a3f7345522"}
Jul 15 15:35:37.022489 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:37.022475    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dthn7" event={"ID":"ec82e02f-7632-41be-8e7d-8c9d59c569b6","Type":"ContainerStarted","Data":"355b20f31eeaf28602a0e653f75ffa302dd8f26a5a8aa1e8e9daafe6279e941e"}
Jul 15 15:35:37.022531 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:37.022512    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dthn7" event={"ID":"ec82e02f-7632-41be-8e7d-8c9d59c569b6","Type":"ContainerDied","Data":"2816107a528f3a2f25531a25eb154dd0e1ed36e783437b04e6c0b3d44bc1832b"}
Jul 15 15:35:37.022565 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:37.022546    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dthn7" event={"ID":"ec82e02f-7632-41be-8e7d-8c9d59c569b6","Type":"ContainerStarted","Data":"c289939fd6167fa89da394f965038395a36b13276795d2b9651f49207cde6644"}
Jul 15 15:35:37.024104 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:37.024086    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-vh644" event={"ID":"baf9a41e-5bae-4ec3-acbe-9d3f88e05149","Type":"ContainerStarted","Data":"83185a900a3cd4fe425e0674b7672d6796c83c0a17feccdf876098fae0688bb3"}
Jul 15 15:35:37.028979 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:37.028943    2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-f7bpr" podStartSLOduration=2.590494992 podStartE2EDuration="22.028932667s" totalImagesPullingTime="19.438437675s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 15:35:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:35:37.028568792 +0000 UTC m=+22.680634550" watchObservedRunningTime="2026-07-15 15:35:37.028932667 +0000 UTC m=+22.680998426"
Jul 15 15:35:37.029063 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:37.029007    2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-212.ec2.internal" podStartSLOduration=21.029002431 podStartE2EDuration="21.029002431s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 15:35:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:35:21.003541764 +0000 UTC m=+6.655607523" watchObservedRunningTime="2026-07-15 15:35:37.029002431 +0000 UTC m=+22.681068187"
Jul 15 15:35:37.080876 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:37.080752    2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-wkp76" podStartSLOduration=2.594148496 podStartE2EDuration="22.080738612s" totalImagesPullingTime="19.486590116s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 15:35:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:35:37.080211965 +0000 UTC m=+22.732277723" watchObservedRunningTime="2026-07-15 15:35:37.080738612 +0000 UTC m=+22.732804371"
Jul 15 15:35:37.102662 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:37.102623    2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-wmcfh" podStartSLOduration=3.600506576 podStartE2EDuration="23.102609077s" totalImagesPullingTime="19.502102501s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 15:35:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:35:37.102411367 +0000 UTC m=+22.754477147" watchObservedRunningTime="2026-07-15 15:35:37.102609077 +0000 UTC m=+22.754674835"
Jul 15 15:35:37.130532 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:37.130455    2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-nhrz9" podStartSLOduration=3.641328396 podStartE2EDuration="23.130442192s" totalImagesPullingTime="19.489113796s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 15:35:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:35:37.130209173 +0000 UTC m=+22.782274956" watchObservedRunningTime="2026-07-15 15:35:37.130442192 +0000 UTC m=+22.782507950"
Jul 15 15:35:37.157950 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:37.157912    2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-vh644" podStartSLOduration=2.673255488 podStartE2EDuration="22.157899218s" totalImagesPullingTime="19.48464373s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 15:35:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:35:37.157625283 +0000 UTC m=+22.809691042" watchObservedRunningTime="2026-07-15 15:35:37.157899218 +0000 UTC m=+22.809964976"
Jul 15 15:35:37.757896 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:37.757829    2588 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-nhrz9"
Jul 15 15:35:37.758554 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:37.758535    2588 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-nhrz9"
Jul 15 15:35:37.904406 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:37.904386    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n4kpw"
Jul 15 15:35:37.904515 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:35:37.904485    2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n4kpw" podUID="542b7772-fe16-4f43-b9fb-e0d1538c5134"
Jul 15 15:35:38.029847 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:38.029823    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dthn7_ec82e02f-7632-41be-8e7d-8c9d59c569b6/ovn-acl-logging/0.log"
Jul 15 15:35:38.030367 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:38.030241    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dthn7" event={"ID":"ec82e02f-7632-41be-8e7d-8c9d59c569b6","Type":"ContainerStarted","Data":"29c0765fca1b0a2f85bbac834b34c8446907c20ed7bd7d69873b9f1c951e5a22"}
Jul 15 15:35:38.030367 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:38.030312    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dthn7" event={"ID":"ec82e02f-7632-41be-8e7d-8c9d59c569b6","Type":"ContainerStarted","Data":"b9eed4d0e65d1cf912f544b699b92b079422bbbbdca456f995b28310321d5613"}
Jul 15 15:35:38.031780 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:38.031759    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-rx8tl" event={"ID":"be0dcd2c-0e4a-47d0-a26e-b178256de470","Type":"ContainerStarted","Data":"ae568985087f78a49c1bba73cbdde51f6a59963384d60a775713edc23880183b"}
Jul 15 15:35:38.056224 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:38.056183    2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-rx8tl" podStartSLOduration=3.5849950699999997 podStartE2EDuration="23.056166413s" totalImagesPullingTime="19.471171343s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 15:35:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:35:38.055559966 +0000 UTC m=+23.707625727" watchObservedRunningTime="2026-07-15 15:35:38.056166413 +0000 UTC m=+23.708232175"
Jul 15 15:35:38.142314 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:38.142259    2588 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 15 15:35:38.800862 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:38.800694    2588 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-15T15:35:38.142279083Z","UUID":"1a227a3f-c5e5-4155-a27f-a258f4034b30","Handler":null,"Name":"","Endpoint":""}
Jul 15 15:35:38.802440 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:38.802413    2588 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 15 15:35:38.802568 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:38.802461    2588 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 15 15:35:38.904695 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:38.904664    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fgm54"
Jul 15 15:35:38.904695 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:38.904691    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5xbsg"
Jul 15 15:35:38.904926 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:35:38.904785    2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fgm54" podUID="0383c465-26ac-4666-9180-4298272af4c7"
Jul 15 15:35:38.904980 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:35:38.904922    2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5xbsg" podUID="0b8fbcd1-d8ee-49e6-bdf0-6818a2754992"
Jul 15 15:35:39.035864 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:39.035834    2588 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 15 15:35:39.036267 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:39.035837    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m9jzh" event={"ID":"e7a6e261-bdc8-4f06-883e-34d9d91b4434","Type":"ContainerStarted","Data":"6c07da749db1f3eaa649891aaac716b666a58435b60089e5d2184318d56b717f"}
Jul 15 15:35:39.905134 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:39.904924    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n4kpw"
Jul 15 15:35:39.905278 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:35:39.905231    2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n4kpw" podUID="542b7772-fe16-4f43-b9fb-e0d1538c5134"
Jul 15 15:35:40.044189 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:40.044156    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dthn7_ec82e02f-7632-41be-8e7d-8c9d59c569b6/ovn-acl-logging/0.log"
Jul 15 15:35:40.044639 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:40.044536    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dthn7" event={"ID":"ec82e02f-7632-41be-8e7d-8c9d59c569b6","Type":"ContainerStarted","Data":"38df602506de1dd0e2374199cd184094d0ad9435b25c742fef54db2505d8dc25"}
Jul 15 15:35:40.905093 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:40.905065    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5xbsg"
Jul 15 15:35:40.905365 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:40.905070    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fgm54"
Jul 15 15:35:40.905365 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:35:40.905176    2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5xbsg" podUID="0b8fbcd1-d8ee-49e6-bdf0-6818a2754992"
Jul 15 15:35:40.905365 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:35:40.905262    2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fgm54" podUID="0383c465-26ac-4666-9180-4298272af4c7"
Jul 15 15:35:41.904505 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:41.904299    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n4kpw"
Jul 15 15:35:41.905082 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:35:41.904602    2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n4kpw" podUID="542b7772-fe16-4f43-b9fb-e0d1538c5134"
Jul 15 15:35:42.051395 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:42.051369    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dthn7_ec82e02f-7632-41be-8e7d-8c9d59c569b6/ovn-acl-logging/0.log"
Jul 15 15:35:42.051722 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:42.051689    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dthn7" event={"ID":"ec82e02f-7632-41be-8e7d-8c9d59c569b6","Type":"ContainerStarted","Data":"04c23345e3bb876f1fedff2d6f8a60f316152585d85d4552c301531c23005664"}
Jul 15 15:35:42.054713 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:42.052592    2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-dthn7"
Jul 15 15:35:42.054713 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:42.052712    2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-dthn7"
Jul 15 15:35:42.054713 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:42.052781    2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-dthn7"
Jul 15 15:35:42.054713 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:42.052802    2588 scope.go:117] "RemoveContainer" containerID="2816107a528f3a2f25531a25eb154dd0e1ed36e783437b04e6c0b3d44bc1832b"
Jul 15 15:35:42.057357 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:42.057312    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m9jzh" event={"ID":"e7a6e261-bdc8-4f06-883e-34d9d91b4434","Type":"ContainerStarted","Data":"b0f8b76fb66457d634cda9e5ae4a98ba3abbe206866b865c21179b461cb0dadd"}
Jul 15 15:35:42.059540 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:42.059511    2588 generic.go:356] "Generic (PLEG): container finished" podID="d64071a5-5f14-450d-99d6-f9295b7b0edc" containerID="1a731241e1ad95357d88e82c78dfaa468fbe97c21ae30e348dd4e206efd840a1" exitCode=0
Jul 15 15:35:42.059636 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:42.059551    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qpqrs" event={"ID":"d64071a5-5f14-450d-99d6-f9295b7b0edc","Type":"ContainerDied","Data":"1a731241e1ad95357d88e82c78dfaa468fbe97c21ae30e348dd4e206efd840a1"}
Jul 15 15:35:42.071507 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:42.071486    2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-dthn7"
Jul 15 15:35:42.071595 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:42.071585    2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-dthn7"
Jul 15 15:35:42.164237 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:42.164183    2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m9jzh" podStartSLOduration=2.797811444 podStartE2EDuration="27.164165578s" totalImagesPullingTime="24.366354134s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 15:35:15 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:35:42.163616694 +0000 UTC m=+27.815682477" watchObservedRunningTime="2026-07-15 15:35:42.164165578 +0000 UTC m=+27.816231336"
Jul 15 15:35:42.905810 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:42.905777    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fgm54"
Jul 15 15:35:42.906275 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:35:42.905913    2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fgm54" podUID="0383c465-26ac-4666-9180-4298272af4c7"
Jul 15 15:35:42.906275 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:42.905779    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5xbsg"
Jul 15 15:35:42.906415 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:35:42.906398    2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5xbsg" podUID="0b8fbcd1-d8ee-49e6-bdf0-6818a2754992"
Jul 15 15:35:42.951648 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:42.951619    2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-nhrz9"
Jul 15 15:35:42.951806 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:42.951736    2588 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 15 15:35:42.952138 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:42.952124    2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-nhrz9"
Jul 15 15:35:43.065280 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:43.065249    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dthn7_ec82e02f-7632-41be-8e7d-8c9d59c569b6/ovn-acl-logging/0.log"
Jul 15 15:35:43.065676 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:43.065649    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dthn7" event={"ID":"ec82e02f-7632-41be-8e7d-8c9d59c569b6","Type":"ContainerStarted","Data":"fa0165c2a59dcdd25fbd57f82a9ec4328e805b22b74399893b38827bb3f2cc13"}
Jul 15 15:35:43.096131 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:43.096087    2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-dthn7" podStartSLOduration=8.622095009 podStartE2EDuration="28.096072728s" totalImagesPullingTime="19.473977719s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 15:35:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:35:43.094447806 +0000 UTC m=+28.746513581" watchObservedRunningTime="2026-07-15 15:35:43.096072728 +0000 UTC m=+28.748138486"
Jul 15 15:35:43.602528 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:43.602497    2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-n4kpw"]
Jul 15 15:35:43.602755 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:43.602634    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n4kpw"
Jul 15 15:35:43.602755 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:35:43.602742    2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n4kpw" podUID="542b7772-fe16-4f43-b9fb-e0d1538c5134"
Jul 15 15:35:43.606536 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:43.606514    2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-fgm54"]
Jul 15 15:35:43.606664 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:43.606610    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fgm54"
Jul 15 15:35:43.606722 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:35:43.606699    2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fgm54" podUID="0383c465-26ac-4666-9180-4298272af4c7"
Jul 15 15:35:43.609147 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:43.609126    2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-5xbsg"]
Jul 15 15:35:43.609233 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:43.609206    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5xbsg"
Jul 15 15:35:43.609286 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:35:43.609271    2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5xbsg" podUID="0b8fbcd1-d8ee-49e6-bdf0-6818a2754992"
Jul 15 15:35:44.069552 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:44.069471    2588 generic.go:356] "Generic (PLEG): container finished" podID="d64071a5-5f14-450d-99d6-f9295b7b0edc" containerID="32c77512fb6336b36ad6c7923372f2ee53c964d855a6a8fc445643946dd18768" exitCode=0
Jul 15 15:35:44.069918 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:44.069554    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qpqrs" event={"ID":"d64071a5-5f14-450d-99d6-f9295b7b0edc","Type":"ContainerDied","Data":"32c77512fb6336b36ad6c7923372f2ee53c964d855a6a8fc445643946dd18768"}
Jul 15 15:35:45.905328 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:45.905149    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5xbsg"
Jul 15 15:35:45.905772 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:45.905149    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fgm54"
Jul 15 15:35:45.905772 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:35:45.905446    2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5xbsg" podUID="0b8fbcd1-d8ee-49e6-bdf0-6818a2754992"
Jul 15 15:35:45.905772 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:45.905158    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n4kpw"
Jul 15 15:35:45.905772 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:35:45.905492    2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fgm54" podUID="0383c465-26ac-4666-9180-4298272af4c7"
Jul 15 15:35:45.905772 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:35:45.905564    2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n4kpw" podUID="542b7772-fe16-4f43-b9fb-e0d1538c5134"
Jul 15 15:35:46.077760 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:46.077731    2588 generic.go:356] "Generic (PLEG): container finished" podID="d64071a5-5f14-450d-99d6-f9295b7b0edc" containerID="56ab953a674a287168d559d2efb8ff4708d9f5097d0bdbe51dd6fb0b0057ff84" exitCode=0
Jul 15 15:35:46.077899 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:46.077772    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qpqrs" event={"ID":"d64071a5-5f14-450d-99d6-f9295b7b0edc","Type":"ContainerDied","Data":"56ab953a674a287168d559d2efb8ff4708d9f5097d0bdbe51dd6fb0b0057ff84"}
Jul 15 15:35:47.905048 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:47.905010    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5xbsg"
Jul 15 15:35:47.905683 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:47.905010    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n4kpw"
Jul 15 15:35:47.905683 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:35:47.905145    2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5xbsg" podUID="0b8fbcd1-d8ee-49e6-bdf0-6818a2754992"
Jul 15 15:35:47.905683 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:35:47.905272    2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n4kpw" podUID="542b7772-fe16-4f43-b9fb-e0d1538c5134"
Jul 15 15:35:47.905683 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:47.905010    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fgm54"
Jul 15 15:35:47.905683 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:35:47.905396    2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fgm54" podUID="0383c465-26ac-4666-9180-4298272af4c7"
Jul 15 15:35:48.589509 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:48.589479    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/542b7772-fe16-4f43-b9fb-e0d1538c5134-original-pull-secret\") pod \"global-pull-secret-syncer-n4kpw\" (UID: \"542b7772-fe16-4f43-b9fb-e0d1538c5134\") " pod="kube-system/global-pull-secret-syncer-n4kpw"
Jul 15 15:35:48.589702 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:48.589541    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0b8fbcd1-d8ee-49e6-bdf0-6818a2754992-metrics-certs\") pod \"network-metrics-daemon-5xbsg\" (UID: \"0b8fbcd1-d8ee-49e6-bdf0-6818a2754992\") " pod="openshift-multus/network-metrics-daemon-5xbsg"
Jul 15 15:35:48.589702 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:48.589572    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wh2pb\" (UniqueName: \"kubernetes.io/projected/0383c465-26ac-4666-9180-4298272af4c7-kube-api-access-wh2pb\") pod \"network-check-target-fgm54\" (UID: \"0383c465-26ac-4666-9180-4298272af4c7\") " pod="openshift-network-diagnostics/network-check-target-fgm54"
Jul 15 15:35:48.589702 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:35:48.589651    2588 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 15:35:48.589702 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:35:48.589691    2588 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 15:35:48.589904 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:35:48.589720    2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/542b7772-fe16-4f43-b9fb-e0d1538c5134-original-pull-secret podName:542b7772-fe16-4f43-b9fb-e0d1538c5134 nodeName:}" failed. No retries permitted until 2026-07-15 15:36:20.589698185 +0000 UTC m=+66.241763935 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/542b7772-fe16-4f43-b9fb-e0d1538c5134-original-pull-secret") pod "global-pull-secret-syncer-n4kpw" (UID: "542b7772-fe16-4f43-b9fb-e0d1538c5134") : object "kube-system"/"original-pull-secret" not registered
Jul 15 15:35:48.589904 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:35:48.589751    2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b8fbcd1-d8ee-49e6-bdf0-6818a2754992-metrics-certs podName:0b8fbcd1-d8ee-49e6-bdf0-6818a2754992 nodeName:}" failed. No retries permitted until 2026-07-15 15:36:20.589734805 +0000 UTC m=+66.241800552 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0b8fbcd1-d8ee-49e6-bdf0-6818a2754992-metrics-certs") pod "network-metrics-daemon-5xbsg" (UID: "0b8fbcd1-d8ee-49e6-bdf0-6818a2754992") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 15:35:48.589904 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:35:48.589761    2588 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 15:35:48.589904 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:35:48.589779    2588 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 15:35:48.589904 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:35:48.589793    2588 projected.go:196] Error preparing data for projected volume kube-api-access-wh2pb for pod openshift-network-diagnostics/network-check-target-fgm54: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 15:35:48.589904 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:35:48.589835    2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0383c465-26ac-4666-9180-4298272af4c7-kube-api-access-wh2pb podName:0383c465-26ac-4666-9180-4298272af4c7 nodeName:}" failed. No retries permitted until 2026-07-15 15:36:20.589825941 +0000 UTC m=+66.241891683 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-wh2pb" (UniqueName: "kubernetes.io/projected/0383c465-26ac-4666-9180-4298272af4c7-kube-api-access-wh2pb") pod "network-check-target-fgm54" (UID: "0383c465-26ac-4666-9180-4298272af4c7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 15:35:49.170247 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:49.170218    2588 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-212.ec2.internal" event="NodeReady"
Jul 15 15:35:49.170686 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:49.170382    2588 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 15 15:35:49.213902 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:49.213870    2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-ntx28"]
Jul 15 15:35:49.235122 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:49.235095    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-ntx28"
Jul 15 15:35:49.235966 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:49.235388    2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-xqhg4"]
Jul 15 15:35:49.239114 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:49.239087    2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Jul 15 15:35:49.239689 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:49.239651    2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-8bvdn\""
Jul 15 15:35:49.240405 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:49.240278    2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Jul 15 15:35:49.246650 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:49.246439    2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-pxkjb"]
Jul 15 15:35:49.247078 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:49.246888    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-xqhg4"
Jul 15 15:35:49.250631 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:49.250231    2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Jul 15 15:35:49.250631 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:49.250394    2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Jul 15 15:35:49.250631 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:49.250421    2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Jul 15 15:35:49.250631 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:49.250419    2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-bj8pt\""
Jul 15 15:35:49.250631 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:49.250584    2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Jul 15 15:35:49.259564 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:49.259533    2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-zkq4t"]
Jul 15 15:35:49.259681 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:49.259662    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-pxkjb"
Jul 15 15:35:49.263889 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:49.263870    2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Jul 15 15:35:49.263889 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:49.263885    2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Jul 15 15:35:49.264042 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:49.264031    2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Jul 15 15:35:49.264415 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:49.264395    2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Jul 15 15:35:49.264507 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:49.264416    2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-r2cpk\""
Jul 15 15:35:49.271760 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:49.271742    2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-7866497494-qcvqk"]
Jul 15 15:35:49.271873 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:49.271857    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-zkq4t"
Jul 15 15:35:49.274897 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:49.274845    2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Jul 15 15:35:49.275086 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:49.275071    2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Jul 15 15:35:49.275165 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:49.275136    2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Jul 15 15:35:49.275621 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:49.275602    2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-x97q5\""
Jul 15 15:35:49.283866 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:49.283850    2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7497644dd6-r6f4x"]
Jul 15 15:35:49.283986 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:49.283969    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7866497494-qcvqk"
Jul 15 15:35:49.287907 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:49.287888    2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Jul 15 15:35:49.288292 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:49.288276    2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Jul 15 15:35:49.288629 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:49.288611    2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Jul 15 15:35:49.288764 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:49.288747    2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Jul 15 15:35:49.289126 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:49.288829    2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-lzzjf\""
Jul 15 15:35:49.293896 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:49.293854    2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Jul 15 15:35:49.298010 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:49.297991    2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-d5wnr"]
Jul 15 15:35:49.298125 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:49.298111    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7497644dd6-r6f4x"
Jul 15 15:35:49.306473 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:49.306456    2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 15 15:35:49.306877 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:49.306481    2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-b5ggf\""
Jul 15 15:35:49.306877 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:49.306742    2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 15 15:35:49.306877 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:49.306655    2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 15 15:35:49.311852 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:49.311835    2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-ntx28"]
Jul 15 15:35:49.311984 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:49.311870    2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-sksmh"]
Jul 15 15:35:49.311984 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:49.311954    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-68d9dd94cf-d5wnr"
Jul 15 15:35:49.317222 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:49.317196    2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 15 15:35:49.319222 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:49.319204    2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 15 15:35:49.319222 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:49.319217    2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-tlkwx\""
Jul 15 15:35:49.319389 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:49.319314    2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Jul 15 15:35:49.319462 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:49.319446    2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Jul 15 15:35:49.321459 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:49.321442    2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 15 15:35:49.323983 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:49.323962    2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Jul 15 15:35:49.324834 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:49.324814    2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-lbdlp"]
Jul 15 15:35:49.324986 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:49.324970    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cf856758c-sksmh"
Jul 15 15:35:49.327641 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:49.327624    2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Jul 15 15:35:49.327736 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:49.327668    2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Jul 15 15:35:49.328048 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:49.328031    2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-txrmq\""
Jul 15 15:35:49.357042 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:49.357015    2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-zkq4t"]
Jul 15 15:35:49.357247 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:49.357229    2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-xqhg4"]
Jul 15 15:35:49.357247 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:49.357256    2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-pxkjb"]
Jul 15 15:35:49.357460 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:49.357277    2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7497644dd6-r6f4x"]
Jul 15 15:35:49.357460 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:49.357298    2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7866497494-qcvqk"]
Jul 15 15:35:49.357460 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:49.357315    2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-d5wnr"]
Jul 15 15:35:49.357460 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:49.357334    2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-lbdlp"]
Jul 15 15:35:49.357460 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:49.357132    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-lbdlp"
Jul 15 15:35:49.357460 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:49.357373    2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-sksmh"]
Jul 15 15:35:49.357460 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:49.357396    2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-6b6d8f8b7b-mrtkd"]
Jul 15 15:35:49.361100 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:49.361013    2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-bl25x\""
Jul 15 15:35:49.361100 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:49.361057    2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 15 15:35:49.361273 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:49.361257    2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Jul 15 15:35:49.361359 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:49.361294    2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 15 15:35:49.362199 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:49.362182    2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Jul 15 15:35:49.381128 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:49.381107    2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-crgxn"]
Jul 15 15:35:49.381254 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:49.381236    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6b6d8f8b7b-mrtkd"
Jul 15 15:35:49.385890 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:49.385868    2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Jul 15 15:35:49.385992 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:49.385924    2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Jul 15 15:35:49.385992 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:49.385931    2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 15 15:35:49.386167 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:49.386150    2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Jul 15 15:35:49.386237 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:49.386211    2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Jul 15 15:35:49.386237 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:49.386221    2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-8d9bl\""
Jul 15 15:35:49.386459 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:49.386441    2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 15 15:35:49.395149 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:49.395125    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/dfd89595-3f0b-4bbb-b6c3-3adff5584228-installation-pull-secrets\") pod \"image-registry-7497644dd6-r6f4x\" (UID: \"dfd89595-3f0b-4bbb-b6c3-3adff5584228\") " pod="openshift-image-registry/image-registry-7497644dd6-r6f4x"
Jul 15 15:35:49.395237 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:49.395162    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rn9dt\" (UniqueName: \"kubernetes.io/projected/3d27b6dd-79a8-46a5-9295-7d359f472c6d-kube-api-access-rn9dt\") pod \"service-ca-operator-7695fc6c8c-xqhg4\" (UID: \"3d27b6dd-79a8-46a5-9295-7d359f472c6d\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-xqhg4"
Jul 15 15:35:49.395237 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:49.395186    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/dfd89595-3f0b-4bbb-b6c3-3adff5584228-trusted-ca\") pod \"image-registry-7497644dd6-r6f4x\" (UID: \"dfd89595-3f0b-4bbb-b6c3-3adff5584228\") " pod="openshift-image-registry/image-registry-7497644dd6-r6f4x"
Jul 15 15:35:49.395237 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:49.395213    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c6536c40-bac4-4b75-9914-aa2ff4363de8-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-d5wnr\" (UID: \"c6536c40-bac4-4b75-9914-aa2ff4363de8\") " pod="openshift-insights/insights-operator-68d9dd94cf-d5wnr"
Jul 15 15:35:49.395390 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:49.395280    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3d27b6dd-79a8-46a5-9295-7d359f472c6d-config\") pod \"service-ca-operator-7695fc6c8c-xqhg4\" (UID: \"3d27b6dd-79a8-46a5-9295-7d359f472c6d\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-xqhg4"
Jul 15 15:35:49.395390 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:49.395306    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/dfd89595-3f0b-4bbb-b6c3-3adff5584228-bound-sa-token\") pod \"image-registry-7497644dd6-r6f4x\" (UID: \"dfd89595-3f0b-4bbb-b6c3-3adff5584228\") " pod="openshift-image-registry/image-registry-7497644dd6-r6f4x"
Jul 15 15:35:49.395390 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:49.395326    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-76b58\" (UniqueName: \"kubernetes.io/projected/dfd89595-3f0b-4bbb-b6c3-3adff5584228-kube-api-access-76b58\") pod \"image-registry-7497644dd6-r6f4x\" (UID: \"dfd89595-3f0b-4bbb-b6c3-3adff5584228\") " pod="openshift-image-registry/image-registry-7497644dd6-r6f4x"
Jul 15 15:35:49.395390 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:49.395356    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c6536c40-bac4-4b75-9914-aa2ff4363de8-tmp\") pod \"insights-operator-68d9dd94cf-d5wnr\" (UID: \"c6536c40-bac4-4b75-9914-aa2ff4363de8\") " pod="openshift-insights/insights-operator-68d9dd94cf-d5wnr"
Jul 15 15:35:49.395390 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:49.395382    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/dfd89595-3f0b-4bbb-b6c3-3adff5584228-image-registry-private-configuration\") pod \"image-registry-7497644dd6-r6f4x\" (UID: \"dfd89595-3f0b-4bbb-b6c3-3adff5584228\") " pod="openshift-image-registry/image-registry-7497644dd6-r6f4x"
Jul 15 15:35:49.395568 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:49.395408    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/dfd89595-3f0b-4bbb-b6c3-3adff5584228-registry-tls\") pod \"image-registry-7497644dd6-r6f4x\" (UID: \"dfd89595-3f0b-4bbb-b6c3-3adff5584228\") " pod="openshift-image-registry/image-registry-7497644dd6-r6f4x"
Jul 15 15:35:49.395568 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:49.395431    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/c6536c40-bac4-4b75-9914-aa2ff4363de8-snapshots\") pod \"insights-operator-68d9dd94cf-d5wnr\" (UID: \"c6536c40-bac4-4b75-9914-aa2ff4363de8\") " pod="openshift-insights/insights-operator-68d9dd94cf-d5wnr"
Jul 15 15:35:49.395568 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:49.395456    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xstrn\" (UniqueName: \"kubernetes.io/projected/32207a22-c82a-4d3b-a044-aa9899bcdf2d-kube-api-access-xstrn\") pod \"kube-storage-version-migrator-operator-799cb7f958-pxkjb\" (UID: \"32207a22-c82a-4d3b-a044-aa9899bcdf2d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-pxkjb"
Jul 15 15:35:49.395568 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:49.395475    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c6536c40-bac4-4b75-9914-aa2ff4363de8-serving-cert\") pod \"insights-operator-68d9dd94cf-d5wnr\" (UID: \"c6536c40-bac4-4b75-9914-aa2ff4363de8\") " pod="openshift-insights/insights-operator-68d9dd94cf-d5wnr"
Jul 15 15:35:49.395568 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:49.395495    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/32207a22-c82a-4d3b-a044-aa9899bcdf2d-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-pxkjb\" (UID: \"32207a22-c82a-4d3b-a044-aa9899bcdf2d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-pxkjb"
Jul 15 15:35:49.395568 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:49.395517    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/dfd89595-3f0b-4bbb-b6c3-3adff5584228-ca-trust-extracted\") pod \"image-registry-7497644dd6-r6f4x\" (UID: \"dfd89595-3f0b-4bbb-b6c3-3adff5584228\") " pod="openshift-image-registry/image-registry-7497644dd6-r6f4x"
Jul 15 15:35:49.395770 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:49.395574    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/eb866034-d7d1-4bee-b8b7-616b355d371d-trusted-ca\") pod \"console-operator-7866497494-qcvqk\" (UID: \"eb866034-d7d1-4bee-b8b7-616b355d371d\") " pod="openshift-console-operator/console-operator-7866497494-qcvqk"
Jul 15 15:35:49.395770 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:49.395595    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3d27b6dd-79a8-46a5-9295-7d359f472c6d-serving-cert\") pod \"service-ca-operator-7695fc6c8c-xqhg4\" (UID: \"3d27b6dd-79a8-46a5-9295-7d359f472c6d\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-xqhg4"
Jul 15 15:35:49.395770 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:49.395611    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zltgb\" (UniqueName: \"kubernetes.io/projected/c6536c40-bac4-4b75-9914-aa2ff4363de8-kube-api-access-zltgb\") pod \"insights-operator-68d9dd94cf-d5wnr\" (UID: \"c6536c40-bac4-4b75-9914-aa2ff4363de8\") " pod="openshift-insights/insights-operator-68d9dd94cf-d5wnr"
Jul 15 15:35:49.395770 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:49.395646    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/2e7ce623-e580-4213-a1fd-87e6fe2f2dfa-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-zkq4t\" (UID: \"2e7ce623-e580-4213-a1fd-87e6fe2f2dfa\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-zkq4t"
Jul 15 15:35:49.395770 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:49.395670    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/eb866034-d7d1-4bee-b8b7-616b355d371d-config\") pod \"console-operator-7866497494-qcvqk\" (UID: \"eb866034-d7d1-4bee-b8b7-616b355d371d\") " pod="openshift-console-operator/console-operator-7866497494-qcvqk"
Jul 15 15:35:49.395770 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:49.395694    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/dfd89595-3f0b-4bbb-b6c3-3adff5584228-registry-certificates\") pod \"image-registry-7497644dd6-r6f4x\" (UID: \"dfd89595-3f0b-4bbb-b6c3-3adff5584228\") " pod="openshift-image-registry/image-registry-7497644dd6-r6f4x"
Jul 15 15:35:49.395770 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:49.395719    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c6536c40-bac4-4b75-9914-aa2ff4363de8-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-d5wnr\" (UID: \"c6536c40-bac4-4b75-9914-aa2ff4363de8\") " pod="openshift-insights/insights-operator-68d9dd94cf-d5wnr"
Jul 15 15:35:49.395770 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:49.395737    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/eb866034-d7d1-4bee-b8b7-616b355d371d-serving-cert\") pod \"console-operator-7866497494-qcvqk\" (UID: \"eb866034-d7d1-4bee-b8b7-616b355d371d\") " pod="openshift-console-operator/console-operator-7866497494-qcvqk"
Jul 15 15:35:49.395770 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:49.395764    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l66jp\" (UniqueName: \"kubernetes.io/projected/eb866034-d7d1-4bee-b8b7-616b355d371d-kube-api-access-l66jp\") pod \"console-operator-7866497494-qcvqk\" (UID: \"eb866034-d7d1-4bee-b8b7-616b355d371d\") " pod="openshift-console-operator/console-operator-7866497494-qcvqk"
Jul 15 15:35:49.396043 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:49.395801    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rxszk\" (UniqueName: \"kubernetes.io/projected/1e467c41-9552-498c-92b7-6bed182b4c7a-kube-api-access-rxszk\") pod \"volume-data-source-validator-78495597f6-ntx28\" (UID: \"1e467c41-9552-498c-92b7-6bed182b4c7a\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-ntx28"
Jul 15 15:35:49.396043 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:49.395843    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/32207a22-c82a-4d3b-a044-aa9899bcdf2d-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-pxkjb\" (UID: \"32207a22-c82a-4d3b-a044-aa9899bcdf2d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-pxkjb"
Jul 15 15:35:49.396043 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:49.395862    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5xhbv\" (UniqueName: \"kubernetes.io/projected/2e7ce623-e580-4213-a1fd-87e6fe2f2dfa-kube-api-access-5xhbv\") pod \"cluster-samples-operator-65db858894-zkq4t\" (UID: \"2e7ce623-e580-4213-a1fd-87e6fe2f2dfa\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-zkq4t"
Jul 15 15:35:49.401129 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:49.401111    2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-cbhd5"]
Jul 15 15:35:49.401255 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:49.401239    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-crgxn"
Jul 15 15:35:49.404331 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:49.404316    2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 15 15:35:49.404652 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:49.404633    2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 15 15:35:49.404746 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:49.404709    2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-lflgd\""
Jul 15 15:35:49.421519 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:49.421499    2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-crgxn"]
Jul 15 15:35:49.421615 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:49.421531    2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-cbhd5"]
Jul 15 15:35:49.421615 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:49.421558    2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6b6d8f8b7b-mrtkd"]
Jul 15 15:35:49.421615 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:49.421606    2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-btdcp"]
Jul 15 15:35:49.421754 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:49.421657    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-cbhd5"
Jul 15 15:35:49.426223 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:49.426203    2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 15 15:35:49.426391 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:49.426375    2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 15 15:35:49.426468 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:49.426459    2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-qwxrd\""
Jul 15 15:35:49.426578 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:49.426563    2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 15 15:35:49.445512 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:49.445480    2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-btdcp"]
Jul 15 15:35:49.445620 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:49.445590    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-btdcp"
Jul 15 15:35:49.449287 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:49.449266    2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 15 15:35:49.449405 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:49.449302    2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 15 15:35:49.449405 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:49.449389    2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-dq8c7\""
Jul 15 15:35:49.496421 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:49.496395    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5xhbv\" (UniqueName: \"kubernetes.io/projected/2e7ce623-e580-4213-a1fd-87e6fe2f2dfa-kube-api-access-5xhbv\") pod \"cluster-samples-operator-65db858894-zkq4t\" (UID: \"2e7ce623-e580-4213-a1fd-87e6fe2f2dfa\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-zkq4t"
Jul 15 15:35:49.496565 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:49.496430    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/c80ed5cd-4b7c-4981-95c6-a02cf058f709-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-lbdlp\" (UID: \"c80ed5cd-4b7c-4981-95c6-a02cf058f709\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-lbdlp"
Jul 15 15:35:49.496565 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:49.496452    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/7f8686f6-7e33-4c8e-91fe-d5fabf84906a-stats-auth\") pod \"router-default-6b6d8f8b7b-mrtkd\" (UID: \"7f8686f6-7e33-4c8e-91fe-d5fabf84906a\") " pod="openshift-ingress/router-default-6b6d8f8b7b-mrtkd"
Jul 15 15:35:49.496565 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:49.496478    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/dfd89595-3f0b-4bbb-b6c3-3adff5584228-installation-pull-secrets\") pod \"image-registry-7497644dd6-r6f4x\" (UID: \"dfd89595-3f0b-4bbb-b6c3-3adff5584228\") " pod="openshift-image-registry/image-registry-7497644dd6-r6f4x"
Jul 15 15:35:49.496565 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:49.496521    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/7f8686f6-7e33-4c8e-91fe-d5fabf84906a-default-certificate\") pod \"router-default-6b6d8f8b7b-mrtkd\" (UID: \"7f8686f6-7e33-4c8e-91fe-d5fabf84906a\") " pod="openshift-ingress/router-default-6b6d8f8b7b-mrtkd"
Jul 15 15:35:49.496756 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:49.496674    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rn9dt\" (UniqueName: \"kubernetes.io/projected/3d27b6dd-79a8-46a5-9295-7d359f472c6d-kube-api-access-rn9dt\") pod \"service-ca-operator-7695fc6c8c-xqhg4\" (UID: \"3d27b6dd-79a8-46a5-9295-7d359f472c6d\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-xqhg4"
Jul 15 15:35:49.496756 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:49.496708    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5ae097ff-d3b5-4962-afef-f78b9b65ccaa-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-sksmh\" (UID: \"5ae097ff-d3b5-4962-afef-f78b9b65ccaa\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-sksmh"
Jul 15 15:35:49.496756 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:49.496743    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/dfd89595-3f0b-4bbb-b6c3-3adff5584228-trusted-ca\") pod \"image-registry-7497644dd6-r6f4x\" (UID: \"dfd89595-3f0b-4bbb-b6c3-3adff5584228\") " pod="openshift-image-registry/image-registry-7497644dd6-r6f4x"
Jul 15 15:35:49.496890 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:49.496773    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c6536c40-bac4-4b75-9914-aa2ff4363de8-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-d5wnr\" (UID: \"c6536c40-bac4-4b75-9914-aa2ff4363de8\") " pod="openshift-insights/insights-operator-68d9dd94cf-d5wnr"
Jul 15 15:35:49.496890 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:49.496812    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3d27b6dd-79a8-46a5-9295-7d359f472c6d-config\") pod \"service-ca-operator-7695fc6c8c-xqhg4\" (UID: \"3d27b6dd-79a8-46a5-9295-7d359f472c6d\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-xqhg4"
Jul 15 15:35:49.496890 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:49.496836    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/dfd89595-3f0b-4bbb-b6c3-3adff5584228-bound-sa-token\") pod \"image-registry-7497644dd6-r6f4x\" (UID: \"dfd89595-3f0b-4bbb-b6c3-3adff5584228\") " pod="openshift-image-registry/image-registry-7497644dd6-r6f4x"
Jul 15 15:35:49.496890 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:49.496865    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-76b58\" (UniqueName: \"kubernetes.io/projected/dfd89595-3f0b-4bbb-b6c3-3adff5584228-kube-api-access-76b58\") pod \"image-registry-7497644dd6-r6f4x\" (UID: \"dfd89595-3f0b-4bbb-b6c3-3adff5584228\") " pod="openshift-image-registry/image-registry-7497644dd6-r6f4x"
Jul 15 15:35:49.497080 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:49.496889    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c6536c40-bac4-4b75-9914-aa2ff4363de8-tmp\") pod \"insights-operator-68d9dd94cf-d5wnr\" (UID: \"c6536c40-bac4-4b75-9914-aa2ff4363de8\") " pod="openshift-insights/insights-operator-68d9dd94cf-d5wnr"
Jul 15 15:35:49.497080 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:49.496916    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/dfd89595-3f0b-4bbb-b6c3-3adff5584228-image-registry-private-configuration\") pod \"image-registry-7497644dd6-r6f4x\" (UID: \"dfd89595-3f0b-4bbb-b6c3-3adff5584228\") " pod="openshift-image-registry/image-registry-7497644dd6-r6f4x"
Jul 15 15:35:49.497080 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:49.496942    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/dfd89595-3f0b-4bbb-b6c3-3adff5584228-registry-tls\") pod \"image-registry-7497644dd6-r6f4x\" (UID: \"dfd89595-3f0b-4bbb-b6c3-3adff5584228\") " pod="openshift-image-registry/image-registry-7497644dd6-r6f4x"
Jul 15 15:35:49.497080 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:49.496968    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/c6536c40-bac4-4b75-9914-aa2ff4363de8-snapshots\") pod \"insights-operator-68d9dd94cf-d5wnr\" (UID: \"c6536c40-bac4-4b75-9914-aa2ff4363de8\") " pod="openshift-insights/insights-operator-68d9dd94cf-d5wnr"
Jul 15 15:35:49.497080 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:49.496992    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/5ae097ff-d3b5-4962-afef-f78b9b65ccaa-nginx-conf\") pod \"networking-console-plugin-6cf856758c-sksmh\" (UID: \"5ae097ff-d3b5-4962-afef-f78b9b65ccaa\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-sksmh"
Jul 15 15:35:49.497080 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:49.497017    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-klkld\" (UniqueName: \"kubernetes.io/projected/7f8686f6-7e33-4c8e-91fe-d5fabf84906a-kube-api-access-klkld\") pod \"router-default-6b6d8f8b7b-mrtkd\" (UID: \"7f8686f6-7e33-4c8e-91fe-d5fabf84906a\") " pod="openshift-ingress/router-default-6b6d8f8b7b-mrtkd"
Jul 15 15:35:49.497080 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:49.497047    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xstrn\" (UniqueName: \"kubernetes.io/projected/32207a22-c82a-4d3b-a044-aa9899bcdf2d-kube-api-access-xstrn\") pod \"kube-storage-version-migrator-operator-799cb7f958-pxkjb\" (UID: \"32207a22-c82a-4d3b-a044-aa9899bcdf2d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-pxkjb"
Jul 15 15:35:49.497080 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:49.497073    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c6536c40-bac4-4b75-9914-aa2ff4363de8-serving-cert\") pod \"insights-operator-68d9dd94cf-d5wnr\" (UID: \"c6536c40-bac4-4b75-9914-aa2ff4363de8\") " pod="openshift-insights/insights-operator-68d9dd94cf-d5wnr"
Jul 15 15:35:49.497462 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:49.497109    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/32207a22-c82a-4d3b-a044-aa9899bcdf2d-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-pxkjb\" (UID: \"32207a22-c82a-4d3b-a044-aa9899bcdf2d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-pxkjb"
Jul 15 15:35:49.497462 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:49.497133    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/dfd89595-3f0b-4bbb-b6c3-3adff5584228-ca-trust-extracted\") pod \"image-registry-7497644dd6-r6f4x\" (UID: \"dfd89595-3f0b-4bbb-b6c3-3adff5584228\") " pod="openshift-image-registry/image-registry-7497644dd6-r6f4x"
Jul 15 15:35:49.497462 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:49.497176    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/eb866034-d7d1-4bee-b8b7-616b355d371d-trusted-ca\") pod \"console-operator-7866497494-qcvqk\" (UID: \"eb866034-d7d1-4bee-b8b7-616b355d371d\") " pod="openshift-console-operator/console-operator-7866497494-qcvqk"
Jul 15 15:35:49.497462 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:49.497204    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3d27b6dd-79a8-46a5-9295-7d359f472c6d-serving-cert\") pod \"service-ca-operator-7695fc6c8c-xqhg4\" (UID: \"3d27b6dd-79a8-46a5-9295-7d359f472c6d\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-xqhg4"
Jul 15 15:35:49.497462 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:49.497228    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zltgb\" (UniqueName: \"kubernetes.io/projected/c6536c40-bac4-4b75-9914-aa2ff4363de8-kube-api-access-zltgb\") pod \"insights-operator-68d9dd94cf-d5wnr\" (UID: \"c6536c40-bac4-4b75-9914-aa2ff4363de8\") " pod="openshift-insights/insights-operator-68d9dd94cf-d5wnr"
Jul 15 15:35:49.497462 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:49.497251    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7f8686f6-7e33-4c8e-91fe-d5fabf84906a-service-ca-bundle\") pod \"router-default-6b6d8f8b7b-mrtkd\" (UID: \"7f8686f6-7e33-4c8e-91fe-d5fabf84906a\") " pod="openshift-ingress/router-default-6b6d8f8b7b-mrtkd"
Jul 15 15:35:49.497462 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:49.497294    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/2e7ce623-e580-4213-a1fd-87e6fe2f2dfa-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-zkq4t\" (UID: \"2e7ce623-e580-4213-a1fd-87e6fe2f2dfa\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-zkq4t"
Jul 15 15:35:49.497462 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:49.497318    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/eb866034-d7d1-4bee-b8b7-616b355d371d-config\") pod \"console-operator-7866497494-qcvqk\" (UID: \"eb866034-d7d1-4bee-b8b7-616b355d371d\") " pod="openshift-console-operator/console-operator-7866497494-qcvqk"
Jul 15 15:35:49.497462 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:49.497366    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/dfd89595-3f0b-4bbb-b6c3-3adff5584228-registry-certificates\") pod \"image-registry-7497644dd6-r6f4x\" (UID: \"dfd89595-3f0b-4bbb-b6c3-3adff5584228\") " pod="openshift-image-registry/image-registry-7497644dd6-r6f4x"
Jul 15 15:35:49.497462 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:49.497430    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3d27b6dd-79a8-46a5-9295-7d359f472c6d-config\") pod \"service-ca-operator-7695fc6c8c-xqhg4\" (UID: \"3d27b6dd-79a8-46a5-9295-7d359f472c6d\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-xqhg4"
Jul 15 15:35:49.497908 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:49.497752    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/dfd89595-3f0b-4bbb-b6c3-3adff5584228-trusted-ca\") pod \"image-registry-7497644dd6-r6f4x\" (UID: \"dfd89595-3f0b-4bbb-b6c3-3adff5584228\") " pod="openshift-image-registry/image-registry-7497644dd6-r6f4x"
Jul 15 15:35:49.497908 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:49.497814    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c6536c40-bac4-4b75-9914-aa2ff4363de8-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-d5wnr\" (UID: \"c6536c40-bac4-4b75-9914-aa2ff4363de8\") " pod="openshift-insights/insights-operator-68d9dd94cf-d5wnr"
Jul 15 15:35:49.497908 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:49.497841    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/eb866034-d7d1-4bee-b8b7-616b355d371d-serving-cert\") pod \"console-operator-7866497494-qcvqk\" (UID: \"eb866034-d7d1-4bee-b8b7-616b355d371d\") " pod="openshift-console-operator/console-operator-7866497494-qcvqk"
Jul 15 15:35:49.497908 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:49.497866    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l66jp\" (UniqueName: \"kubernetes.io/projected/eb866034-d7d1-4bee-b8b7-616b355d371d-kube-api-access-l66jp\") pod \"console-operator-7866497494-qcvqk\" (UID: \"eb866034-d7d1-4bee-b8b7-616b355d371d\") " pod="openshift-console-operator/console-operator-7866497494-qcvqk"
Jul 15 15:35:49.497908 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:49.497887    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/dfd89595-3f0b-4bbb-b6c3-3adff5584228-registry-certificates\") pod \"image-registry-7497644dd6-r6f4x\" (UID: \"dfd89595-3f0b-4bbb-b6c3-3adff5584228\") " pod="openshift-image-registry/image-registry-7497644dd6-r6f4x"
Jul 15 15:35:49.497908 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:49.497899    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rxszk\" (UniqueName: \"kubernetes.io/projected/1e467c41-9552-498c-92b7-6bed182b4c7a-kube-api-access-rxszk\") pod \"volume-data-source-validator-78495597f6-ntx28\" (UID: \"1e467c41-9552-498c-92b7-6bed182b4c7a\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-ntx28"
Jul 15 15:35:49.498210 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:49.497938    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v9snb\" (UniqueName: \"kubernetes.io/projected/91470f33-4aad-469b-abc5-615603d650b6-kube-api-access-v9snb\") pod \"network-check-source-869dcfcdcd-crgxn\" (UID: \"91470f33-4aad-469b-abc5-615603d650b6\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-crgxn"
Jul 15 15:35:49.498210 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:49.497969    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/c80ed5cd-4b7c-4981-95c6-a02cf058f709-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-lbdlp\" (UID: \"c80ed5cd-4b7c-4981-95c6-a02cf058f709\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-lbdlp"
Jul 15 15:35:49.498210 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:49.498001    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jh54n\" (UniqueName: \"kubernetes.io/projected/c80ed5cd-4b7c-4981-95c6-a02cf058f709-kube-api-access-jh54n\") pod \"cluster-monitoring-operator-5f7f494dd4-lbdlp\" (UID: \"c80ed5cd-4b7c-4981-95c6-a02cf058f709\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-lbdlp"
Jul 15 15:35:49.498210 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:49.498042    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/32207a22-c82a-4d3b-a044-aa9899bcdf2d-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-pxkjb\" (UID: \"32207a22-c82a-4d3b-a044-aa9899bcdf2d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-pxkjb"
Jul 15 15:35:49.498210 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:49.498069    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7f8686f6-7e33-4c8e-91fe-d5fabf84906a-metrics-certs\") pod \"router-default-6b6d8f8b7b-mrtkd\" (UID: \"7f8686f6-7e33-4c8e-91fe-d5fabf84906a\") " pod="openshift-ingress/router-default-6b6d8f8b7b-mrtkd"
Jul 15 15:35:49.498210 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:49.498185    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/c6536c40-bac4-4b75-9914-aa2ff4363de8-snapshots\") pod \"insights-operator-68d9dd94cf-d5wnr\" (UID: \"c6536c40-bac4-4b75-9914-aa2ff4363de8\") " pod="openshift-insights/insights-operator-68d9dd94cf-d5wnr"
Jul 15 15:35:49.498527 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:49.498229    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/eb866034-d7d1-4bee-b8b7-616b355d371d-trusted-ca\") pod \"console-operator-7866497494-qcvqk\" (UID: \"eb866034-d7d1-4bee-b8b7-616b355d371d\") " pod="openshift-console-operator/console-operator-7866497494-qcvqk"
Jul 15 15:35:49.498527 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:49.498504    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c6536c40-bac4-4b75-9914-aa2ff4363de8-tmp\") pod \"insights-operator-68d9dd94cf-d5wnr\" (UID: \"c6536c40-bac4-4b75-9914-aa2ff4363de8\") " pod="openshift-insights/insights-operator-68d9dd94cf-d5wnr"
Jul 15 15:35:49.498527 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:35:49.498524    2588 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 15 15:35:49.498637 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:35:49.498539    2588 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7497644dd6-r6f4x: secret "image-registry-tls" not found
Jul 15 15:35:49.498637 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:35:49.498596    2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dfd89595-3f0b-4bbb-b6c3-3adff5584228-registry-tls podName:dfd89595-3f0b-4bbb-b6c3-3adff5584228 nodeName:}" failed. No retries permitted until 2026-07-15 15:35:49.998579698 +0000 UTC m=+35.650645458 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/dfd89595-3f0b-4bbb-b6c3-3adff5584228-registry-tls") pod "image-registry-7497644dd6-r6f4x" (UID: "dfd89595-3f0b-4bbb-b6c3-3adff5584228") : secret "image-registry-tls" not found
Jul 15 15:35:49.498800 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:35:49.498521    2588 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 15 15:35:49.498875 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:35:49.498838    2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e7ce623-e580-4213-a1fd-87e6fe2f2dfa-samples-operator-tls podName:2e7ce623-e580-4213-a1fd-87e6fe2f2dfa nodeName:}" failed. No retries permitted until 2026-07-15 15:35:49.998821217 +0000 UTC m=+35.650886964 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/2e7ce623-e580-4213-a1fd-87e6fe2f2dfa-samples-operator-tls") pod "cluster-samples-operator-65db858894-zkq4t" (UID: "2e7ce623-e580-4213-a1fd-87e6fe2f2dfa") : secret "samples-operator-tls" not found
Jul 15 15:35:49.500953 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:49.499260    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/32207a22-c82a-4d3b-a044-aa9899bcdf2d-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-pxkjb\" (UID: \"32207a22-c82a-4d3b-a044-aa9899bcdf2d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-pxkjb"
Jul 15 15:35:49.500953 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:49.499380    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/dfd89595-3f0b-4bbb-b6c3-3adff5584228-ca-trust-extracted\") pod \"image-registry-7497644dd6-r6f4x\" (UID: \"dfd89595-3f0b-4bbb-b6c3-3adff5584228\") " pod="openshift-image-registry/image-registry-7497644dd6-r6f4x"
Jul 15 15:35:49.500953 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:49.499960    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c6536c40-bac4-4b75-9914-aa2ff4363de8-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-d5wnr\" (UID: \"c6536c40-bac4-4b75-9914-aa2ff4363de8\") " pod="openshift-insights/insights-operator-68d9dd94cf-d5wnr"
Jul 15 15:35:49.500953 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:49.499981    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/eb866034-d7d1-4bee-b8b7-616b355d371d-config\") pod \"console-operator-7866497494-qcvqk\" (UID: \"eb866034-d7d1-4bee-b8b7-616b355d371d\") " pod="openshift-console-operator/console-operator-7866497494-qcvqk"
Jul 15 15:35:49.502324 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:49.502086    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3d27b6dd-79a8-46a5-9295-7d359f472c6d-serving-cert\") pod \"service-ca-operator-7695fc6c8c-xqhg4\" (UID: \"3d27b6dd-79a8-46a5-9295-7d359f472c6d\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-xqhg4"
Jul 15 15:35:49.502324 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:49.502097    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/32207a22-c82a-4d3b-a044-aa9899bcdf2d-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-pxkjb\" (UID: \"32207a22-c82a-4d3b-a044-aa9899bcdf2d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-pxkjb"
Jul 15 15:35:49.502324 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:49.502219    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/dfd89595-3f0b-4bbb-b6c3-3adff5584228-installation-pull-secrets\") pod \"image-registry-7497644dd6-r6f4x\" (UID: \"dfd89595-3f0b-4bbb-b6c3-3adff5584228\") " pod="openshift-image-registry/image-registry-7497644dd6-r6f4x"
Jul 15 15:35:49.502629 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:49.502599    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/dfd89595-3f0b-4bbb-b6c3-3adff5584228-image-registry-private-configuration\") pod \"image-registry-7497644dd6-r6f4x\" (UID: \"dfd89595-3f0b-4bbb-b6c3-3adff5584228\") " pod="openshift-image-registry/image-registry-7497644dd6-r6f4x"
Jul 15 15:35:49.502884 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:49.502865    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c6536c40-bac4-4b75-9914-aa2ff4363de8-serving-cert\") pod \"insights-operator-68d9dd94cf-d5wnr\" (UID: \"c6536c40-bac4-4b75-9914-aa2ff4363de8\") " pod="openshift-insights/insights-operator-68d9dd94cf-d5wnr"
Jul 15 15:35:49.503451 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:49.503417    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/eb866034-d7d1-4bee-b8b7-616b355d371d-serving-cert\") pod \"console-operator-7866497494-qcvqk\" (UID: \"eb866034-d7d1-4bee-b8b7-616b355d371d\") " pod="openshift-console-operator/console-operator-7866497494-qcvqk"
Jul 15 15:35:49.507886 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:49.507858    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c6536c40-bac4-4b75-9914-aa2ff4363de8-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-d5wnr\" (UID: \"c6536c40-bac4-4b75-9914-aa2ff4363de8\") " pod="openshift-insights/insights-operator-68d9dd94cf-d5wnr"
Jul 15 15:35:49.508950 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:49.508927    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rxszk\" (UniqueName: \"kubernetes.io/projected/1e467c41-9552-498c-92b7-6bed182b4c7a-kube-api-access-rxszk\") pod \"volume-data-source-validator-78495597f6-ntx28\" (UID: \"1e467c41-9552-498c-92b7-6bed182b4c7a\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-ntx28"
Jul 15 15:35:49.509303 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:49.509236    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-76b58\" (UniqueName: \"kubernetes.io/projected/dfd89595-3f0b-4bbb-b6c3-3adff5584228-kube-api-access-76b58\") pod \"image-registry-7497644dd6-r6f4x\" (UID: \"dfd89595-3f0b-4bbb-b6c3-3adff5584228\") " pod="openshift-image-registry/image-registry-7497644dd6-r6f4x"
Jul 15 15:35:49.509691 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:49.509642    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zltgb\" (UniqueName: \"kubernetes.io/projected/c6536c40-bac4-4b75-9914-aa2ff4363de8-kube-api-access-zltgb\") pod \"insights-operator-68d9dd94cf-d5wnr\" (UID: \"c6536c40-bac4-4b75-9914-aa2ff4363de8\") " pod="openshift-insights/insights-operator-68d9dd94cf-d5wnr"
Jul 15 15:35:49.509979 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:49.509929    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rn9dt\" (UniqueName: \"kubernetes.io/projected/3d27b6dd-79a8-46a5-9295-7d359f472c6d-kube-api-access-rn9dt\") pod \"service-ca-operator-7695fc6c8c-xqhg4\" (UID: \"3d27b6dd-79a8-46a5-9295-7d359f472c6d\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-xqhg4"
Jul 15 15:35:49.511054 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:49.510932    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/dfd89595-3f0b-4bbb-b6c3-3adff5584228-bound-sa-token\") pod \"image-registry-7497644dd6-r6f4x\" (UID: \"dfd89595-3f0b-4bbb-b6c3-3adff5584228\") " pod="openshift-image-registry/image-registry-7497644dd6-r6f4x"
Jul 15 15:35:49.511794 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:49.511769    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xstrn\" (UniqueName: \"kubernetes.io/projected/32207a22-c82a-4d3b-a044-aa9899bcdf2d-kube-api-access-xstrn\") pod \"kube-storage-version-migrator-operator-799cb7f958-pxkjb\" (UID: \"32207a22-c82a-4d3b-a044-aa9899bcdf2d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-pxkjb"
Jul 15 15:35:49.512036 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:49.511985    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l66jp\" (UniqueName: \"kubernetes.io/projected/eb866034-d7d1-4bee-b8b7-616b355d371d-kube-api-access-l66jp\") pod \"console-operator-7866497494-qcvqk\" (UID: \"eb866034-d7d1-4bee-b8b7-616b355d371d\") " pod="openshift-console-operator/console-operator-7866497494-qcvqk"
Jul 15 15:35:49.520141 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:49.520114    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5xhbv\" (UniqueName: \"kubernetes.io/projected/2e7ce623-e580-4213-a1fd-87e6fe2f2dfa-kube-api-access-5xhbv\") pod \"cluster-samples-operator-65db858894-zkq4t\" (UID: \"2e7ce623-e580-4213-a1fd-87e6fe2f2dfa\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-zkq4t"
Jul 15 15:35:49.550890 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:49.550836    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-ntx28"
Jul 15 15:35:49.561040 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:49.561018    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-xqhg4"
Jul 15 15:35:49.569157 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:49.569137    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-pxkjb"
Jul 15 15:35:49.592714 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:49.592691    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7866497494-qcvqk"
Jul 15 15:35:49.599237 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:49.599214    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7f8686f6-7e33-4c8e-91fe-d5fabf84906a-service-ca-bundle\") pod \"router-default-6b6d8f8b7b-mrtkd\" (UID: \"7f8686f6-7e33-4c8e-91fe-d5fabf84906a\") " pod="openshift-ingress/router-default-6b6d8f8b7b-mrtkd"
Jul 15 15:35:49.599331 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:49.599296    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v9snb\" (UniqueName: \"kubernetes.io/projected/91470f33-4aad-469b-abc5-615603d650b6-kube-api-access-v9snb\") pod \"network-check-source-869dcfcdcd-crgxn\" (UID: \"91470f33-4aad-469b-abc5-615603d650b6\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-crgxn"
Jul 15 15:35:49.599416 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:49.599327    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/c80ed5cd-4b7c-4981-95c6-a02cf058f709-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-lbdlp\" (UID: \"c80ed5cd-4b7c-4981-95c6-a02cf058f709\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-lbdlp"
Jul 15 15:35:49.599416 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:35:49.599373    2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7f8686f6-7e33-4c8e-91fe-d5fabf84906a-service-ca-bundle podName:7f8686f6-7e33-4c8e-91fe-d5fabf84906a nodeName:}" failed. No retries permitted until 2026-07-15 15:35:50.09932985 +0000 UTC m=+35.751395591 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/7f8686f6-7e33-4c8e-91fe-d5fabf84906a-service-ca-bundle") pod "router-default-6b6d8f8b7b-mrtkd" (UID: "7f8686f6-7e33-4c8e-91fe-d5fabf84906a") : configmap references non-existent config key: service-ca.crt
Jul 15 15:35:49.599523 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:49.599417    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jh54n\" (UniqueName: \"kubernetes.io/projected/c80ed5cd-4b7c-4981-95c6-a02cf058f709-kube-api-access-jh54n\") pod \"cluster-monitoring-operator-5f7f494dd4-lbdlp\" (UID: \"c80ed5cd-4b7c-4981-95c6-a02cf058f709\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-lbdlp"
Jul 15 15:35:49.599523 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:49.599451    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7f8686f6-7e33-4c8e-91fe-d5fabf84906a-metrics-certs\") pod \"router-default-6b6d8f8b7b-mrtkd\" (UID: \"7f8686f6-7e33-4c8e-91fe-d5fabf84906a\") " pod="openshift-ingress/router-default-6b6d8f8b7b-mrtkd"
Jul 15 15:35:49.599610 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:35:49.599529    2588 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 15 15:35:49.599610 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:35:49.599563    2588 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 15 15:35:49.599610 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:35:49.599570    2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f8686f6-7e33-4c8e-91fe-d5fabf84906a-metrics-certs podName:7f8686f6-7e33-4c8e-91fe-d5fabf84906a nodeName:}" failed. No retries permitted until 2026-07-15 15:35:50.099556701 +0000 UTC m=+35.751622450 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7f8686f6-7e33-4c8e-91fe-d5fabf84906a-metrics-certs") pod "router-default-6b6d8f8b7b-mrtkd" (UID: "7f8686f6-7e33-4c8e-91fe-d5fabf84906a") : secret "router-metrics-certs-default" not found
Jul 15 15:35:49.599753 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:35:49.599634    2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c80ed5cd-4b7c-4981-95c6-a02cf058f709-cluster-monitoring-operator-tls podName:c80ed5cd-4b7c-4981-95c6-a02cf058f709 nodeName:}" failed. No retries permitted until 2026-07-15 15:35:50.099615547 +0000 UTC m=+35.751681284 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/c80ed5cd-4b7c-4981-95c6-a02cf058f709-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-lbdlp" (UID: "c80ed5cd-4b7c-4981-95c6-a02cf058f709") : secret "cluster-monitoring-operator-tls" not found
Jul 15 15:35:49.599753 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:49.599654    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3856ae8d-74b3-4640-ac17-8800509097a6-tmp-dir\") pod \"dns-default-btdcp\" (UID: \"3856ae8d-74b3-4640-ac17-8800509097a6\") " pod="openshift-dns/dns-default-btdcp"
Jul 15 15:35:49.599753 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:49.599684    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/c80ed5cd-4b7c-4981-95c6-a02cf058f709-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-lbdlp\" (UID: \"c80ed5cd-4b7c-4981-95c6-a02cf058f709\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-lbdlp"
Jul 15 15:35:49.599753 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:49.599708    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/7f8686f6-7e33-4c8e-91fe-d5fabf84906a-stats-auth\") pod \"router-default-6b6d8f8b7b-mrtkd\" (UID: \"7f8686f6-7e33-4c8e-91fe-d5fabf84906a\") " pod="openshift-ingress/router-default-6b6d8f8b7b-mrtkd"
Jul 15 15:35:49.599753 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:49.599736    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-25j48\" (UniqueName: \"kubernetes.io/projected/ca4f5583-9d02-45e0-ab0a-aac9fc70bd71-kube-api-access-25j48\") pod \"ingress-canary-cbhd5\" (UID: \"ca4f5583-9d02-45e0-ab0a-aac9fc70bd71\") " pod="openshift-ingress-canary/ingress-canary-cbhd5"
Jul 15 15:35:49.599953 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:49.599764    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/7f8686f6-7e33-4c8e-91fe-d5fabf84906a-default-certificate\") pod \"router-default-6b6d8f8b7b-mrtkd\" (UID: \"7f8686f6-7e33-4c8e-91fe-d5fabf84906a\") " pod="openshift-ingress/router-default-6b6d8f8b7b-mrtkd"
Jul 15 15:35:49.599953 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:49.599787    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ca4f5583-9d02-45e0-ab0a-aac9fc70bd71-cert\") pod \"ingress-canary-cbhd5\" (UID: \"ca4f5583-9d02-45e0-ab0a-aac9fc70bd71\") " pod="openshift-ingress-canary/ingress-canary-cbhd5"
Jul 15 15:35:49.599953 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:49.599825    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5ae097ff-d3b5-4962-afef-f78b9b65ccaa-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-sksmh\" (UID: \"5ae097ff-d3b5-4962-afef-f78b9b65ccaa\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-sksmh"
Jul 15 15:35:49.599953 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:49.599860    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3856ae8d-74b3-4640-ac17-8800509097a6-metrics-tls\") pod \"dns-default-btdcp\" (UID: \"3856ae8d-74b3-4640-ac17-8800509097a6\") " pod="openshift-dns/dns-default-btdcp"
Jul 15 15:35:49.599953 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:49.599910    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t6hk9\" (UniqueName: \"kubernetes.io/projected/3856ae8d-74b3-4640-ac17-8800509097a6-kube-api-access-t6hk9\") pod \"dns-default-btdcp\" (UID: \"3856ae8d-74b3-4640-ac17-8800509097a6\") " pod="openshift-dns/dns-default-btdcp"
Jul 15 15:35:49.599953 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:49.599949    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/5ae097ff-d3b5-4962-afef-f78b9b65ccaa-nginx-conf\") pod \"networking-console-plugin-6cf856758c-sksmh\" (UID: \"5ae097ff-d3b5-4962-afef-f78b9b65ccaa\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-sksmh"
Jul 15 15:35:49.600179 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:49.599976    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-klkld\" (UniqueName: \"kubernetes.io/projected/7f8686f6-7e33-4c8e-91fe-d5fabf84906a-kube-api-access-klkld\") pod \"router-default-6b6d8f8b7b-mrtkd\" (UID: \"7f8686f6-7e33-4c8e-91fe-d5fabf84906a\") " pod="openshift-ingress/router-default-6b6d8f8b7b-mrtkd"
Jul 15 15:35:49.600179 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:49.600005    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3856ae8d-74b3-4640-ac17-8800509097a6-config-volume\") pod \"dns-default-btdcp\" (UID: \"3856ae8d-74b3-4640-ac17-8800509097a6\") " pod="openshift-dns/dns-default-btdcp"
Jul 15 15:35:49.600378 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:35:49.600358    2588 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 15 15:35:49.600378 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:49.600368    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/c80ed5cd-4b7c-4981-95c6-a02cf058f709-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-lbdlp\" (UID: \"c80ed5cd-4b7c-4981-95c6-a02cf058f709\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-lbdlp"
Jul 15 15:35:49.600484 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:35:49.600450    2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5ae097ff-d3b5-4962-afef-f78b9b65ccaa-networking-console-plugin-cert podName:5ae097ff-d3b5-4962-afef-f78b9b65ccaa nodeName:}" failed. No retries permitted until 2026-07-15 15:35:50.100397449 +0000 UTC m=+35.752463196 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/5ae097ff-d3b5-4962-afef-f78b9b65ccaa-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-sksmh" (UID: "5ae097ff-d3b5-4962-afef-f78b9b65ccaa") : secret "networking-console-plugin-cert" not found
Jul 15 15:35:49.600874 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:49.600842    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/5ae097ff-d3b5-4962-afef-f78b9b65ccaa-nginx-conf\") pod \"networking-console-plugin-6cf856758c-sksmh\" (UID: \"5ae097ff-d3b5-4962-afef-f78b9b65ccaa\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-sksmh"
Jul 15 15:35:49.603100 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:49.603067    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/7f8686f6-7e33-4c8e-91fe-d5fabf84906a-stats-auth\") pod \"router-default-6b6d8f8b7b-mrtkd\" (UID: \"7f8686f6-7e33-4c8e-91fe-d5fabf84906a\") " pod="openshift-ingress/router-default-6b6d8f8b7b-mrtkd"
Jul 15 15:35:49.603100 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:49.603086    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/7f8686f6-7e33-4c8e-91fe-d5fabf84906a-default-certificate\") pod \"router-default-6b6d8f8b7b-mrtkd\" (UID: \"7f8686f6-7e33-4c8e-91fe-d5fabf84906a\") " pod="openshift-ingress/router-default-6b6d8f8b7b-mrtkd"
Jul 15 15:35:49.610892 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:49.610872    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jh54n\" (UniqueName: \"kubernetes.io/projected/c80ed5cd-4b7c-4981-95c6-a02cf058f709-kube-api-access-jh54n\") pod \"cluster-monitoring-operator-5f7f494dd4-lbdlp\" (UID: \"c80ed5cd-4b7c-4981-95c6-a02cf058f709\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-lbdlp"
Jul 15 15:35:49.611031 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:49.610888    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v9snb\" (UniqueName: \"kubernetes.io/projected/91470f33-4aad-469b-abc5-615603d650b6-kube-api-access-v9snb\") pod \"network-check-source-869dcfcdcd-crgxn\" (UID: \"91470f33-4aad-469b-abc5-615603d650b6\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-crgxn"
Jul 15 15:35:49.612060 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:49.612039    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-klkld\" (UniqueName: \"kubernetes.io/projected/7f8686f6-7e33-4c8e-91fe-d5fabf84906a-kube-api-access-klkld\") pod \"router-default-6b6d8f8b7b-mrtkd\" (UID: \"7f8686f6-7e33-4c8e-91fe-d5fabf84906a\") " pod="openshift-ingress/router-default-6b6d8f8b7b-mrtkd"
Jul 15 15:35:49.627114 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:49.627091    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-68d9dd94cf-d5wnr"
Jul 15 15:35:49.700870 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:49.700830    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t6hk9\" (UniqueName: \"kubernetes.io/projected/3856ae8d-74b3-4640-ac17-8800509097a6-kube-api-access-t6hk9\") pod \"dns-default-btdcp\" (UID: \"3856ae8d-74b3-4640-ac17-8800509097a6\") " pod="openshift-dns/dns-default-btdcp"
Jul 15 15:35:49.700997 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:49.700906    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3856ae8d-74b3-4640-ac17-8800509097a6-config-volume\") pod \"dns-default-btdcp\" (UID: \"3856ae8d-74b3-4640-ac17-8800509097a6\") " pod="openshift-dns/dns-default-btdcp"
Jul 15 15:35:49.701048 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:49.701033    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3856ae8d-74b3-4640-ac17-8800509097a6-tmp-dir\") pod \"dns-default-btdcp\" (UID: \"3856ae8d-74b3-4640-ac17-8800509097a6\") " pod="openshift-dns/dns-default-btdcp"
Jul 15 15:35:49.701114 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:49.701062    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-25j48\" (UniqueName: \"kubernetes.io/projected/ca4f5583-9d02-45e0-ab0a-aac9fc70bd71-kube-api-access-25j48\") pod \"ingress-canary-cbhd5\" (UID: \"ca4f5583-9d02-45e0-ab0a-aac9fc70bd71\") " pod="openshift-ingress-canary/ingress-canary-cbhd5"
Jul 15 15:35:49.701114 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:49.701086    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ca4f5583-9d02-45e0-ab0a-aac9fc70bd71-cert\") pod \"ingress-canary-cbhd5\" (UID: \"ca4f5583-9d02-45e0-ab0a-aac9fc70bd71\") " pod="openshift-ingress-canary/ingress-canary-cbhd5"
Jul 15 15:35:49.701206 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:49.701128    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3856ae8d-74b3-4640-ac17-8800509097a6-metrics-tls\") pod \"dns-default-btdcp\" (UID: \"3856ae8d-74b3-4640-ac17-8800509097a6\") " pod="openshift-dns/dns-default-btdcp"
Jul 15 15:35:49.701252 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:35:49.701230    2588 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 15 15:35:49.701300 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:35:49.701292    2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3856ae8d-74b3-4640-ac17-8800509097a6-metrics-tls podName:3856ae8d-74b3-4640-ac17-8800509097a6 nodeName:}" failed. No retries permitted until 2026-07-15 15:35:50.201275289 +0000 UTC m=+35.853341040 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3856ae8d-74b3-4640-ac17-8800509097a6-metrics-tls") pod "dns-default-btdcp" (UID: "3856ae8d-74b3-4640-ac17-8800509097a6") : secret "dns-default-metrics-tls" not found
Jul 15 15:35:49.701464 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:49.701435    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3856ae8d-74b3-4640-ac17-8800509097a6-tmp-dir\") pod \"dns-default-btdcp\" (UID: \"3856ae8d-74b3-4640-ac17-8800509097a6\") " pod="openshift-dns/dns-default-btdcp"
Jul 15 15:35:49.701614 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:49.701589    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3856ae8d-74b3-4640-ac17-8800509097a6-config-volume\") pod \"dns-default-btdcp\" (UID: \"3856ae8d-74b3-4640-ac17-8800509097a6\") " pod="openshift-dns/dns-default-btdcp"
Jul 15 15:35:49.703794 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:49.703775    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ca4f5583-9d02-45e0-ab0a-aac9fc70bd71-cert\") pod \"ingress-canary-cbhd5\" (UID: \"ca4f5583-9d02-45e0-ab0a-aac9fc70bd71\") " pod="openshift-ingress-canary/ingress-canary-cbhd5"
Jul 15 15:35:49.710975 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:49.710956    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-crgxn"
Jul 15 15:35:49.711272 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:49.711251    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t6hk9\" (UniqueName: \"kubernetes.io/projected/3856ae8d-74b3-4640-ac17-8800509097a6-kube-api-access-t6hk9\") pod \"dns-default-btdcp\" (UID: \"3856ae8d-74b3-4640-ac17-8800509097a6\") " pod="openshift-dns/dns-default-btdcp"
Jul 15 15:35:49.711920 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:49.711904    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-25j48\" (UniqueName: \"kubernetes.io/projected/ca4f5583-9d02-45e0-ab0a-aac9fc70bd71-kube-api-access-25j48\") pod \"ingress-canary-cbhd5\" (UID: \"ca4f5583-9d02-45e0-ab0a-aac9fc70bd71\") " pod="openshift-ingress-canary/ingress-canary-cbhd5"
Jul 15 15:35:49.734896 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:49.734875    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-cbhd5"
Jul 15 15:35:49.905135 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:49.905104    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fgm54"
Jul 15 15:35:49.905135 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:49.905135    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n4kpw"
Jul 15 15:35:49.905376 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:49.905109    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5xbsg"
Jul 15 15:35:49.908485 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:49.908462    2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-xhclp\""
Jul 15 15:35:49.908485 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:49.908480    2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-89d92\""
Jul 15 15:35:49.908673 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:49.908632    2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 15 15:35:49.908735 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:49.908703    2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 15 15:35:50.003752 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:50.002932    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/dfd89595-3f0b-4bbb-b6c3-3adff5584228-registry-tls\") pod \"image-registry-7497644dd6-r6f4x\" (UID: \"dfd89595-3f0b-4bbb-b6c3-3adff5584228\") " pod="openshift-image-registry/image-registry-7497644dd6-r6f4x"
Jul 15 15:35:50.003752 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:50.003023    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/2e7ce623-e580-4213-a1fd-87e6fe2f2dfa-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-zkq4t\" (UID: \"2e7ce623-e580-4213-a1fd-87e6fe2f2dfa\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-zkq4t"
Jul 15 15:35:50.003752 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:35:50.003211    2588 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 15 15:35:50.003752 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:35:50.003280    2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e7ce623-e580-4213-a1fd-87e6fe2f2dfa-samples-operator-tls podName:2e7ce623-e580-4213-a1fd-87e6fe2f2dfa nodeName:}" failed. No retries permitted until 2026-07-15 15:35:51.003261316 +0000 UTC m=+36.655327057 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/2e7ce623-e580-4213-a1fd-87e6fe2f2dfa-samples-operator-tls") pod "cluster-samples-operator-65db858894-zkq4t" (UID: "2e7ce623-e580-4213-a1fd-87e6fe2f2dfa") : secret "samples-operator-tls" not found
Jul 15 15:35:50.003752 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:35:50.003738    2588 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 15 15:35:50.003752 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:35:50.003754    2588 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7497644dd6-r6f4x: secret "image-registry-tls" not found
Jul 15 15:35:50.004231 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:35:50.003806    2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dfd89595-3f0b-4bbb-b6c3-3adff5584228-registry-tls podName:dfd89595-3f0b-4bbb-b6c3-3adff5584228 nodeName:}" failed. No retries permitted until 2026-07-15 15:35:51.003790536 +0000 UTC m=+36.655856287 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/dfd89595-3f0b-4bbb-b6c3-3adff5584228-registry-tls") pod "image-registry-7497644dd6-r6f4x" (UID: "dfd89595-3f0b-4bbb-b6c3-3adff5584228") : secret "image-registry-tls" not found
Jul 15 15:35:50.106003 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:50.104294    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7f8686f6-7e33-4c8e-91fe-d5fabf84906a-service-ca-bundle\") pod \"router-default-6b6d8f8b7b-mrtkd\" (UID: \"7f8686f6-7e33-4c8e-91fe-d5fabf84906a\") " pod="openshift-ingress/router-default-6b6d8f8b7b-mrtkd"
Jul 15 15:35:50.106003 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:50.104416    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/c80ed5cd-4b7c-4981-95c6-a02cf058f709-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-lbdlp\" (UID: \"c80ed5cd-4b7c-4981-95c6-a02cf058f709\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-lbdlp"
Jul 15 15:35:50.106003 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:50.104459    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7f8686f6-7e33-4c8e-91fe-d5fabf84906a-metrics-certs\") pod \"router-default-6b6d8f8b7b-mrtkd\" (UID: \"7f8686f6-7e33-4c8e-91fe-d5fabf84906a\") " pod="openshift-ingress/router-default-6b6d8f8b7b-mrtkd"
Jul 15 15:35:50.106003 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:50.104505    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5ae097ff-d3b5-4962-afef-f78b9b65ccaa-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-sksmh\" (UID: \"5ae097ff-d3b5-4962-afef-f78b9b65ccaa\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-sksmh"
Jul 15 15:35:50.106003 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:35:50.105107    2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7f8686f6-7e33-4c8e-91fe-d5fabf84906a-service-ca-bundle podName:7f8686f6-7e33-4c8e-91fe-d5fabf84906a nodeName:}" failed. No retries permitted until 2026-07-15 15:35:51.10508549 +0000 UTC m=+36.757151235 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/7f8686f6-7e33-4c8e-91fe-d5fabf84906a-service-ca-bundle") pod "router-default-6b6d8f8b7b-mrtkd" (UID: "7f8686f6-7e33-4c8e-91fe-d5fabf84906a") : configmap references non-existent config key: service-ca.crt
Jul 15 15:35:50.106003 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:35:50.105555    2588 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 15 15:35:50.106003 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:35:50.105608    2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c80ed5cd-4b7c-4981-95c6-a02cf058f709-cluster-monitoring-operator-tls podName:c80ed5cd-4b7c-4981-95c6-a02cf058f709 nodeName:}" failed. No retries permitted until 2026-07-15 15:35:51.105590867 +0000 UTC m=+36.757656618 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/c80ed5cd-4b7c-4981-95c6-a02cf058f709-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-lbdlp" (UID: "c80ed5cd-4b7c-4981-95c6-a02cf058f709") : secret "cluster-monitoring-operator-tls" not found
Jul 15 15:35:50.106003 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:35:50.105662    2588 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 15 15:35:50.106003 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:35:50.105692    2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f8686f6-7e33-4c8e-91fe-d5fabf84906a-metrics-certs podName:7f8686f6-7e33-4c8e-91fe-d5fabf84906a nodeName:}" failed. No retries permitted until 2026-07-15 15:35:51.105681762 +0000 UTC m=+36.757747514 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7f8686f6-7e33-4c8e-91fe-d5fabf84906a-metrics-certs") pod "router-default-6b6d8f8b7b-mrtkd" (UID: "7f8686f6-7e33-4c8e-91fe-d5fabf84906a") : secret "router-metrics-certs-default" not found
Jul 15 15:35:50.106003 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:35:50.105745    2588 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 15 15:35:50.106003 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:35:50.105775    2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5ae097ff-d3b5-4962-afef-f78b9b65ccaa-networking-console-plugin-cert podName:5ae097ff-d3b5-4962-afef-f78b9b65ccaa nodeName:}" failed. No retries permitted until 2026-07-15 15:35:51.105766663 +0000 UTC m=+36.757832414 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/5ae097ff-d3b5-4962-afef-f78b9b65ccaa-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-sksmh" (UID: "5ae097ff-d3b5-4962-afef-f78b9b65ccaa") : secret "networking-console-plugin-cert" not found
Jul 15 15:35:50.206736 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:50.205717    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3856ae8d-74b3-4640-ac17-8800509097a6-metrics-tls\") pod \"dns-default-btdcp\" (UID: \"3856ae8d-74b3-4640-ac17-8800509097a6\") " pod="openshift-dns/dns-default-btdcp"
Jul 15 15:35:50.206736 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:35:50.206039    2588 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 15 15:35:50.206736 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:35:50.206106    2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3856ae8d-74b3-4640-ac17-8800509097a6-metrics-tls podName:3856ae8d-74b3-4640-ac17-8800509097a6 nodeName:}" failed. No retries permitted until 2026-07-15 15:35:51.206085068 +0000 UTC m=+36.858150825 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3856ae8d-74b3-4640-ac17-8800509097a6-metrics-tls") pod "dns-default-btdcp" (UID: "3856ae8d-74b3-4640-ac17-8800509097a6") : secret "dns-default-metrics-tls" not found
Jul 15 15:35:50.253262 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:50.253223    2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-cbhd5"]
Jul 15 15:35:50.255045 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:50.254595    2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-crgxn"]
Jul 15 15:35:50.255505 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:50.255485    2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-pxkjb"]
Jul 15 15:35:50.258807 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:50.258788    2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-d5wnr"]
Jul 15 15:35:50.262532 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:50.262087    2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-ntx28"]
Jul 15 15:35:50.265430 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:50.265410    2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-xqhg4"]
Jul 15 15:35:50.274189 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:50.274157    2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7866497494-qcvqk"]
Jul 15 15:35:50.276319 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:50.276292    2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod91470f33_4aad_469b_abc5_615603d650b6.slice/crio-3c562c7b40dc56052ec409b19de6110d09d37d1129e5900a023abdb6d6a2e1a5 WatchSource:0}: Error finding container 3c562c7b40dc56052ec409b19de6110d09d37d1129e5900a023abdb6d6a2e1a5: Status 404 returned error can't find the container with id 3c562c7b40dc56052ec409b19de6110d09d37d1129e5900a023abdb6d6a2e1a5
Jul 15 15:35:50.277157 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:50.277137    2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32207a22_c82a_4d3b_a044_aa9899bcdf2d.slice/crio-7ecd6be936fc4ee6b7a4aa954e2d72c4671e3e26d0314475af399f30aaf7dfec WatchSource:0}: Error finding container 7ecd6be936fc4ee6b7a4aa954e2d72c4671e3e26d0314475af399f30aaf7dfec: Status 404 returned error can't find the container with id 7ecd6be936fc4ee6b7a4aa954e2d72c4671e3e26d0314475af399f30aaf7dfec
Jul 15 15:35:50.281535 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:50.280384    2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca4f5583_9d02_45e0_ab0a_aac9fc70bd71.slice/crio-cb82548034c3b874fbc079ca6dc30a3196cd07c805addc3d2128551642751007 WatchSource:0}: Error finding container cb82548034c3b874fbc079ca6dc30a3196cd07c805addc3d2128551642751007: Status 404 returned error can't find the container with id cb82548034c3b874fbc079ca6dc30a3196cd07c805addc3d2128551642751007
Jul 15 15:35:51.012918 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:51.012889    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/2e7ce623-e580-4213-a1fd-87e6fe2f2dfa-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-zkq4t\" (UID: \"2e7ce623-e580-4213-a1fd-87e6fe2f2dfa\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-zkq4t"
Jul 15 15:35:51.013095 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:51.013070    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/dfd89595-3f0b-4bbb-b6c3-3adff5584228-registry-tls\") pod \"image-registry-7497644dd6-r6f4x\" (UID: \"dfd89595-3f0b-4bbb-b6c3-3adff5584228\") " pod="openshift-image-registry/image-registry-7497644dd6-r6f4x"
Jul 15 15:35:51.013220 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:35:51.013204    2588 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 15 15:35:51.013281 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:35:51.013224    2588 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7497644dd6-r6f4x: secret "image-registry-tls" not found
Jul 15 15:35:51.013334 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:35:51.013281    2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dfd89595-3f0b-4bbb-b6c3-3adff5584228-registry-tls podName:dfd89595-3f0b-4bbb-b6c3-3adff5584228 nodeName:}" failed. No retries permitted until 2026-07-15 15:35:53.013263307 +0000 UTC m=+38.665329050 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/dfd89595-3f0b-4bbb-b6c3-3adff5584228-registry-tls") pod "image-registry-7497644dd6-r6f4x" (UID: "dfd89595-3f0b-4bbb-b6c3-3adff5584228") : secret "image-registry-tls" not found
Jul 15 15:35:51.013689 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:35:51.013670    2588 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 15 15:35:51.013783 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:35:51.013725    2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e7ce623-e580-4213-a1fd-87e6fe2f2dfa-samples-operator-tls podName:2e7ce623-e580-4213-a1fd-87e6fe2f2dfa nodeName:}" failed. No retries permitted until 2026-07-15 15:35:53.013709202 +0000 UTC m=+38.665774951 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/2e7ce623-e580-4213-a1fd-87e6fe2f2dfa-samples-operator-tls") pod "cluster-samples-operator-65db858894-zkq4t" (UID: "2e7ce623-e580-4213-a1fd-87e6fe2f2dfa") : secret "samples-operator-tls" not found
Jul 15 15:35:51.095207 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:51.095170    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-xqhg4" event={"ID":"3d27b6dd-79a8-46a5-9295-7d359f472c6d","Type":"ContainerStarted","Data":"42f9d5c66b89b564b107e8dc110d9b2f66a6cab49cc4838152d775e0d185731b"}
Jul 15 15:35:51.097405 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:51.097373    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-d5wnr" event={"ID":"c6536c40-bac4-4b75-9914-aa2ff4363de8","Type":"ContainerStarted","Data":"51e58192d6389a05f1c12ce515feec6aa0028defd7afdff8094eefa0d5274532"}
Jul 15 15:35:51.099479 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:51.099454    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-ntx28" event={"ID":"1e467c41-9552-498c-92b7-6bed182b4c7a","Type":"ContainerStarted","Data":"5a1b2495fac265e25dc6574d086ebaa2e7ffff154dc0c425ff11fbb4fd3bfc6c"}
Jul 15 15:35:51.104393 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:51.104368    2588 generic.go:356] "Generic (PLEG): container finished" podID="d64071a5-5f14-450d-99d6-f9295b7b0edc" containerID="d4bb908c29fcd13932b853aa56fd4f383f735eb978f5aebfbabfd635ecce1c75" exitCode=0
Jul 15 15:35:51.104479 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:51.104442    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qpqrs" event={"ID":"d64071a5-5f14-450d-99d6-f9295b7b0edc","Type":"ContainerDied","Data":"d4bb908c29fcd13932b853aa56fd4f383f735eb978f5aebfbabfd635ecce1c75"}
Jul 15 15:35:51.108418 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:51.108332    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-crgxn" event={"ID":"91470f33-4aad-469b-abc5-615603d650b6","Type":"ContainerStarted","Data":"3c562c7b40dc56052ec409b19de6110d09d37d1129e5900a023abdb6d6a2e1a5"}
Jul 15 15:35:51.113288 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:51.113266    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-pxkjb" event={"ID":"32207a22-c82a-4d3b-a044-aa9899bcdf2d","Type":"ContainerStarted","Data":"7ecd6be936fc4ee6b7a4aa954e2d72c4671e3e26d0314475af399f30aaf7dfec"}
Jul 15 15:35:51.113768 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:51.113747    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7f8686f6-7e33-4c8e-91fe-d5fabf84906a-metrics-certs\") pod \"router-default-6b6d8f8b7b-mrtkd\" (UID: \"7f8686f6-7e33-4c8e-91fe-d5fabf84906a\") " pod="openshift-ingress/router-default-6b6d8f8b7b-mrtkd"
Jul 15 15:35:51.113863 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:51.113797    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5ae097ff-d3b5-4962-afef-f78b9b65ccaa-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-sksmh\" (UID: \"5ae097ff-d3b5-4962-afef-f78b9b65ccaa\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-sksmh"
Jul 15 15:35:51.113941 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:51.113925    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7f8686f6-7e33-4c8e-91fe-d5fabf84906a-service-ca-bundle\") pod \"router-default-6b6d8f8b7b-mrtkd\" (UID: \"7f8686f6-7e33-4c8e-91fe-d5fabf84906a\") " pod="openshift-ingress/router-default-6b6d8f8b7b-mrtkd"
Jul 15 15:35:51.114039 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:51.114024    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/c80ed5cd-4b7c-4981-95c6-a02cf058f709-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-lbdlp\" (UID: \"c80ed5cd-4b7c-4981-95c6-a02cf058f709\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-lbdlp"
Jul 15 15:35:51.114167 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:35:51.114153    2588 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 15 15:35:51.114231 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:35:51.114213    2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c80ed5cd-4b7c-4981-95c6-a02cf058f709-cluster-monitoring-operator-tls podName:c80ed5cd-4b7c-4981-95c6-a02cf058f709 nodeName:}" failed. No retries permitted until 2026-07-15 15:35:53.114194434 +0000 UTC m=+38.766260172 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/c80ed5cd-4b7c-4981-95c6-a02cf058f709-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-lbdlp" (UID: "c80ed5cd-4b7c-4981-95c6-a02cf058f709") : secret "cluster-monitoring-operator-tls" not found
Jul 15 15:35:51.114581 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:35:51.114565    2588 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 15 15:35:51.114670 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:35:51.114613    2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f8686f6-7e33-4c8e-91fe-d5fabf84906a-metrics-certs podName:7f8686f6-7e33-4c8e-91fe-d5fabf84906a nodeName:}" failed. No retries permitted until 2026-07-15 15:35:53.114599517 +0000 UTC m=+38.766665272 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7f8686f6-7e33-4c8e-91fe-d5fabf84906a-metrics-certs") pod "router-default-6b6d8f8b7b-mrtkd" (UID: "7f8686f6-7e33-4c8e-91fe-d5fabf84906a") : secret "router-metrics-certs-default" not found
Jul 15 15:35:51.114737 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:35:51.114683    2588 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 15 15:35:51.114737 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:35:51.114718    2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5ae097ff-d3b5-4962-afef-f78b9b65ccaa-networking-console-plugin-cert podName:5ae097ff-d3b5-4962-afef-f78b9b65ccaa nodeName:}" failed. No retries permitted until 2026-07-15 15:35:53.114706028 +0000 UTC m=+38.766771770 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/5ae097ff-d3b5-4962-afef-f78b9b65ccaa-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-sksmh" (UID: "5ae097ff-d3b5-4962-afef-f78b9b65ccaa") : secret "networking-console-plugin-cert" not found
Jul 15 15:35:51.114837 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:35:51.114782    2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7f8686f6-7e33-4c8e-91fe-d5fabf84906a-service-ca-bundle podName:7f8686f6-7e33-4c8e-91fe-d5fabf84906a nodeName:}" failed. No retries permitted until 2026-07-15 15:35:53.114772273 +0000 UTC m=+38.766838014 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/7f8686f6-7e33-4c8e-91fe-d5fabf84906a-service-ca-bundle") pod "router-default-6b6d8f8b7b-mrtkd" (UID: "7f8686f6-7e33-4c8e-91fe-d5fabf84906a") : configmap references non-existent config key: service-ca.crt
Jul 15 15:35:51.118305 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:51.118265    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-qcvqk" event={"ID":"eb866034-d7d1-4bee-b8b7-616b355d371d","Type":"ContainerStarted","Data":"3acaac82c34bccd29bd8c3b6035e566e0eb43601b8732f769edcfcf75488d0a3"}
Jul 15 15:35:51.120971 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:51.120948    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-cbhd5" event={"ID":"ca4f5583-9d02-45e0-ab0a-aac9fc70bd71","Type":"ContainerStarted","Data":"cb82548034c3b874fbc079ca6dc30a3196cd07c805addc3d2128551642751007"}
Jul 15 15:35:51.215771 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:51.214568    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3856ae8d-74b3-4640-ac17-8800509097a6-metrics-tls\") pod \"dns-default-btdcp\" (UID: \"3856ae8d-74b3-4640-ac17-8800509097a6\") " pod="openshift-dns/dns-default-btdcp"
Jul 15 15:35:51.215771 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:35:51.214780    2588 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 15 15:35:51.215771 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:35:51.214852    2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3856ae8d-74b3-4640-ac17-8800509097a6-metrics-tls podName:3856ae8d-74b3-4640-ac17-8800509097a6 nodeName:}" failed. No retries permitted until 2026-07-15 15:35:53.214831535 +0000 UTC m=+38.866897294 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3856ae8d-74b3-4640-ac17-8800509097a6-metrics-tls") pod "dns-default-btdcp" (UID: "3856ae8d-74b3-4640-ac17-8800509097a6") : secret "dns-default-metrics-tls" not found
Jul 15 15:35:52.130314 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:52.130276    2588 generic.go:356] "Generic (PLEG): container finished" podID="d64071a5-5f14-450d-99d6-f9295b7b0edc" containerID="6beb2d84c1fa6cbf6116e431f77f76ecdda8bff473142747c5d9d85cd9794663" exitCode=0
Jul 15 15:35:52.130543 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:52.130375    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qpqrs" event={"ID":"d64071a5-5f14-450d-99d6-f9295b7b0edc","Type":"ContainerDied","Data":"6beb2d84c1fa6cbf6116e431f77f76ecdda8bff473142747c5d9d85cd9794663"}
Jul 15 15:35:53.035854 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:53.035773    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/2e7ce623-e580-4213-a1fd-87e6fe2f2dfa-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-zkq4t\" (UID: \"2e7ce623-e580-4213-a1fd-87e6fe2f2dfa\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-zkq4t"
Jul 15 15:35:53.036236 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:35:53.035958    2588 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 15 15:35:53.036236 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:53.035977    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/dfd89595-3f0b-4bbb-b6c3-3adff5584228-registry-tls\") pod \"image-registry-7497644dd6-r6f4x\" (UID: \"dfd89595-3f0b-4bbb-b6c3-3adff5584228\") " pod="openshift-image-registry/image-registry-7497644dd6-r6f4x"
Jul 15 15:35:53.036236 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:35:53.036037    2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e7ce623-e580-4213-a1fd-87e6fe2f2dfa-samples-operator-tls podName:2e7ce623-e580-4213-a1fd-87e6fe2f2dfa nodeName:}" failed. No retries permitted until 2026-07-15 15:35:57.036015465 +0000 UTC m=+42.688081216 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/2e7ce623-e580-4213-a1fd-87e6fe2f2dfa-samples-operator-tls") pod "cluster-samples-operator-65db858894-zkq4t" (UID: "2e7ce623-e580-4213-a1fd-87e6fe2f2dfa") : secret "samples-operator-tls" not found
Jul 15 15:35:53.036236 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:35:53.036090    2588 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 15 15:35:53.036236 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:35:53.036100    2588 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7497644dd6-r6f4x: secret "image-registry-tls" not found
Jul 15 15:35:53.036236 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:35:53.036140    2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dfd89595-3f0b-4bbb-b6c3-3adff5584228-registry-tls podName:dfd89595-3f0b-4bbb-b6c3-3adff5584228 nodeName:}" failed. No retries permitted until 2026-07-15 15:35:57.036128197 +0000 UTC m=+42.688193934 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/dfd89595-3f0b-4bbb-b6c3-3adff5584228-registry-tls") pod "image-registry-7497644dd6-r6f4x" (UID: "dfd89595-3f0b-4bbb-b6c3-3adff5584228") : secret "image-registry-tls" not found
Jul 15 15:35:53.137231 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:53.137194    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7f8686f6-7e33-4c8e-91fe-d5fabf84906a-service-ca-bundle\") pod \"router-default-6b6d8f8b7b-mrtkd\" (UID: \"7f8686f6-7e33-4c8e-91fe-d5fabf84906a\") " pod="openshift-ingress/router-default-6b6d8f8b7b-mrtkd"
Jul 15 15:35:53.137426 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:53.137285    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/c80ed5cd-4b7c-4981-95c6-a02cf058f709-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-lbdlp\" (UID: \"c80ed5cd-4b7c-4981-95c6-a02cf058f709\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-lbdlp"
Jul 15 15:35:53.137426 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:53.137323    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7f8686f6-7e33-4c8e-91fe-d5fabf84906a-metrics-certs\") pod \"router-default-6b6d8f8b7b-mrtkd\" (UID: \"7f8686f6-7e33-4c8e-91fe-d5fabf84906a\") " pod="openshift-ingress/router-default-6b6d8f8b7b-mrtkd"
Jul 15 15:35:53.137426 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:53.137374    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5ae097ff-d3b5-4962-afef-f78b9b65ccaa-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-sksmh\" (UID: \"5ae097ff-d3b5-4962-afef-f78b9b65ccaa\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-sksmh"
Jul 15 15:35:53.137426 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:35:53.137410    2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7f8686f6-7e33-4c8e-91fe-d5fabf84906a-service-ca-bundle podName:7f8686f6-7e33-4c8e-91fe-d5fabf84906a nodeName:}" failed. No retries permitted until 2026-07-15 15:35:57.1373891 +0000 UTC m=+42.789454860 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/7f8686f6-7e33-4c8e-91fe-d5fabf84906a-service-ca-bundle") pod "router-default-6b6d8f8b7b-mrtkd" (UID: "7f8686f6-7e33-4c8e-91fe-d5fabf84906a") : configmap references non-existent config key: service-ca.crt
Jul 15 15:35:53.137426 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:35:53.137428    2588 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 15 15:35:53.137660 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:35:53.137451    2588 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 15 15:35:53.137660 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:35:53.137456    2588 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 15 15:35:53.137660 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:35:53.137468    2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c80ed5cd-4b7c-4981-95c6-a02cf058f709-cluster-monitoring-operator-tls podName:c80ed5cd-4b7c-4981-95c6-a02cf058f709 nodeName:}" failed. No retries permitted until 2026-07-15 15:35:57.137456792 +0000 UTC m=+42.789522548 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/c80ed5cd-4b7c-4981-95c6-a02cf058f709-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-lbdlp" (UID: "c80ed5cd-4b7c-4981-95c6-a02cf058f709") : secret "cluster-monitoring-operator-tls" not found
Jul 15 15:35:53.137660 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:35:53.137502    2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f8686f6-7e33-4c8e-91fe-d5fabf84906a-metrics-certs podName:7f8686f6-7e33-4c8e-91fe-d5fabf84906a nodeName:}" failed. No retries permitted until 2026-07-15 15:35:57.137485848 +0000 UTC m=+42.789551602 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7f8686f6-7e33-4c8e-91fe-d5fabf84906a-metrics-certs") pod "router-default-6b6d8f8b7b-mrtkd" (UID: "7f8686f6-7e33-4c8e-91fe-d5fabf84906a") : secret "router-metrics-certs-default" not found
Jul 15 15:35:53.137660 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:35:53.137525    2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5ae097ff-d3b5-4962-afef-f78b9b65ccaa-networking-console-plugin-cert podName:5ae097ff-d3b5-4962-afef-f78b9b65ccaa nodeName:}" failed. No retries permitted until 2026-07-15 15:35:57.137515589 +0000 UTC m=+42.789581332 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/5ae097ff-d3b5-4962-afef-f78b9b65ccaa-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-sksmh" (UID: "5ae097ff-d3b5-4962-afef-f78b9b65ccaa") : secret "networking-console-plugin-cert" not found
Jul 15 15:35:53.237974 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:53.237944    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3856ae8d-74b3-4640-ac17-8800509097a6-metrics-tls\") pod \"dns-default-btdcp\" (UID: \"3856ae8d-74b3-4640-ac17-8800509097a6\") " pod="openshift-dns/dns-default-btdcp"
Jul 15 15:35:53.238147 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:35:53.238077    2588 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 15 15:35:53.238147 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:35:53.238141    2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3856ae8d-74b3-4640-ac17-8800509097a6-metrics-tls podName:3856ae8d-74b3-4640-ac17-8800509097a6 nodeName:}" failed. No retries permitted until 2026-07-15 15:35:57.238124426 +0000 UTC m=+42.890190170 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3856ae8d-74b3-4640-ac17-8800509097a6-metrics-tls") pod "dns-default-btdcp" (UID: "3856ae8d-74b3-4640-ac17-8800509097a6") : secret "dns-default-metrics-tls" not found
Jul 15 15:35:57.075824 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:57.075494    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/2e7ce623-e580-4213-a1fd-87e6fe2f2dfa-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-zkq4t\" (UID: \"2e7ce623-e580-4213-a1fd-87e6fe2f2dfa\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-zkq4t"
Jul 15 15:35:57.075824 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:57.075666    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/dfd89595-3f0b-4bbb-b6c3-3adff5584228-registry-tls\") pod \"image-registry-7497644dd6-r6f4x\" (UID: \"dfd89595-3f0b-4bbb-b6c3-3adff5584228\") " pod="openshift-image-registry/image-registry-7497644dd6-r6f4x"
Jul 15 15:35:57.075824 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:35:57.075743    2588 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 15 15:35:57.075824 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:35:57.075770    2588 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 15 15:35:57.075824 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:35:57.075781    2588 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7497644dd6-r6f4x: secret "image-registry-tls" not found
Jul 15 15:35:57.075824 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:35:57.075809    2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e7ce623-e580-4213-a1fd-87e6fe2f2dfa-samples-operator-tls podName:2e7ce623-e580-4213-a1fd-87e6fe2f2dfa nodeName:}" failed. No retries permitted until 2026-07-15 15:36:05.07579186 +0000 UTC m=+50.727857614 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/2e7ce623-e580-4213-a1fd-87e6fe2f2dfa-samples-operator-tls") pod "cluster-samples-operator-65db858894-zkq4t" (UID: "2e7ce623-e580-4213-a1fd-87e6fe2f2dfa") : secret "samples-operator-tls" not found
Jul 15 15:35:57.075824 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:35:57.075826    2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dfd89595-3f0b-4bbb-b6c3-3adff5584228-registry-tls podName:dfd89595-3f0b-4bbb-b6c3-3adff5584228 nodeName:}" failed. No retries permitted until 2026-07-15 15:36:05.075818216 +0000 UTC m=+50.727883953 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/dfd89595-3f0b-4bbb-b6c3-3adff5584228-registry-tls") pod "image-registry-7497644dd6-r6f4x" (UID: "dfd89595-3f0b-4bbb-b6c3-3adff5584228") : secret "image-registry-tls" not found
Jul 15 15:35:57.143903 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:57.143865    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-ntx28" event={"ID":"1e467c41-9552-498c-92b7-6bed182b4c7a","Type":"ContainerStarted","Data":"78bd83e8d3d1de0c8cbe84685a9fff4ba0f6fd0bf9917dbdde6c5f9bcfc268ca"}
Jul 15 15:35:57.147224 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:57.147185    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qpqrs" event={"ID":"d64071a5-5f14-450d-99d6-f9295b7b0edc","Type":"ContainerStarted","Data":"55b47de569b2f063c4b397b3b5487f62d347ac3975369a99f24a5a9e33b366fc"}
Jul 15 15:35:57.148661 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:57.148639    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-crgxn" event={"ID":"91470f33-4aad-469b-abc5-615603d650b6","Type":"ContainerStarted","Data":"0c16fe6adfc40c76ed27821e3f6616c5fc3cdf513a2955f49a0cc519fbe53f8c"}
Jul 15 15:35:57.149978 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:57.149960    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-pxkjb" event={"ID":"32207a22-c82a-4d3b-a044-aa9899bcdf2d","Type":"ContainerStarted","Data":"1d2d104e8d7cb2502e206b16bb67de04cd953a45d30fca917787b9fd0da6d331"}
Jul 15 15:35:57.164152 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:57.164049    2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-ntx28" podStartSLOduration=16.408323086 podStartE2EDuration="22.164034632s" totalImagesPullingTime="5.755711546s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 15:35:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:35:57.163510235 +0000 UTC m=+42.815576018" watchObservedRunningTime="2026-07-15 15:35:57.164034632 +0000 UTC m=+42.816100391"
Jul 15 15:35:57.176758 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:57.176719    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5ae097ff-d3b5-4962-afef-f78b9b65ccaa-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-sksmh\" (UID: \"5ae097ff-d3b5-4962-afef-f78b9b65ccaa\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-sksmh"
Jul 15 15:35:57.177093 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:57.176899    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7f8686f6-7e33-4c8e-91fe-d5fabf84906a-service-ca-bundle\") pod \"router-default-6b6d8f8b7b-mrtkd\" (UID: \"7f8686f6-7e33-4c8e-91fe-d5fabf84906a\") " pod="openshift-ingress/router-default-6b6d8f8b7b-mrtkd"
Jul 15 15:35:57.177093 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:57.177033    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/c80ed5cd-4b7c-4981-95c6-a02cf058f709-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-lbdlp\" (UID: \"c80ed5cd-4b7c-4981-95c6-a02cf058f709\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-lbdlp"
Jul 15 15:35:57.177265 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:57.177121    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7f8686f6-7e33-4c8e-91fe-d5fabf84906a-metrics-certs\") pod \"router-default-6b6d8f8b7b-mrtkd\" (UID: \"7f8686f6-7e33-4c8e-91fe-d5fabf84906a\") " pod="openshift-ingress/router-default-6b6d8f8b7b-mrtkd"
Jul 15 15:35:57.177265 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:35:57.177232    2588 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 15 15:35:57.177385 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:35:57.177282    2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f8686f6-7e33-4c8e-91fe-d5fabf84906a-metrics-certs podName:7f8686f6-7e33-4c8e-91fe-d5fabf84906a nodeName:}" failed. No retries permitted until 2026-07-15 15:36:05.177265371 +0000 UTC m=+50.829331111 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7f8686f6-7e33-4c8e-91fe-d5fabf84906a-metrics-certs") pod "router-default-6b6d8f8b7b-mrtkd" (UID: "7f8686f6-7e33-4c8e-91fe-d5fabf84906a") : secret "router-metrics-certs-default" not found
Jul 15 15:35:57.177385 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:35:57.177288    2588 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 15 15:35:57.177385 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:35:57.177325    2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5ae097ff-d3b5-4962-afef-f78b9b65ccaa-networking-console-plugin-cert podName:5ae097ff-d3b5-4962-afef-f78b9b65ccaa nodeName:}" failed. No retries permitted until 2026-07-15 15:36:05.177313471 +0000 UTC m=+50.829379219 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/5ae097ff-d3b5-4962-afef-f78b9b65ccaa-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-sksmh" (UID: "5ae097ff-d3b5-4962-afef-f78b9b65ccaa") : secret "networking-console-plugin-cert" not found
Jul 15 15:35:57.178113 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:35:57.177793    2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7f8686f6-7e33-4c8e-91fe-d5fabf84906a-service-ca-bundle podName:7f8686f6-7e33-4c8e-91fe-d5fabf84906a nodeName:}" failed. No retries permitted until 2026-07-15 15:36:05.177778095 +0000 UTC m=+50.829843846 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/7f8686f6-7e33-4c8e-91fe-d5fabf84906a-service-ca-bundle") pod "router-default-6b6d8f8b7b-mrtkd" (UID: "7f8686f6-7e33-4c8e-91fe-d5fabf84906a") : configmap references non-existent config key: service-ca.crt
Jul 15 15:35:57.178113 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:35:57.177989    2588 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 15 15:35:57.178113 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:35:57.178088    2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c80ed5cd-4b7c-4981-95c6-a02cf058f709-cluster-monitoring-operator-tls podName:c80ed5cd-4b7c-4981-95c6-a02cf058f709 nodeName:}" failed. No retries permitted until 2026-07-15 15:36:05.178060742 +0000 UTC m=+50.830126511 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/c80ed5cd-4b7c-4981-95c6-a02cf058f709-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-lbdlp" (UID: "c80ed5cd-4b7c-4981-95c6-a02cf058f709") : secret "cluster-monitoring-operator-tls" not found
Jul 15 15:35:57.190777 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:57.190720    2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-qpqrs" podStartSLOduration=12.057108678 podStartE2EDuration="42.190702458s" totalImagesPullingTime="30.13359378s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 15:35:15 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:35:57.19000791 +0000 UTC m=+42.842073694" watchObservedRunningTime="2026-07-15 15:35:57.190702458 +0000 UTC m=+42.842768219"
Jul 15 15:35:57.220488 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:57.219672    2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-pxkjb" podStartSLOduration=16.46147888 podStartE2EDuration="22.219650412s" totalImagesPullingTime="5.758171532s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 15:35:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:35:57.218960115 +0000 UTC m=+42.871025909" watchObservedRunningTime="2026-07-15 15:35:57.219650412 +0000 UTC m=+42.871716169"
Jul 15 15:35:57.242994 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:57.242934    2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-crgxn" podStartSLOduration=16.484502826 podStartE2EDuration="22.242912428s" totalImagesPullingTime="5.758409602s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 15:35:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:35:57.242639564 +0000 UTC m=+42.894705326" watchObservedRunningTime="2026-07-15 15:35:57.242912428 +0000 UTC m=+42.894978188"
Jul 15 15:35:57.277872 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:57.277836    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3856ae8d-74b3-4640-ac17-8800509097a6-metrics-tls\") pod \"dns-default-btdcp\" (UID: \"3856ae8d-74b3-4640-ac17-8800509097a6\") " pod="openshift-dns/dns-default-btdcp"
Jul 15 15:35:57.278043 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:35:57.277995    2588 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 15 15:35:57.278107 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:35:57.278053    2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3856ae8d-74b3-4640-ac17-8800509097a6-metrics-tls podName:3856ae8d-74b3-4640-ac17-8800509097a6 nodeName:}" failed. No retries permitted until 2026-07-15 15:36:05.278033663 +0000 UTC m=+50.930099422 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3856ae8d-74b3-4640-ac17-8800509097a6-metrics-tls") pod "dns-default-btdcp" (UID: "3856ae8d-74b3-4640-ac17-8800509097a6") : secret "dns-default-metrics-tls" not found
Jul 15 15:35:58.015203 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:58.015130    2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-g8vnq"]
Jul 15 15:35:58.033960 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:58.033932    2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-g8vnq"]
Jul 15 15:35:58.034113 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:58.034052    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-g8vnq"
Jul 15 15:35:58.041852 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:58.041828    2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Jul 15 15:35:58.041996 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:58.041837    2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Jul 15 15:35:58.043179 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:58.043160    2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-n5j9p\""
Jul 15 15:35:58.089315 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:58.089284    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-svtv8\" (UniqueName: \"kubernetes.io/projected/006b063d-5fd3-40f5-b898-27117973659a-kube-api-access-svtv8\") pod \"migrator-7f59b54f6c-g8vnq\" (UID: \"006b063d-5fd3-40f5-b898-27117973659a\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-g8vnq"
Jul 15 15:35:58.157359 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:58.157313    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-qcvqk_eb866034-d7d1-4bee-b8b7-616b355d371d/console-operator/0.log"
Jul 15 15:35:58.157594 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:58.157567    2588 generic.go:356] "Generic (PLEG): container finished" podID="eb866034-d7d1-4bee-b8b7-616b355d371d" containerID="041f51735625e081eb49d82339eabb02854bef03f30fd2ca77f6b2225fcaa08d" exitCode=255
Jul 15 15:35:58.158150 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:58.158133    2588 scope.go:117] "RemoveContainer" containerID="041f51735625e081eb49d82339eabb02854bef03f30fd2ca77f6b2225fcaa08d"
Jul 15 15:35:58.159540 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:58.158860    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-qcvqk" event={"ID":"eb866034-d7d1-4bee-b8b7-616b355d371d","Type":"ContainerDied","Data":"041f51735625e081eb49d82339eabb02854bef03f30fd2ca77f6b2225fcaa08d"}
Jul 15 15:35:58.161780 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:58.161754    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-cbhd5" event={"ID":"ca4f5583-9d02-45e0-ab0a-aac9fc70bd71","Type":"ContainerStarted","Data":"03e8227018065a6a8c3f874cc13df19b0c686f95fc732acd52315cbd1d813752"}
Jul 15 15:35:58.163958 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:58.163790    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-xqhg4" event={"ID":"3d27b6dd-79a8-46a5-9295-7d359f472c6d","Type":"ContainerStarted","Data":"9d20bb9b24f102a6eaacc0b246d12e0015f44d44b32607e7d7eac046201e7d04"}
Jul 15 15:35:58.165812 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:58.165785    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-d5wnr" event={"ID":"c6536c40-bac4-4b75-9914-aa2ff4363de8","Type":"ContainerStarted","Data":"945bbf410712be292c4a201e36857f904b527ce6073ab716f6cfd9e68d3f08e4"}
Jul 15 15:35:58.191227 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:58.190781    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-svtv8\" (UniqueName: \"kubernetes.io/projected/006b063d-5fd3-40f5-b898-27117973659a-kube-api-access-svtv8\") pod \"migrator-7f59b54f6c-g8vnq\" (UID: \"006b063d-5fd3-40f5-b898-27117973659a\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-g8vnq"
Jul 15 15:35:58.203589 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:58.203566    2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-l8hv5"]
Jul 15 15:35:58.220988 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:58.220962    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-svtv8\" (UniqueName: \"kubernetes.io/projected/006b063d-5fd3-40f5-b898-27117973659a-kube-api-access-svtv8\") pod \"migrator-7f59b54f6c-g8vnq\" (UID: \"006b063d-5fd3-40f5-b898-27117973659a\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-g8vnq"
Jul 15 15:35:58.226206 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:58.226188    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-l8hv5"
Jul 15 15:35:58.231262 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:58.231242    2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 15 15:35:58.231378 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:58.231365    2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 15 15:35:58.231477 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:58.231458    2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-cvjqc\""
Jul 15 15:35:58.257435 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:58.257413    2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-l8hv5"]
Jul 15 15:35:58.269119 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:58.269046    2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-68d9dd94cf-d5wnr" podStartSLOduration=17.507804331 podStartE2EDuration="23.269032469s" totalImagesPullingTime="5.761228138s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 15:35:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:35:58.268563782 +0000 UTC m=+43.920629542" watchObservedRunningTime="2026-07-15 15:35:58.269032469 +0000 UTC m=+43.921098227"
Jul 15 15:35:58.292891 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:58.292516    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ee7abfdf-8181-4118-ba10-d36fef9ed9d1-data-volume\") pod \"insights-runtime-extractor-l8hv5\" (UID: \"ee7abfdf-8181-4118-ba10-d36fef9ed9d1\") " pod="openshift-insights/insights-runtime-extractor-l8hv5"
Jul 15 15:35:58.292891 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:58.292614    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ee7abfdf-8181-4118-ba10-d36fef9ed9d1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-l8hv5\" (UID: \"ee7abfdf-8181-4118-ba10-d36fef9ed9d1\") " pod="openshift-insights/insights-runtime-extractor-l8hv5"
Jul 15 15:35:58.292891 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:58.292723    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ee7abfdf-8181-4118-ba10-d36fef9ed9d1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-l8hv5\" (UID: \"ee7abfdf-8181-4118-ba10-d36fef9ed9d1\") " pod="openshift-insights/insights-runtime-extractor-l8hv5"
Jul 15 15:35:58.292891 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:58.292780    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zkkkr\" (UniqueName: \"kubernetes.io/projected/ee7abfdf-8181-4118-ba10-d36fef9ed9d1-kube-api-access-zkkkr\") pod \"insights-runtime-extractor-l8hv5\" (UID: \"ee7abfdf-8181-4118-ba10-d36fef9ed9d1\") " pod="openshift-insights/insights-runtime-extractor-l8hv5"
Jul 15 15:35:58.292891 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:58.292833    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ee7abfdf-8181-4118-ba10-d36fef9ed9d1-crio-socket\") pod \"insights-runtime-extractor-l8hv5\" (UID: \"ee7abfdf-8181-4118-ba10-d36fef9ed9d1\") " pod="openshift-insights/insights-runtime-extractor-l8hv5"
Jul 15 15:35:58.344675 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:58.344650    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-g8vnq"
Jul 15 15:35:58.393803 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:58.393771    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ee7abfdf-8181-4118-ba10-d36fef9ed9d1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-l8hv5\" (UID: \"ee7abfdf-8181-4118-ba10-d36fef9ed9d1\") " pod="openshift-insights/insights-runtime-extractor-l8hv5"
Jul 15 15:35:58.393943 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:58.393831    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zkkkr\" (UniqueName: \"kubernetes.io/projected/ee7abfdf-8181-4118-ba10-d36fef9ed9d1-kube-api-access-zkkkr\") pod \"insights-runtime-extractor-l8hv5\" (UID: \"ee7abfdf-8181-4118-ba10-d36fef9ed9d1\") " pod="openshift-insights/insights-runtime-extractor-l8hv5"
Jul 15 15:35:58.393943 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:58.393886    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ee7abfdf-8181-4118-ba10-d36fef9ed9d1-crio-socket\") pod \"insights-runtime-extractor-l8hv5\" (UID: \"ee7abfdf-8181-4118-ba10-d36fef9ed9d1\") " pod="openshift-insights/insights-runtime-extractor-l8hv5"
Jul 15 15:35:58.393943 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:58.393920    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ee7abfdf-8181-4118-ba10-d36fef9ed9d1-data-volume\") pod \"insights-runtime-extractor-l8hv5\" (UID: \"ee7abfdf-8181-4118-ba10-d36fef9ed9d1\") " pod="openshift-insights/insights-runtime-extractor-l8hv5"
Jul 15 15:35:58.394113 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:58.393977    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ee7abfdf-8181-4118-ba10-d36fef9ed9d1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-l8hv5\" (UID: \"ee7abfdf-8181-4118-ba10-d36fef9ed9d1\") " pod="openshift-insights/insights-runtime-extractor-l8hv5"
Jul 15 15:35:58.394158 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:58.394144    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ee7abfdf-8181-4118-ba10-d36fef9ed9d1-crio-socket\") pod \"insights-runtime-extractor-l8hv5\" (UID: \"ee7abfdf-8181-4118-ba10-d36fef9ed9d1\") " pod="openshift-insights/insights-runtime-extractor-l8hv5"
Jul 15 15:35:58.394202 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:35:58.393922    2588 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 15 15:35:58.394249 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:35:58.394234    2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ee7abfdf-8181-4118-ba10-d36fef9ed9d1-insights-runtime-extractor-tls podName:ee7abfdf-8181-4118-ba10-d36fef9ed9d1 nodeName:}" failed. No retries permitted until 2026-07-15 15:35:58.894213286 +0000 UTC m=+44.546279032 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ee7abfdf-8181-4118-ba10-d36fef9ed9d1-insights-runtime-extractor-tls") pod "insights-runtime-extractor-l8hv5" (UID: "ee7abfdf-8181-4118-ba10-d36fef9ed9d1") : secret "insights-runtime-extractor-tls" not found
Jul 15 15:35:58.394391 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:35:58.394095    2588 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 15 15:35:58.394500 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:35:58.394426    2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ee7abfdf-8181-4118-ba10-d36fef9ed9d1-kube-rbac-proxy-cm podName:ee7abfdf-8181-4118-ba10-d36fef9ed9d1 nodeName:}" failed. No retries permitted until 2026-07-15 15:35:58.894410601 +0000 UTC m=+44.546476352 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ee7abfdf-8181-4118-ba10-d36fef9ed9d1-kube-rbac-proxy-cm") pod "insights-runtime-extractor-l8hv5" (UID: "ee7abfdf-8181-4118-ba10-d36fef9ed9d1") : configmap "kube-rbac-proxy" not found
Jul 15 15:35:58.394500 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:58.394478    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ee7abfdf-8181-4118-ba10-d36fef9ed9d1-data-volume\") pod \"insights-runtime-extractor-l8hv5\" (UID: \"ee7abfdf-8181-4118-ba10-d36fef9ed9d1\") " pod="openshift-insights/insights-runtime-extractor-l8hv5"
Jul 15 15:35:58.396295 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:58.396254    2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-xqhg4" podStartSLOduration=17.638155817 podStartE2EDuration="23.396241983s" totalImagesPullingTime="5.758086166s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 15:35:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:35:58.394683665 +0000 UTC m=+44.046749434" watchObservedRunningTime="2026-07-15 15:35:58.396241983 +0000 UTC m=+44.048307742"
Jul 15 15:35:58.396404 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:58.396383    2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-cbhd5" podStartSLOduration=2.177294346 podStartE2EDuration="9.396377035s" totalImagesPullingTime="7.219082689s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 15:35:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:35:58.333508915 +0000 UTC m=+43.985574676" watchObservedRunningTime="2026-07-15 15:35:58.396377035 +0000 UTC m=+44.048442793"
Jul 15 15:35:58.440747 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:58.440664    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zkkkr\" (UniqueName: \"kubernetes.io/projected/ee7abfdf-8181-4118-ba10-d36fef9ed9d1-kube-api-access-zkkkr\") pod \"insights-runtime-extractor-l8hv5\" (UID: \"ee7abfdf-8181-4118-ba10-d36fef9ed9d1\") " pod="openshift-insights/insights-runtime-extractor-l8hv5"
Jul 15 15:35:58.497078 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:58.497026    2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-g8vnq"]
Jul 15 15:35:58.499521 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:35:58.499491    2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod006b063d_5fd3_40f5_b898_27117973659a.slice/crio-31f65b25c0ca1390c636c3cf93a39df48fd69ec3a0fedb8e94d456857d07489e WatchSource:0}: Error finding container 31f65b25c0ca1390c636c3cf93a39df48fd69ec3a0fedb8e94d456857d07489e: Status 404 returned error can't find the container with id 31f65b25c0ca1390c636c3cf93a39df48fd69ec3a0fedb8e94d456857d07489e
Jul 15 15:35:58.898850 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:58.898813    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ee7abfdf-8181-4118-ba10-d36fef9ed9d1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-l8hv5\" (UID: \"ee7abfdf-8181-4118-ba10-d36fef9ed9d1\") " pod="openshift-insights/insights-runtime-extractor-l8hv5"
Jul 15 15:35:58.899045 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:58.898919    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ee7abfdf-8181-4118-ba10-d36fef9ed9d1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-l8hv5\" (UID: \"ee7abfdf-8181-4118-ba10-d36fef9ed9d1\") " pod="openshift-insights/insights-runtime-extractor-l8hv5"
Jul 15 15:35:58.899045 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:35:58.898946    2588 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 15 15:35:58.899045 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:35:58.899006    2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ee7abfdf-8181-4118-ba10-d36fef9ed9d1-kube-rbac-proxy-cm podName:ee7abfdf-8181-4118-ba10-d36fef9ed9d1 nodeName:}" failed. No retries permitted until 2026-07-15 15:35:59.898989301 +0000 UTC m=+45.551055042 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ee7abfdf-8181-4118-ba10-d36fef9ed9d1-kube-rbac-proxy-cm") pod "insights-runtime-extractor-l8hv5" (UID: "ee7abfdf-8181-4118-ba10-d36fef9ed9d1") : configmap "kube-rbac-proxy" not found
Jul 15 15:35:58.899164 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:35:58.899067    2588 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 15 15:35:58.899164 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:35:58.899119    2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ee7abfdf-8181-4118-ba10-d36fef9ed9d1-insights-runtime-extractor-tls podName:ee7abfdf-8181-4118-ba10-d36fef9ed9d1 nodeName:}" failed. No retries permitted until 2026-07-15 15:35:59.899106502 +0000 UTC m=+45.551172239 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ee7abfdf-8181-4118-ba10-d36fef9ed9d1-insights-runtime-extractor-tls") pod "insights-runtime-extractor-l8hv5" (UID: "ee7abfdf-8181-4118-ba10-d36fef9ed9d1") : secret "insights-runtime-extractor-tls" not found
Jul 15 15:35:59.170928 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:59.170863    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-qcvqk_eb866034-d7d1-4bee-b8b7-616b355d371d/console-operator/1.log"
Jul 15 15:35:59.171288 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:59.171243    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-qcvqk_eb866034-d7d1-4bee-b8b7-616b355d371d/console-operator/0.log"
Jul 15 15:35:59.171288 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:59.171276    2588 generic.go:356] "Generic (PLEG): container finished" podID="eb866034-d7d1-4bee-b8b7-616b355d371d" containerID="d5f71209a5d7f9ad628cbb9106326894e1f69a8135aa0af21a8db1dd52e77d46" exitCode=255
Jul 15 15:35:59.171373 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:59.171357    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-qcvqk" event={"ID":"eb866034-d7d1-4bee-b8b7-616b355d371d","Type":"ContainerDied","Data":"d5f71209a5d7f9ad628cbb9106326894e1f69a8135aa0af21a8db1dd52e77d46"}
Jul 15 15:35:59.171422 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:59.171406    2588 scope.go:117] "RemoveContainer" containerID="041f51735625e081eb49d82339eabb02854bef03f30fd2ca77f6b2225fcaa08d"
Jul 15 15:35:59.171617 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:59.171594    2588 scope.go:117] "RemoveContainer" containerID="d5f71209a5d7f9ad628cbb9106326894e1f69a8135aa0af21a8db1dd52e77d46"
Jul 15 15:35:59.171807 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:35:59.171787    2588 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-qcvqk_openshift-console-operator(eb866034-d7d1-4bee-b8b7-616b355d371d)\"" pod="openshift-console-operator/console-operator-7866497494-qcvqk" podUID="eb866034-d7d1-4bee-b8b7-616b355d371d"
Jul 15 15:35:59.172938 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:59.172672    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-g8vnq" event={"ID":"006b063d-5fd3-40f5-b898-27117973659a","Type":"ContainerStarted","Data":"31f65b25c0ca1390c636c3cf93a39df48fd69ec3a0fedb8e94d456857d07489e"}
Jul 15 15:35:59.593150 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:59.593123    2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-qcvqk"
Jul 15 15:35:59.593300 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:59.593177    2588 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-7866497494-qcvqk"
Jul 15 15:35:59.907395 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:59.907296    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ee7abfdf-8181-4118-ba10-d36fef9ed9d1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-l8hv5\" (UID: \"ee7abfdf-8181-4118-ba10-d36fef9ed9d1\") " pod="openshift-insights/insights-runtime-extractor-l8hv5"
Jul 15 15:35:59.907568 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:35:59.907410    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ee7abfdf-8181-4118-ba10-d36fef9ed9d1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-l8hv5\" (UID: \"ee7abfdf-8181-4118-ba10-d36fef9ed9d1\") " pod="openshift-insights/insights-runtime-extractor-l8hv5"
Jul 15 15:35:59.907568 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:35:59.907433    2588 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 15 15:35:59.907568 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:35:59.907510    2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ee7abfdf-8181-4118-ba10-d36fef9ed9d1-kube-rbac-proxy-cm podName:ee7abfdf-8181-4118-ba10-d36fef9ed9d1 nodeName:}" failed. No retries permitted until 2026-07-15 15:36:01.907489134 +0000 UTC m=+47.559554890 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ee7abfdf-8181-4118-ba10-d36fef9ed9d1-kube-rbac-proxy-cm") pod "insights-runtime-extractor-l8hv5" (UID: "ee7abfdf-8181-4118-ba10-d36fef9ed9d1") : configmap "kube-rbac-proxy" not found
Jul 15 15:35:59.907568 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:35:59.907551    2588 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 15 15:35:59.907765 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:35:59.907603    2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ee7abfdf-8181-4118-ba10-d36fef9ed9d1-insights-runtime-extractor-tls podName:ee7abfdf-8181-4118-ba10-d36fef9ed9d1 nodeName:}" failed. No retries permitted until 2026-07-15 15:36:01.907590564 +0000 UTC m=+47.559656302 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ee7abfdf-8181-4118-ba10-d36fef9ed9d1-insights-runtime-extractor-tls") pod "insights-runtime-extractor-l8hv5" (UID: "ee7abfdf-8181-4118-ba10-d36fef9ed9d1") : secret "insights-runtime-extractor-tls" not found
Jul 15 15:36:00.177433 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:00.177362    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-qcvqk_eb866034-d7d1-4bee-b8b7-616b355d371d/console-operator/1.log"
Jul 15 15:36:00.177744 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:00.177677    2588 scope.go:117] "RemoveContainer" containerID="d5f71209a5d7f9ad628cbb9106326894e1f69a8135aa0af21a8db1dd52e77d46"
Jul 15 15:36:00.177834 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:36:00.177813    2588 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-qcvqk_openshift-console-operator(eb866034-d7d1-4bee-b8b7-616b355d371d)\"" pod="openshift-console-operator/console-operator-7866497494-qcvqk" podUID="eb866034-d7d1-4bee-b8b7-616b355d371d"
Jul 15 15:36:00.370016 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:00.369996    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-wmcfh_6d4c5bcd-e4af-48c1-a49c-00ebbf891ff1/dns-node-resolver/0.log"
Jul 15 15:36:01.168696 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:01.168670    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-f7bpr_0bc9e977-62dc-48b4-bd53-a6ae3de45690/node-ca/0.log"
Jul 15 15:36:01.181782 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:01.181752    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-g8vnq" event={"ID":"006b063d-5fd3-40f5-b898-27117973659a","Type":"ContainerStarted","Data":"e9d1186da04b7c9e48ea6d4e9c9fc306a49f698bdbe865b7a5e4d0fd240f0e32"}
Jul 15 15:36:01.182144 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:01.181800    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-g8vnq" event={"ID":"006b063d-5fd3-40f5-b898-27117973659a","Type":"ContainerStarted","Data":"d160fc1b57d637b33f001d0431c5c3c3e86741eb3c1a1d070fe602823556f497"}
Jul 15 15:36:01.182144 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:01.182020    2588 scope.go:117] "RemoveContainer" containerID="d5f71209a5d7f9ad628cbb9106326894e1f69a8135aa0af21a8db1dd52e77d46"
Jul 15 15:36:01.182220 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:36:01.182173    2588 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-qcvqk_openshift-console-operator(eb866034-d7d1-4bee-b8b7-616b355d371d)\"" pod="openshift-console-operator/console-operator-7866497494-qcvqk" podUID="eb866034-d7d1-4bee-b8b7-616b355d371d"
Jul 15 15:36:01.202544 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:01.202497    2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-g8vnq" podStartSLOduration=2.437997192 podStartE2EDuration="4.202483505s" totalImagesPullingTime="1.764486313s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 15:35:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:36:01.20158395 +0000 UTC m=+46.853649732" watchObservedRunningTime="2026-07-15 15:36:01.202483505 +0000 UTC m=+46.854549298"
Jul 15 15:36:01.770448 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:01.770366    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-cbhd5_ca4f5583-9d02-45e0-ab0a-aac9fc70bd71/serve-healthcheck-canary/0.log"
Jul 15 15:36:01.924354 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:01.924318    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ee7abfdf-8181-4118-ba10-d36fef9ed9d1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-l8hv5\" (UID: \"ee7abfdf-8181-4118-ba10-d36fef9ed9d1\") " pod="openshift-insights/insights-runtime-extractor-l8hv5"
Jul 15 15:36:01.924565 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:01.924434    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ee7abfdf-8181-4118-ba10-d36fef9ed9d1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-l8hv5\" (UID: \"ee7abfdf-8181-4118-ba10-d36fef9ed9d1\") " pod="openshift-insights/insights-runtime-extractor-l8hv5"
Jul 15 15:36:01.924565 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:36:01.924476    2588 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 15 15:36:01.924565 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:36:01.924556    2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ee7abfdf-8181-4118-ba10-d36fef9ed9d1-kube-rbac-proxy-cm podName:ee7abfdf-8181-4118-ba10-d36fef9ed9d1 nodeName:}" failed. No retries permitted until 2026-07-15 15:36:05.924537596 +0000 UTC m=+51.576603336 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ee7abfdf-8181-4118-ba10-d36fef9ed9d1-kube-rbac-proxy-cm") pod "insights-runtime-extractor-l8hv5" (UID: "ee7abfdf-8181-4118-ba10-d36fef9ed9d1") : configmap "kube-rbac-proxy" not found
Jul 15 15:36:01.924730 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:36:01.924595    2588 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 15 15:36:01.924730 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:36:01.924650    2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ee7abfdf-8181-4118-ba10-d36fef9ed9d1-insights-runtime-extractor-tls podName:ee7abfdf-8181-4118-ba10-d36fef9ed9d1 nodeName:}" failed. No retries permitted until 2026-07-15 15:36:05.924636426 +0000 UTC m=+51.576702165 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ee7abfdf-8181-4118-ba10-d36fef9ed9d1-insights-runtime-extractor-tls") pod "insights-runtime-extractor-l8hv5" (UID: "ee7abfdf-8181-4118-ba10-d36fef9ed9d1") : secret "insights-runtime-extractor-tls" not found
Jul 15 15:36:01.970152 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:01.970123    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-g8vnq_006b063d-5fd3-40f5-b898-27117973659a/migrator/0.log"
Jul 15 15:36:02.168326 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:02.168292    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-g8vnq_006b063d-5fd3-40f5-b898-27117973659a/graceful-termination/0.log"
Jul 15 15:36:02.370652 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:02.370620    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-799cb7f958-pxkjb_32207a22-c82a-4d3b-a044-aa9899bcdf2d/kube-storage-version-migrator-operator/0.log"
Jul 15 15:36:05.149112 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:05.149085    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/2e7ce623-e580-4213-a1fd-87e6fe2f2dfa-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-zkq4t\" (UID: \"2e7ce623-e580-4213-a1fd-87e6fe2f2dfa\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-zkq4t"
Jul 15 15:36:05.149492 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:05.149185    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/dfd89595-3f0b-4bbb-b6c3-3adff5584228-registry-tls\") pod \"image-registry-7497644dd6-r6f4x\" (UID: \"dfd89595-3f0b-4bbb-b6c3-3adff5584228\") " pod="openshift-image-registry/image-registry-7497644dd6-r6f4x"
Jul 15 15:36:05.149492 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:36:05.149223    2588 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 15 15:36:05.149492 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:36:05.149275    2588 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 15 15:36:05.149492 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:36:05.149283    2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e7ce623-e580-4213-a1fd-87e6fe2f2dfa-samples-operator-tls podName:2e7ce623-e580-4213-a1fd-87e6fe2f2dfa nodeName:}" failed. No retries permitted until 2026-07-15 15:36:21.149266464 +0000 UTC m=+66.801332202 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/2e7ce623-e580-4213-a1fd-87e6fe2f2dfa-samples-operator-tls") pod "cluster-samples-operator-65db858894-zkq4t" (UID: "2e7ce623-e580-4213-a1fd-87e6fe2f2dfa") : secret "samples-operator-tls" not found
Jul 15 15:36:05.149492 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:36:05.149285    2588 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7497644dd6-r6f4x: secret "image-registry-tls" not found
Jul 15 15:36:05.149492 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:36:05.149330    2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dfd89595-3f0b-4bbb-b6c3-3adff5584228-registry-tls podName:dfd89595-3f0b-4bbb-b6c3-3adff5584228 nodeName:}" failed. No retries permitted until 2026-07-15 15:36:21.149319219 +0000 UTC m=+66.801384957 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/dfd89595-3f0b-4bbb-b6c3-3adff5584228-registry-tls") pod "image-registry-7497644dd6-r6f4x" (UID: "dfd89595-3f0b-4bbb-b6c3-3adff5584228") : secret "image-registry-tls" not found
Jul 15 15:36:05.249998 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:05.249971    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7f8686f6-7e33-4c8e-91fe-d5fabf84906a-service-ca-bundle\") pod \"router-default-6b6d8f8b7b-mrtkd\" (UID: \"7f8686f6-7e33-4c8e-91fe-d5fabf84906a\") " pod="openshift-ingress/router-default-6b6d8f8b7b-mrtkd"
Jul 15 15:36:05.250152 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:05.250038    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/c80ed5cd-4b7c-4981-95c6-a02cf058f709-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-lbdlp\" (UID: \"c80ed5cd-4b7c-4981-95c6-a02cf058f709\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-lbdlp"
Jul 15 15:36:05.250152 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:05.250075    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7f8686f6-7e33-4c8e-91fe-d5fabf84906a-metrics-certs\") pod \"router-default-6b6d8f8b7b-mrtkd\" (UID: \"7f8686f6-7e33-4c8e-91fe-d5fabf84906a\") " pod="openshift-ingress/router-default-6b6d8f8b7b-mrtkd"
Jul 15 15:36:05.250152 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:36:05.250127    2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7f8686f6-7e33-4c8e-91fe-d5fabf84906a-service-ca-bundle podName:7f8686f6-7e33-4c8e-91fe-d5fabf84906a nodeName:}" failed. No retries permitted until 2026-07-15 15:36:21.250109914 +0000 UTC m=+66.902175665 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/7f8686f6-7e33-4c8e-91fe-d5fabf84906a-service-ca-bundle") pod "router-default-6b6d8f8b7b-mrtkd" (UID: "7f8686f6-7e33-4c8e-91fe-d5fabf84906a") : configmap references non-existent config key: service-ca.crt
Jul 15 15:36:05.250310 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:36:05.250173    2588 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 15 15:36:05.250310 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:05.250194    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5ae097ff-d3b5-4962-afef-f78b9b65ccaa-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-sksmh\" (UID: \"5ae097ff-d3b5-4962-afef-f78b9b65ccaa\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-sksmh"
Jul 15 15:36:05.250310 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:36:05.250215    2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c80ed5cd-4b7c-4981-95c6-a02cf058f709-cluster-monitoring-operator-tls podName:c80ed5cd-4b7c-4981-95c6-a02cf058f709 nodeName:}" failed. No retries permitted until 2026-07-15 15:36:21.250202984 +0000 UTC m=+66.902268724 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/c80ed5cd-4b7c-4981-95c6-a02cf058f709-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-lbdlp" (UID: "c80ed5cd-4b7c-4981-95c6-a02cf058f709") : secret "cluster-monitoring-operator-tls" not found
Jul 15 15:36:05.250310 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:36:05.250253    2588 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 15 15:36:05.250310 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:36:05.250173    2588 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 15 15:36:05.250310 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:36:05.250289    2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5ae097ff-d3b5-4962-afef-f78b9b65ccaa-networking-console-plugin-cert podName:5ae097ff-d3b5-4962-afef-f78b9b65ccaa nodeName:}" failed. No retries permitted until 2026-07-15 15:36:21.250278195 +0000 UTC m=+66.902343946 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/5ae097ff-d3b5-4962-afef-f78b9b65ccaa-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-sksmh" (UID: "5ae097ff-d3b5-4962-afef-f78b9b65ccaa") : secret "networking-console-plugin-cert" not found
Jul 15 15:36:05.250554 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:36:05.250396    2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f8686f6-7e33-4c8e-91fe-d5fabf84906a-metrics-certs podName:7f8686f6-7e33-4c8e-91fe-d5fabf84906a nodeName:}" failed. No retries permitted until 2026-07-15 15:36:21.250376253 +0000 UTC m=+66.902441993 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7f8686f6-7e33-4c8e-91fe-d5fabf84906a-metrics-certs") pod "router-default-6b6d8f8b7b-mrtkd" (UID: "7f8686f6-7e33-4c8e-91fe-d5fabf84906a") : secret "router-metrics-certs-default" not found
Jul 15 15:36:05.350724 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:05.350698    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3856ae8d-74b3-4640-ac17-8800509097a6-metrics-tls\") pod \"dns-default-btdcp\" (UID: \"3856ae8d-74b3-4640-ac17-8800509097a6\") " pod="openshift-dns/dns-default-btdcp"
Jul 15 15:36:05.350864 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:36:05.350842    2588 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 15 15:36:05.350928 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:36:05.350896    2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3856ae8d-74b3-4640-ac17-8800509097a6-metrics-tls podName:3856ae8d-74b3-4640-ac17-8800509097a6 nodeName:}" failed. No retries permitted until 2026-07-15 15:36:21.35088119 +0000 UTC m=+67.002946944 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3856ae8d-74b3-4640-ac17-8800509097a6-metrics-tls") pod "dns-default-btdcp" (UID: "3856ae8d-74b3-4640-ac17-8800509097a6") : secret "dns-default-metrics-tls" not found
Jul 15 15:36:05.956852 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:05.956819    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ee7abfdf-8181-4118-ba10-d36fef9ed9d1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-l8hv5\" (UID: \"ee7abfdf-8181-4118-ba10-d36fef9ed9d1\") " pod="openshift-insights/insights-runtime-extractor-l8hv5"
Jul 15 15:36:05.957013 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:05.956900    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ee7abfdf-8181-4118-ba10-d36fef9ed9d1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-l8hv5\" (UID: \"ee7abfdf-8181-4118-ba10-d36fef9ed9d1\") " pod="openshift-insights/insights-runtime-extractor-l8hv5"
Jul 15 15:36:05.957055 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:36:05.957034    2588 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 15 15:36:05.957106 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:36:05.957095    2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ee7abfdf-8181-4118-ba10-d36fef9ed9d1-insights-runtime-extractor-tls podName:ee7abfdf-8181-4118-ba10-d36fef9ed9d1 nodeName:}" failed. No retries permitted until 2026-07-15 15:36:13.957079499 +0000 UTC m=+59.609145236 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ee7abfdf-8181-4118-ba10-d36fef9ed9d1-insights-runtime-extractor-tls") pod "insights-runtime-extractor-l8hv5" (UID: "ee7abfdf-8181-4118-ba10-d36fef9ed9d1") : secret "insights-runtime-extractor-tls" not found
Jul 15 15:36:05.957427 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:05.957409    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ee7abfdf-8181-4118-ba10-d36fef9ed9d1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-l8hv5\" (UID: \"ee7abfdf-8181-4118-ba10-d36fef9ed9d1\") " pod="openshift-insights/insights-runtime-extractor-l8hv5"
Jul 15 15:36:14.030814 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:14.030771    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ee7abfdf-8181-4118-ba10-d36fef9ed9d1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-l8hv5\" (UID: \"ee7abfdf-8181-4118-ba10-d36fef9ed9d1\") " pod="openshift-insights/insights-runtime-extractor-l8hv5"
Jul 15 15:36:14.033080 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:14.033055    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ee7abfdf-8181-4118-ba10-d36fef9ed9d1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-l8hv5\" (UID: \"ee7abfdf-8181-4118-ba10-d36fef9ed9d1\") " pod="openshift-insights/insights-runtime-extractor-l8hv5"
Jul 15 15:36:14.080269 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:14.080244    2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-dthn7"
Jul 15 15:36:14.134494 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:14.134467    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-l8hv5"
Jul 15 15:36:14.259941 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:14.259917    2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-l8hv5"]
Jul 15 15:36:14.262276 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:36:14.262253    2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee7abfdf_8181_4118_ba10_d36fef9ed9d1.slice/crio-0198ea47f0c5367fea3a85d7654ee7c8a5e77a955959f226be05cae7e36cc06f WatchSource:0}: Error finding container 0198ea47f0c5367fea3a85d7654ee7c8a5e77a955959f226be05cae7e36cc06f: Status 404 returned error can't find the container with id 0198ea47f0c5367fea3a85d7654ee7c8a5e77a955959f226be05cae7e36cc06f
Jul 15 15:36:15.224280 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:15.224245    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-l8hv5" event={"ID":"ee7abfdf-8181-4118-ba10-d36fef9ed9d1","Type":"ContainerStarted","Data":"0198ea47f0c5367fea3a85d7654ee7c8a5e77a955959f226be05cae7e36cc06f"}
Jul 15 15:36:16.905075 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:16.905044    2588 scope.go:117] "RemoveContainer" containerID="d5f71209a5d7f9ad628cbb9106326894e1f69a8135aa0af21a8db1dd52e77d46"
Jul 15 15:36:17.233993 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:17.233929    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-qcvqk_eb866034-d7d1-4bee-b8b7-616b355d371d/console-operator/1.log"
Jul 15 15:36:17.234142 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:17.233996    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-qcvqk" event={"ID":"eb866034-d7d1-4bee-b8b7-616b355d371d","Type":"ContainerStarted","Data":"4801e5e09c4badd1f8169176e85c15e3650f0fe793ca9bc2965b5e9dd4c619c5"}
Jul 15 15:36:17.234424 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:17.234394    2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-qcvqk"
Jul 15 15:36:17.255979 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:17.255933    2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-7866497494-qcvqk" podStartSLOduration=35.391188135 podStartE2EDuration="42.255916644s" totalImagesPullingTime="6.864728509s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 15:35:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:36:17.254287138 +0000 UTC m=+62.906352942" watchObservedRunningTime="2026-07-15 15:36:17.255916644 +0000 UTC m=+62.907982402"
Jul 15 15:36:17.343020 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:17.342981    2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-7866497494-qcvqk"
Jul 15 15:36:20.590159 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:20.590115    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0b8fbcd1-d8ee-49e6-bdf0-6818a2754992-metrics-certs\") pod \"network-metrics-daemon-5xbsg\" (UID: \"0b8fbcd1-d8ee-49e6-bdf0-6818a2754992\") " pod="openshift-multus/network-metrics-daemon-5xbsg"
Jul 15 15:36:20.590523 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:20.590183    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wh2pb\" (UniqueName: \"kubernetes.io/projected/0383c465-26ac-4666-9180-4298272af4c7-kube-api-access-wh2pb\") pod \"network-check-target-fgm54\" (UID: \"0383c465-26ac-4666-9180-4298272af4c7\") " pod="openshift-network-diagnostics/network-check-target-fgm54"
Jul 15 15:36:20.590523 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:20.590216    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/542b7772-fe16-4f43-b9fb-e0d1538c5134-original-pull-secret\") pod \"global-pull-secret-syncer-n4kpw\" (UID: \"542b7772-fe16-4f43-b9fb-e0d1538c5134\") " pod="kube-system/global-pull-secret-syncer-n4kpw"
Jul 15 15:36:20.592539 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:20.592521    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wh2pb\" (UniqueName: \"kubernetes.io/projected/0383c465-26ac-4666-9180-4298272af4c7-kube-api-access-wh2pb\") pod \"network-check-target-fgm54\" (UID: \"0383c465-26ac-4666-9180-4298272af4c7\") " pod="openshift-network-diagnostics/network-check-target-fgm54"
Jul 15 15:36:20.593076 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:20.593058    2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 15 15:36:20.593132 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:20.593093    2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 15 15:36:20.602451 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:20.602398    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0b8fbcd1-d8ee-49e6-bdf0-6818a2754992-metrics-certs\") pod \"network-metrics-daemon-5xbsg\" (UID: \"0b8fbcd1-d8ee-49e6-bdf0-6818a2754992\") " pod="openshift-multus/network-metrics-daemon-5xbsg"
Jul 15 15:36:20.602524 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:20.602500    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/542b7772-fe16-4f43-b9fb-e0d1538c5134-original-pull-secret\") pod \"global-pull-secret-syncer-n4kpw\" (UID: \"542b7772-fe16-4f43-b9fb-e0d1538c5134\") " pod="kube-system/global-pull-secret-syncer-n4kpw"
Jul 15 15:36:20.820004 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:20.819973    2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-xhclp\""
Jul 15 15:36:20.826442 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:20.826418    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n4kpw"
Jul 15 15:36:20.827491 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:20.827474    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fgm54"
Jul 15 15:36:20.835075 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:20.835059    2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-89d92\""
Jul 15 15:36:20.843038 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:20.843025    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5xbsg"
Jul 15 15:36:20.990455 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:20.990375    2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-n4kpw"]
Jul 15 15:36:20.994629 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:36:20.994496    2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod542b7772_fe16_4f43_b9fb_e0d1538c5134.slice/crio-7d8df4a84e632d0c0c9a5f3c9202d2d5e1a35a3628166bdeca5df090d112ecf7 WatchSource:0}: Error finding container 7d8df4a84e632d0c0c9a5f3c9202d2d5e1a35a3628166bdeca5df090d112ecf7: Status 404 returned error can't find the container with id 7d8df4a84e632d0c0c9a5f3c9202d2d5e1a35a3628166bdeca5df090d112ecf7
Jul 15 15:36:21.013118 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:21.013057    2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-fgm54"]
Jul 15 15:36:21.015573 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:36:21.015535    2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0383c465_26ac_4666_9180_4298272af4c7.slice/crio-0ffbe2f5d7353ece35a51847f95eb1b3d243086aa58cc62583e2f5ebf984d837 WatchSource:0}: Error finding container 0ffbe2f5d7353ece35a51847f95eb1b3d243086aa58cc62583e2f5ebf984d837: Status 404 returned error can't find the container with id 0ffbe2f5d7353ece35a51847f95eb1b3d243086aa58cc62583e2f5ebf984d837
Jul 15 15:36:21.031536 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:21.031507    2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-5xbsg"]
Jul 15 15:36:21.034661 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:36:21.034635    2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b8fbcd1_d8ee_49e6_bdf0_6818a2754992.slice/crio-a395269e5d26922aeae4334333c48a6219d549afef4d80eeed1eeada7173b28f WatchSource:0}: Error finding container a395269e5d26922aeae4334333c48a6219d549afef4d80eeed1eeada7173b28f: Status 404 returned error can't find the container with id a395269e5d26922aeae4334333c48a6219d549afef4d80eeed1eeada7173b28f
Jul 15 15:36:21.195538 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:21.195459    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/2e7ce623-e580-4213-a1fd-87e6fe2f2dfa-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-zkq4t\" (UID: \"2e7ce623-e580-4213-a1fd-87e6fe2f2dfa\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-zkq4t"
Jul 15 15:36:21.195700 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:21.195589    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/dfd89595-3f0b-4bbb-b6c3-3adff5584228-registry-tls\") pod \"image-registry-7497644dd6-r6f4x\" (UID: \"dfd89595-3f0b-4bbb-b6c3-3adff5584228\") " pod="openshift-image-registry/image-registry-7497644dd6-r6f4x"
Jul 15 15:36:21.198206 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:21.198177    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/dfd89595-3f0b-4bbb-b6c3-3adff5584228-registry-tls\") pod \"image-registry-7497644dd6-r6f4x\" (UID: \"dfd89595-3f0b-4bbb-b6c3-3adff5584228\") " pod="openshift-image-registry/image-registry-7497644dd6-r6f4x"
Jul 15 15:36:21.198431 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:21.198412    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/2e7ce623-e580-4213-a1fd-87e6fe2f2dfa-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-zkq4t\" (UID: \"2e7ce623-e580-4213-a1fd-87e6fe2f2dfa\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-zkq4t"
Jul 15 15:36:21.250006 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:21.249972    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-l8hv5" event={"ID":"ee7abfdf-8181-4118-ba10-d36fef9ed9d1","Type":"ContainerStarted","Data":"914a13ae4884ec90a00753f194f3d94c2cd297764fa5834cf43a7f0ae6eeeaa4"}
Jul 15 15:36:21.251675 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:21.251638    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-fgm54" event={"ID":"0383c465-26ac-4666-9180-4298272af4c7","Type":"ContainerStarted","Data":"3d99581e6c9e71739e56999218150ebd8d7988637538efb76922a5f4e60bc515"}
Jul 15 15:36:21.251770 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:21.251680    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-fgm54" event={"ID":"0383c465-26ac-4666-9180-4298272af4c7","Type":"ContainerStarted","Data":"0ffbe2f5d7353ece35a51847f95eb1b3d243086aa58cc62583e2f5ebf984d837"}
Jul 15 15:36:21.251770 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:21.251720    2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-fgm54"
Jul 15 15:36:21.253057 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:21.253033    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-n4kpw" event={"ID":"542b7772-fe16-4f43-b9fb-e0d1538c5134","Type":"ContainerStarted","Data":"7d8df4a84e632d0c0c9a5f3c9202d2d5e1a35a3628166bdeca5df090d112ecf7"}
Jul 15 15:36:21.254181 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:21.254161    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-5xbsg" event={"ID":"0b8fbcd1-d8ee-49e6-bdf0-6818a2754992","Type":"ContainerStarted","Data":"a395269e5d26922aeae4334333c48a6219d549afef4d80eeed1eeada7173b28f"}
Jul 15 15:36:21.269980 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:21.269939    2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-fgm54" podStartSLOduration=66.2699243 podStartE2EDuration="1m6.2699243s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 15:35:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:36:21.269188497 +0000 UTC m=+66.921254262" watchObservedRunningTime="2026-07-15 15:36:21.2699243 +0000 UTC m=+66.921990058"
Jul 15 15:36:21.295974 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:21.295948    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/c80ed5cd-4b7c-4981-95c6-a02cf058f709-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-lbdlp\" (UID: \"c80ed5cd-4b7c-4981-95c6-a02cf058f709\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-lbdlp"
Jul 15 15:36:21.296084 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:21.295985    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7f8686f6-7e33-4c8e-91fe-d5fabf84906a-metrics-certs\") pod \"router-default-6b6d8f8b7b-mrtkd\" (UID: \"7f8686f6-7e33-4c8e-91fe-d5fabf84906a\") " pod="openshift-ingress/router-default-6b6d8f8b7b-mrtkd"
Jul 15 15:36:21.296084 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:21.296009    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5ae097ff-d3b5-4962-afef-f78b9b65ccaa-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-sksmh\" (UID: \"5ae097ff-d3b5-4962-afef-f78b9b65ccaa\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-sksmh"
Jul 15 15:36:21.296084 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:21.296072    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7f8686f6-7e33-4c8e-91fe-d5fabf84906a-service-ca-bundle\") pod \"router-default-6b6d8f8b7b-mrtkd\" (UID: \"7f8686f6-7e33-4c8e-91fe-d5fabf84906a\") " pod="openshift-ingress/router-default-6b6d8f8b7b-mrtkd"
Jul 15 15:36:21.296779 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:21.296756    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7f8686f6-7e33-4c8e-91fe-d5fabf84906a-service-ca-bundle\") pod \"router-default-6b6d8f8b7b-mrtkd\" (UID: \"7f8686f6-7e33-4c8e-91fe-d5fabf84906a\") " pod="openshift-ingress/router-default-6b6d8f8b7b-mrtkd"
Jul 15 15:36:21.298500 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:21.298481    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5ae097ff-d3b5-4962-afef-f78b9b65ccaa-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-sksmh\" (UID: \"5ae097ff-d3b5-4962-afef-f78b9b65ccaa\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-sksmh"
Jul 15 15:36:21.298633 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:21.298613    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/c80ed5cd-4b7c-4981-95c6-a02cf058f709-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-lbdlp\" (UID: \"c80ed5cd-4b7c-4981-95c6-a02cf058f709\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-lbdlp"
Jul 15 15:36:21.298688 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:21.298641    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7f8686f6-7e33-4c8e-91fe-d5fabf84906a-metrics-certs\") pod \"router-default-6b6d8f8b7b-mrtkd\" (UID: \"7f8686f6-7e33-4c8e-91fe-d5fabf84906a\") " pod="openshift-ingress/router-default-6b6d8f8b7b-mrtkd"
Jul 15 15:36:21.386250 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:21.386217    2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-x97q5\""
Jul 15 15:36:21.394584 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:21.394562    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-zkq4t"
Jul 15 15:36:21.396616 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:21.396352    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3856ae8d-74b3-4640-ac17-8800509097a6-metrics-tls\") pod \"dns-default-btdcp\" (UID: \"3856ae8d-74b3-4640-ac17-8800509097a6\") " pod="openshift-dns/dns-default-btdcp"
Jul 15 15:36:21.398634 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:21.398613    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3856ae8d-74b3-4640-ac17-8800509097a6-metrics-tls\") pod \"dns-default-btdcp\" (UID: \"3856ae8d-74b3-4640-ac17-8800509097a6\") " pod="openshift-dns/dns-default-btdcp"
Jul 15 15:36:21.411332 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:21.411311    2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-b5ggf\""
Jul 15 15:36:21.418734 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:21.418714    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7497644dd6-r6f4x"
Jul 15 15:36:21.438609 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:21.438494    2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-txrmq\""
Jul 15 15:36:21.446322 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:21.446207    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cf856758c-sksmh"
Jul 15 15:36:21.470968 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:21.470881    2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-bl25x\""
Jul 15 15:36:21.478572 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:21.478531    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-lbdlp"
Jul 15 15:36:21.493861 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:21.493644    2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-8d9bl\""
Jul 15 15:36:21.502365 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:21.502060    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6b6d8f8b7b-mrtkd"
Jul 15 15:36:21.563190 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:21.563138    2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-dq8c7\""
Jul 15 15:36:21.565713 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:21.565643    2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-zkq4t"]
Jul 15 15:36:21.568718 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:21.567677    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-btdcp"
Jul 15 15:36:21.639142 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:21.639070    2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7497644dd6-r6f4x"]
Jul 15 15:36:21.653877 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:21.649504    2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-sksmh"]
Jul 15 15:36:21.734068 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:21.733974    2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-lbdlp"]
Jul 15 15:36:21.737806 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:21.737735    2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6b6d8f8b7b-mrtkd"]
Jul 15 15:36:21.739273 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:36:21.739224    2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc80ed5cd_4b7c_4981_95c6_a02cf058f709.slice/crio-fcb00186c85ae1e4465ce3c7cccec52de33b179a2c93ee79bf5442a5890b6cab WatchSource:0}: Error finding container fcb00186c85ae1e4465ce3c7cccec52de33b179a2c93ee79bf5442a5890b6cab: Status 404 returned error can't find the container with id fcb00186c85ae1e4465ce3c7cccec52de33b179a2c93ee79bf5442a5890b6cab
Jul 15 15:36:21.747180 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:36:21.746935    2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f8686f6_7e33_4c8e_91fe_d5fabf84906a.slice/crio-504f65dfcce8a019e09b8929bda3b58ea427f23a51cfddab56a8a03416e08a36 WatchSource:0}: Error finding container 504f65dfcce8a019e09b8929bda3b58ea427f23a51cfddab56a8a03416e08a36: Status 404 returned error can't find the container with id 504f65dfcce8a019e09b8929bda3b58ea427f23a51cfddab56a8a03416e08a36
Jul 15 15:36:21.796395 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:21.796369    2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-btdcp"]
Jul 15 15:36:21.799496 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:36:21.799466    2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3856ae8d_74b3_4640_ac17_8800509097a6.slice/crio-27706b765471001c34387990de9692cf995f3ae32a13980bc1f971dfc9062993 WatchSource:0}: Error finding container 27706b765471001c34387990de9692cf995f3ae32a13980bc1f971dfc9062993: Status 404 returned error can't find the container with id 27706b765471001c34387990de9692cf995f3ae32a13980bc1f971dfc9062993
Jul 15 15:36:22.264596 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:22.264534    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6b6d8f8b7b-mrtkd" event={"ID":"7f8686f6-7e33-4c8e-91fe-d5fabf84906a","Type":"ContainerStarted","Data":"9c3741a674be159fd8c678683a57112a303c7182ae8f6865f46c487cb03715f3"}
Jul 15 15:36:22.264869 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:22.264610    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6b6d8f8b7b-mrtkd" event={"ID":"7f8686f6-7e33-4c8e-91fe-d5fabf84906a","Type":"ContainerStarted","Data":"504f65dfcce8a019e09b8929bda3b58ea427f23a51cfddab56a8a03416e08a36"}
Jul 15 15:36:22.267326 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:22.267253    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6cf856758c-sksmh" event={"ID":"5ae097ff-d3b5-4962-afef-f78b9b65ccaa","Type":"ContainerStarted","Data":"ba5eaf2b269fda6fd00d006d240ada853097de21c9c410de2508307b7b712456"}
Jul 15 15:36:22.270762 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:22.270691    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-lbdlp" event={"ID":"c80ed5cd-4b7c-4981-95c6-a02cf058f709","Type":"ContainerStarted","Data":"fcb00186c85ae1e4465ce3c7cccec52de33b179a2c93ee79bf5442a5890b6cab"}
Jul 15 15:36:22.274163 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:22.274139    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7497644dd6-r6f4x" event={"ID":"dfd89595-3f0b-4bbb-b6c3-3adff5584228","Type":"ContainerStarted","Data":"cb87213abea4c2b0733e245df8dbc850a141196e172136941ea63087856b0d38"}
Jul 15 15:36:22.274262 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:22.274183    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7497644dd6-r6f4x" event={"ID":"dfd89595-3f0b-4bbb-b6c3-3adff5584228","Type":"ContainerStarted","Data":"fdd42e2c6fcacfa9517444cbcb2d9c9bf63aa888cdc4c58a7b9b0880bdbb241e"}
Jul 15 15:36:22.274793 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:22.274746    2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7497644dd6-r6f4x"
Jul 15 15:36:22.278728 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:22.278664    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-zkq4t" event={"ID":"2e7ce623-e580-4213-a1fd-87e6fe2f2dfa","Type":"ContainerStarted","Data":"2150114f471343486409ab938a29170347bc915c934c12eddf37a5b3521d7053"}
Jul 15 15:36:22.282236 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:22.282186    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-btdcp" event={"ID":"3856ae8d-74b3-4640-ac17-8800509097a6","Type":"ContainerStarted","Data":"27706b765471001c34387990de9692cf995f3ae32a13980bc1f971dfc9062993"}
Jul 15 15:36:22.334361 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:22.331082    2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7497644dd6-r6f4x" podStartSLOduration=67.331057652 podStartE2EDuration="1m7.331057652s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 15:35:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:36:22.327427674 +0000 UTC m=+67.979493452" watchObservedRunningTime="2026-07-15 15:36:22.331057652 +0000 UTC m=+67.983123404"
Jul 15 15:36:22.334361 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:22.332743    2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-6b6d8f8b7b-mrtkd" podStartSLOduration=47.332728935 podStartE2EDuration="47.332728935s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 15:35:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:36:22.293404096 +0000 UTC m=+67.945469866" watchObservedRunningTime="2026-07-15 15:36:22.332728935 +0000 UTC m=+67.984794695"
Jul 15 15:36:22.503376 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:22.503256    2588 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-6b6d8f8b7b-mrtkd"
Jul 15 15:36:22.506467 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:22.506227    2588 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-6b6d8f8b7b-mrtkd"
Jul 15 15:36:23.291587 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:23.291445    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-5xbsg" event={"ID":"0b8fbcd1-d8ee-49e6-bdf0-6818a2754992","Type":"ContainerStarted","Data":"9840731e3af60dc0a7d7880ab394d8cb3bda9cfd8e7218672f770f3e96077d03"}
Jul 15 15:36:23.292266 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:23.292243    2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-6b6d8f8b7b-mrtkd"
Jul 15 15:36:23.293539 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:23.293517    2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-6b6d8f8b7b-mrtkd"
Jul 15 15:36:24.297560 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:24.297518    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-5xbsg" event={"ID":"0b8fbcd1-d8ee-49e6-bdf0-6818a2754992","Type":"ContainerStarted","Data":"920bfae5c29f71f64de4763cbc3ea473ae05cad370069c28761622dc10564851"}
Jul 15 15:36:24.299398 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:24.299366    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6cf856758c-sksmh" event={"ID":"5ae097ff-d3b5-4962-afef-f78b9b65ccaa","Type":"ContainerStarted","Data":"50f18500f8a9f8cf0a68e3758ba5fe2e1297f9a5722adf2b547af9ebd5a979b0"}
Jul 15 15:36:24.338198 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:24.338147    2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-5xbsg" podStartSLOduration=67.910217572 podStartE2EDuration="1m9.338128289s" totalImagesPullingTime="1.427910717s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 15:35:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:36:24.337674002 +0000 UTC m=+69.989739790" watchObservedRunningTime="2026-07-15 15:36:24.338128289 +0000 UTC m=+69.990194050"
Jul 15 15:36:24.365174 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:24.365116    2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6cf856758c-sksmh" podStartSLOduration=47.672619054 podStartE2EDuration="49.365102143s" totalImagesPullingTime="1.692483089s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 15:35:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:36:24.364184136 +0000 UTC m=+70.016249897" watchObservedRunningTime="2026-07-15 15:36:24.365102143 +0000 UTC m=+70.017167913"
Jul 15 15:36:29.321331 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:29.321301    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-n4kpw" event={"ID":"542b7772-fe16-4f43-b9fb-e0d1538c5134","Type":"ContainerStarted","Data":"364c8b2abd99f3ea7d69450a6b5a95e308fb768e1f00ea80c387ca0a66019a97"}
Jul 15 15:36:29.323517 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:29.323454    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-zkq4t" event={"ID":"2e7ce623-e580-4213-a1fd-87e6fe2f2dfa","Type":"ContainerStarted","Data":"22201c9a6ebe167855bc33d30de706d60d5be2224193a4ab2af96ab971725dea"}
Jul 15 15:36:29.326120 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:29.326054    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-btdcp" event={"ID":"3856ae8d-74b3-4640-ac17-8800509097a6","Type":"ContainerStarted","Data":"a206b0c2960460aa9d0085bf92d1cd644e4fb902c8d9d5229c988b6d35f9bfa1"}
Jul 15 15:36:29.329503 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:29.329476    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-lbdlp" event={"ID":"c80ed5cd-4b7c-4981-95c6-a02cf058f709","Type":"ContainerStarted","Data":"7d7add77924189b499dda94e0a316cef02c431f2e32d07a507a26c617dfefb05"}
Jul 15 15:36:29.388947 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:29.388895    2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-n4kpw" podStartSLOduration=66.414216309 podStartE2EDuration="1m14.388875779s" totalImagesPullingTime="7.97465947s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 15:35:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:36:29.36057154 +0000 UTC m=+75.012637317" watchObservedRunningTime="2026-07-15 15:36:29.388875779 +0000 UTC m=+75.040941541"
Jul 15 15:36:29.389704 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:29.389670    2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-lbdlp" podStartSLOduration=47.213206996 podStartE2EDuration="54.38965957s" totalImagesPullingTime="7.176452574s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 15:35:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:36:29.388297623 +0000 UTC m=+75.040363383" watchObservedRunningTime="2026-07-15 15:36:29.38965957 +0000 UTC m=+75.041725330"
Jul 15 15:36:30.336778 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:30.336742    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-btdcp" event={"ID":"3856ae8d-74b3-4640-ac17-8800509097a6","Type":"ContainerStarted","Data":"e4c3e2c1890628318654c193218141627d98d4ef9ee8093edd59456c0de7c298"}
Jul 15 15:36:30.337223 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:30.336937    2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-btdcp"
Jul 15 15:36:30.338691 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:30.338662    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-l8hv5" event={"ID":"ee7abfdf-8181-4118-ba10-d36fef9ed9d1","Type":"ContainerStarted","Data":"c0481b85e02358ac52a25216ae5d76036798be80c9c57289871ab53386fed658"}
Jul 15 15:36:30.340649 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:30.340626    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-zkq4t" event={"ID":"2e7ce623-e580-4213-a1fd-87e6fe2f2dfa","Type":"ContainerStarted","Data":"606c02ae2656a97c6ecc169b19db09d0a1cd34f6f9ff9503b3a482f914765936"}
Jul 15 15:36:30.364304 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:30.364249    2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-btdcp" podStartSLOduration=34.247029787 podStartE2EDuration="41.364235112s" totalImagesPullingTime="7.117205325s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 15:35:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:36:30.362676916 +0000 UTC m=+76.014742698" watchObservedRunningTime="2026-07-15 15:36:30.364235112 +0000 UTC m=+76.016300870"
Jul 15 15:36:30.384793 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:30.384742    2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-zkq4t" podStartSLOduration=48.112147171 podStartE2EDuration="55.384725206s" totalImagesPullingTime="7.272578035s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 15:35:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:36:30.383776962 +0000 UTC m=+76.035842742" watchObservedRunningTime="2026-07-15 15:36:30.384725206 +0000 UTC m=+76.036790966"
Jul 15 15:36:33.353620 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:33.353591    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-l8hv5" event={"ID":"ee7abfdf-8181-4118-ba10-d36fef9ed9d1","Type":"ContainerStarted","Data":"ea59b8ccf81045710c4deefe6ceb910fba84421e28d8c80717ee801816040891"}
Jul 15 15:36:33.381548 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:33.381491    2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-l8hv5" podStartSLOduration=16.624466449 podStartE2EDuration="35.381474868s" totalImagesPullingTime="18.757008419s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 15:35:58 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:36:33.379451108 +0000 UTC m=+79.031516885" watchObservedRunningTime="2026-07-15 15:36:33.381474868 +0000 UTC m=+79.033540672"
Jul 15 15:36:40.346151 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:40.346036    2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-btdcp"
Jul 15 15:36:43.873063 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:43.873021    2588 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7497644dd6-r6f4x"]
Jul 15 15:36:43.877335 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:43.877311    2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7497644dd6-r6f4x"
Jul 15 15:36:52.285124 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:52.285090    2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-fgm54"
Jul 15 15:36:53.099169 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:53.099140    2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-fgfgf"]
Jul 15 15:36:53.115060 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:53.114355    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-fgfgf"
Jul 15 15:36:53.117664 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:53.117631    2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 15 15:36:53.117664 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:53.117652    2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 15 15:36:53.117866 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:53.117647    2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-kf856\""
Jul 15 15:36:53.117866 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:53.117652    2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 15 15:36:53.118803 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:53.118786    2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 15 15:36:53.156017 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:53.155992    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4b8da0b7-32e1-4251-9a9c-60b530dab461-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-fgfgf\" (UID: \"4b8da0b7-32e1-4251-9a9c-60b530dab461\") " pod="openshift-monitoring/node-exporter-fgfgf"
Jul 15 15:36:53.156172 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:53.156031    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fl7gq\" (UniqueName: \"kubernetes.io/projected/4b8da0b7-32e1-4251-9a9c-60b530dab461-kube-api-access-fl7gq\") pod \"node-exporter-fgfgf\" (UID: \"4b8da0b7-32e1-4251-9a9c-60b530dab461\") " pod="openshift-monitoring/node-exporter-fgfgf"
Jul 15 15:36:53.156172 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:53.156059    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4b8da0b7-32e1-4251-9a9c-60b530dab461-node-exporter-tls\") pod \"node-exporter-fgfgf\" (UID: \"4b8da0b7-32e1-4251-9a9c-60b530dab461\") " pod="openshift-monitoring/node-exporter-fgfgf"
Jul 15 15:36:53.156172 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:53.156078    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4b8da0b7-32e1-4251-9a9c-60b530dab461-metrics-client-ca\") pod \"node-exporter-fgfgf\" (UID: \"4b8da0b7-32e1-4251-9a9c-60b530dab461\") " pod="openshift-monitoring/node-exporter-fgfgf"
Jul 15 15:36:53.156172 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:53.156105    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/4b8da0b7-32e1-4251-9a9c-60b530dab461-node-exporter-accelerators-collector-config\") pod \"node-exporter-fgfgf\" (UID: \"4b8da0b7-32e1-4251-9a9c-60b530dab461\") " pod="openshift-monitoring/node-exporter-fgfgf"
Jul 15 15:36:53.156374 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:53.156189    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4b8da0b7-32e1-4251-9a9c-60b530dab461-node-exporter-wtmp\") pod \"node-exporter-fgfgf\" (UID: \"4b8da0b7-32e1-4251-9a9c-60b530dab461\") " pod="openshift-monitoring/node-exporter-fgfgf"
Jul 15 15:36:53.156374 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:53.156245    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4b8da0b7-32e1-4251-9a9c-60b530dab461-root\") pod \"node-exporter-fgfgf\" (UID: \"4b8da0b7-32e1-4251-9a9c-60b530dab461\") " pod="openshift-monitoring/node-exporter-fgfgf"
Jul 15 15:36:53.156374 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:53.156263    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4b8da0b7-32e1-4251-9a9c-60b530dab461-node-exporter-textfile\") pod \"node-exporter-fgfgf\" (UID: \"4b8da0b7-32e1-4251-9a9c-60b530dab461\") " pod="openshift-monitoring/node-exporter-fgfgf"
Jul 15 15:36:53.156374 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:53.156289    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4b8da0b7-32e1-4251-9a9c-60b530dab461-sys\") pod \"node-exporter-fgfgf\" (UID: \"4b8da0b7-32e1-4251-9a9c-60b530dab461\") " pod="openshift-monitoring/node-exporter-fgfgf"
Jul 15 15:36:53.257185 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:53.257152    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/4b8da0b7-32e1-4251-9a9c-60b530dab461-node-exporter-accelerators-collector-config\") pod \"node-exporter-fgfgf\" (UID: \"4b8da0b7-32e1-4251-9a9c-60b530dab461\") " pod="openshift-monitoring/node-exporter-fgfgf"
Jul 15 15:36:53.257185 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:53.257184    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4b8da0b7-32e1-4251-9a9c-60b530dab461-node-exporter-wtmp\") pod \"node-exporter-fgfgf\" (UID: \"4b8da0b7-32e1-4251-9a9c-60b530dab461\") " pod="openshift-monitoring/node-exporter-fgfgf"
Jul 15 15:36:53.257456 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:53.257211    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4b8da0b7-32e1-4251-9a9c-60b530dab461-root\") pod \"node-exporter-fgfgf\" (UID: \"4b8da0b7-32e1-4251-9a9c-60b530dab461\") " pod="openshift-monitoring/node-exporter-fgfgf"
Jul 15 15:36:53.257456 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:53.257225    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4b8da0b7-32e1-4251-9a9c-60b530dab461-node-exporter-textfile\") pod \"node-exporter-fgfgf\" (UID: \"4b8da0b7-32e1-4251-9a9c-60b530dab461\") " pod="openshift-monitoring/node-exporter-fgfgf"
Jul 15 15:36:53.257456 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:53.257249    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4b8da0b7-32e1-4251-9a9c-60b530dab461-sys\") pod \"node-exporter-fgfgf\" (UID: \"4b8da0b7-32e1-4251-9a9c-60b530dab461\") " pod="openshift-monitoring/node-exporter-fgfgf"
Jul 15 15:36:53.257456 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:53.257288    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4b8da0b7-32e1-4251-9a9c-60b530dab461-root\") pod \"node-exporter-fgfgf\" (UID: \"4b8da0b7-32e1-4251-9a9c-60b530dab461\") " pod="openshift-monitoring/node-exporter-fgfgf"
Jul 15 15:36:53.257456 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:53.257293    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4b8da0b7-32e1-4251-9a9c-60b530dab461-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-fgfgf\" (UID: \"4b8da0b7-32e1-4251-9a9c-60b530dab461\") " pod="openshift-monitoring/node-exporter-fgfgf"
Jul 15 15:36:53.257456 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:53.257336    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4b8da0b7-32e1-4251-9a9c-60b530dab461-node-exporter-wtmp\") pod \"node-exporter-fgfgf\" (UID: \"4b8da0b7-32e1-4251-9a9c-60b530dab461\") " pod="openshift-monitoring/node-exporter-fgfgf"
Jul 15 15:36:53.257456 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:53.257371    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4b8da0b7-32e1-4251-9a9c-60b530dab461-sys\") pod \"node-exporter-fgfgf\" (UID: \"4b8da0b7-32e1-4251-9a9c-60b530dab461\") " pod="openshift-monitoring/node-exporter-fgfgf"
Jul 15 15:36:53.257456 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:53.257396    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fl7gq\" (UniqueName: \"kubernetes.io/projected/4b8da0b7-32e1-4251-9a9c-60b530dab461-kube-api-access-fl7gq\") pod \"node-exporter-fgfgf\" (UID: \"4b8da0b7-32e1-4251-9a9c-60b530dab461\") " pod="openshift-monitoring/node-exporter-fgfgf"
Jul 15 15:36:53.257456 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:53.257423    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4b8da0b7-32e1-4251-9a9c-60b530dab461-node-exporter-tls\") pod \"node-exporter-fgfgf\" (UID: \"4b8da0b7-32e1-4251-9a9c-60b530dab461\") " pod="openshift-monitoring/node-exporter-fgfgf"
Jul 15 15:36:53.257456 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:53.257449    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4b8da0b7-32e1-4251-9a9c-60b530dab461-metrics-client-ca\") pod \"node-exporter-fgfgf\" (UID: \"4b8da0b7-32e1-4251-9a9c-60b530dab461\") " pod="openshift-monitoring/node-exporter-fgfgf"
Jul 15 15:36:53.257852 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:36:53.257559    2588 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 15 15:36:53.257987 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:36:53.257967    2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4b8da0b7-32e1-4251-9a9c-60b530dab461-node-exporter-tls podName:4b8da0b7-32e1-4251-9a9c-60b530dab461 nodeName:}" failed. No retries permitted until 2026-07-15 15:36:53.757940561 +0000 UTC m=+99.410006352 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/4b8da0b7-32e1-4251-9a9c-60b530dab461-node-exporter-tls") pod "node-exporter-fgfgf" (UID: "4b8da0b7-32e1-4251-9a9c-60b530dab461") : secret "node-exporter-tls" not found
Jul 15 15:36:53.258141 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:53.257990    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4b8da0b7-32e1-4251-9a9c-60b530dab461-node-exporter-textfile\") pod \"node-exporter-fgfgf\" (UID: \"4b8da0b7-32e1-4251-9a9c-60b530dab461\") " pod="openshift-monitoring/node-exporter-fgfgf"
Jul 15 15:36:53.258234 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:53.258143    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/4b8da0b7-32e1-4251-9a9c-60b530dab461-node-exporter-accelerators-collector-config\") pod \"node-exporter-fgfgf\" (UID: \"4b8da0b7-32e1-4251-9a9c-60b530dab461\") " pod="openshift-monitoring/node-exporter-fgfgf"
Jul 15 15:36:53.258354 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:53.258266    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4b8da0b7-32e1-4251-9a9c-60b530dab461-metrics-client-ca\") pod \"node-exporter-fgfgf\" (UID: \"4b8da0b7-32e1-4251-9a9c-60b530dab461\") " pod="openshift-monitoring/node-exporter-fgfgf"
Jul 15 15:36:53.263751 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:53.263731    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4b8da0b7-32e1-4251-9a9c-60b530dab461-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-fgfgf\" (UID: \"4b8da0b7-32e1-4251-9a9c-60b530dab461\") " pod="openshift-monitoring/node-exporter-fgfgf"
Jul 15 15:36:53.270378 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:53.270330    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fl7gq\" (UniqueName: \"kubernetes.io/projected/4b8da0b7-32e1-4251-9a9c-60b530dab461-kube-api-access-fl7gq\") pod \"node-exporter-fgfgf\" (UID: \"4b8da0b7-32e1-4251-9a9c-60b530dab461\") " pod="openshift-monitoring/node-exporter-fgfgf"
Jul 15 15:36:53.760891 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:53.760857    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4b8da0b7-32e1-4251-9a9c-60b530dab461-node-exporter-tls\") pod \"node-exporter-fgfgf\" (UID: \"4b8da0b7-32e1-4251-9a9c-60b530dab461\") " pod="openshift-monitoring/node-exporter-fgfgf"
Jul 15 15:36:53.763261 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:53.763226    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4b8da0b7-32e1-4251-9a9c-60b530dab461-node-exporter-tls\") pod \"node-exporter-fgfgf\" (UID: \"4b8da0b7-32e1-4251-9a9c-60b530dab461\") " pod="openshift-monitoring/node-exporter-fgfgf"
Jul 15 15:36:54.023837 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:54.023763    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-fgfgf"
Jul 15 15:36:54.033524 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:36:54.033500    2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b8da0b7_32e1_4251_9a9c_60b530dab461.slice/crio-42899862553b9f47f2863ccd1ab193b2eb20f7667bf8711dcf51be0971927274 WatchSource:0}: Error finding container 42899862553b9f47f2863ccd1ab193b2eb20f7667bf8711dcf51be0971927274: Status 404 returned error can't find the container with id 42899862553b9f47f2863ccd1ab193b2eb20f7667bf8711dcf51be0971927274
Jul 15 15:36:54.156045 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:54.156016    2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 15 15:36:54.159035 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:54.159013    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 15 15:36:54.165880 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:54.165622    2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 15 15:36:54.165880 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:54.165647    2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 15 15:36:54.165880 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:54.165668    2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 15 15:36:54.165880 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:54.165679    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c8ad33d9-3444-42e2-b3eb-197a3652fb42-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"c8ad33d9-3444-42e2-b3eb-197a3652fb42\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 15:36:54.165880 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:54.165702    2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 15 15:36:54.165880 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:54.165724    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/c8ad33d9-3444-42e2-b3eb-197a3652fb42-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"c8ad33d9-3444-42e2-b3eb-197a3652fb42\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 15:36:54.165880 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:54.165671    2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 15 15:36:54.165880 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:54.165769    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c8ad33d9-3444-42e2-b3eb-197a3652fb42-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"c8ad33d9-3444-42e2-b3eb-197a3652fb42\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 15:36:54.165880 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:54.165640    2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 15 15:36:54.165880 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:54.165802    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c8ad33d9-3444-42e2-b3eb-197a3652fb42-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"c8ad33d9-3444-42e2-b3eb-197a3652fb42\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 15:36:54.165880 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:54.165812    2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-6wdg8\""
Jul 15 15:36:54.165880 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:54.165881    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c8ad33d9-3444-42e2-b3eb-197a3652fb42-web-config\") pod \"alertmanager-main-0\" (UID: \"c8ad33d9-3444-42e2-b3eb-197a3652fb42\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 15:36:54.166611 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:54.165922    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c8ad33d9-3444-42e2-b3eb-197a3652fb42-config-out\") pod \"alertmanager-main-0\" (UID: \"c8ad33d9-3444-42e2-b3eb-197a3652fb42\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 15:36:54.166611 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:54.165950    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c8ad33d9-3444-42e2-b3eb-197a3652fb42-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"c8ad33d9-3444-42e2-b3eb-197a3652fb42\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 15:36:54.166611 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:54.165982    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c8ad33d9-3444-42e2-b3eb-197a3652fb42-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"c8ad33d9-3444-42e2-b3eb-197a3652fb42\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 15:36:54.166611 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:54.166009    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c8ad33d9-3444-42e2-b3eb-197a3652fb42-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"c8ad33d9-3444-42e2-b3eb-197a3652fb42\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 15:36:54.166611 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:54.166018    2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 15 15:36:54.166611 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:54.166036    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/c8ad33d9-3444-42e2-b3eb-197a3652fb42-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"c8ad33d9-3444-42e2-b3eb-197a3652fb42\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 15:36:54.166611 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:54.166079    2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 15 15:36:54.166611 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:54.166079    2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 15 15:36:54.166611 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:54.166078    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c8ad33d9-3444-42e2-b3eb-197a3652fb42-tls-assets\") pod \"alertmanager-main-0\" (UID: \"c8ad33d9-3444-42e2-b3eb-197a3652fb42\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 15:36:54.166611 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:54.166150    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sffgh\" (UniqueName: \"kubernetes.io/projected/c8ad33d9-3444-42e2-b3eb-197a3652fb42-kube-api-access-sffgh\") pod \"alertmanager-main-0\" (UID: \"c8ad33d9-3444-42e2-b3eb-197a3652fb42\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 15:36:54.166611 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:54.166183    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c8ad33d9-3444-42e2-b3eb-197a3652fb42-config-volume\") pod \"alertmanager-main-0\" (UID: \"c8ad33d9-3444-42e2-b3eb-197a3652fb42\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 15:36:54.267081 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:54.267044    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c8ad33d9-3444-42e2-b3eb-197a3652fb42-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"c8ad33d9-3444-42e2-b3eb-197a3652fb42\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 15:36:54.267258 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:54.267093    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c8ad33d9-3444-42e2-b3eb-197a3652fb42-web-config\") pod \"alertmanager-main-0\" (UID: \"c8ad33d9-3444-42e2-b3eb-197a3652fb42\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 15:36:54.267258 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:54.267120    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c8ad33d9-3444-42e2-b3eb-197a3652fb42-config-out\") pod \"alertmanager-main-0\" (UID: \"c8ad33d9-3444-42e2-b3eb-197a3652fb42\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 15:36:54.267258 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:54.267139    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c8ad33d9-3444-42e2-b3eb-197a3652fb42-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"c8ad33d9-3444-42e2-b3eb-197a3652fb42\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 15:36:54.267258 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:54.267165    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c8ad33d9-3444-42e2-b3eb-197a3652fb42-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"c8ad33d9-3444-42e2-b3eb-197a3652fb42\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 15:36:54.267258 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:54.267189    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c8ad33d9-3444-42e2-b3eb-197a3652fb42-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"c8ad33d9-3444-42e2-b3eb-197a3652fb42\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 15:36:54.267538 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:36:54.267300    2588 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found
Jul 15 15:36:54.267538 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:36:54.267388    2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c8ad33d9-3444-42e2-b3eb-197a3652fb42-secret-alertmanager-main-tls podName:c8ad33d9-3444-42e2-b3eb-197a3652fb42 nodeName:}" failed. No retries permitted until 2026-07-15 15:36:54.767367516 +0000 UTC m=+100.419433257 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/c8ad33d9-3444-42e2-b3eb-197a3652fb42-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "c8ad33d9-3444-42e2-b3eb-197a3652fb42") : secret "alertmanager-main-tls" not found
Jul 15 15:36:54.267538 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:54.267422    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/c8ad33d9-3444-42e2-b3eb-197a3652fb42-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"c8ad33d9-3444-42e2-b3eb-197a3652fb42\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 15:36:54.267538 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:54.267467    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c8ad33d9-3444-42e2-b3eb-197a3652fb42-tls-assets\") pod \"alertmanager-main-0\" (UID: \"c8ad33d9-3444-42e2-b3eb-197a3652fb42\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 15:36:54.267538 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:54.267496    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sffgh\" (UniqueName: \"kubernetes.io/projected/c8ad33d9-3444-42e2-b3eb-197a3652fb42-kube-api-access-sffgh\") pod \"alertmanager-main-0\" (UID: \"c8ad33d9-3444-42e2-b3eb-197a3652fb42\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 15:36:54.267538 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:54.267530    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c8ad33d9-3444-42e2-b3eb-197a3652fb42-config-volume\") pod \"alertmanager-main-0\" (UID: \"c8ad33d9-3444-42e2-b3eb-197a3652fb42\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 15:36:54.267819 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:54.267568    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c8ad33d9-3444-42e2-b3eb-197a3652fb42-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"c8ad33d9-3444-42e2-b3eb-197a3652fb42\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 15:36:54.267819 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:54.267603    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/c8ad33d9-3444-42e2-b3eb-197a3652fb42-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"c8ad33d9-3444-42e2-b3eb-197a3652fb42\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 15:36:54.267819 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:54.267633    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c8ad33d9-3444-42e2-b3eb-197a3652fb42-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"c8ad33d9-3444-42e2-b3eb-197a3652fb42\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 15:36:54.267819 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:36:54.267718    2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c8ad33d9-3444-42e2-b3eb-197a3652fb42-alertmanager-trusted-ca-bundle podName:c8ad33d9-3444-42e2-b3eb-197a3652fb42 nodeName:}" failed. No retries permitted until 2026-07-15 15:36:54.76769697 +0000 UTC m=+100.419762722 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/c8ad33d9-3444-42e2-b3eb-197a3652fb42-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "c8ad33d9-3444-42e2-b3eb-197a3652fb42") : configmap references non-existent config key: ca-bundle.crt
Jul 15 15:36:54.268219 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:54.268199    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c8ad33d9-3444-42e2-b3eb-197a3652fb42-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"c8ad33d9-3444-42e2-b3eb-197a3652fb42\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 15:36:54.268702 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:54.268258    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/c8ad33d9-3444-42e2-b3eb-197a3652fb42-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"c8ad33d9-3444-42e2-b3eb-197a3652fb42\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 15:36:54.270199 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:54.270156    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c8ad33d9-3444-42e2-b3eb-197a3652fb42-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"c8ad33d9-3444-42e2-b3eb-197a3652fb42\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 15:36:54.270455 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:54.270420    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c8ad33d9-3444-42e2-b3eb-197a3652fb42-web-config\") pod \"alertmanager-main-0\" (UID: \"c8ad33d9-3444-42e2-b3eb-197a3652fb42\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 15:36:54.270701 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:54.270659    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/c8ad33d9-3444-42e2-b3eb-197a3652fb42-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"c8ad33d9-3444-42e2-b3eb-197a3652fb42\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 15:36:54.271089 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:54.271065    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c8ad33d9-3444-42e2-b3eb-197a3652fb42-tls-assets\") pod \"alertmanager-main-0\" (UID: \"c8ad33d9-3444-42e2-b3eb-197a3652fb42\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 15:36:54.271233 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:54.271216    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c8ad33d9-3444-42e2-b3eb-197a3652fb42-config-volume\") pod \"alertmanager-main-0\" (UID: \"c8ad33d9-3444-42e2-b3eb-197a3652fb42\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 15:36:54.271691 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:54.271669    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c8ad33d9-3444-42e2-b3eb-197a3652fb42-config-out\") pod \"alertmanager-main-0\" (UID: \"c8ad33d9-3444-42e2-b3eb-197a3652fb42\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 15:36:54.271837 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:54.271816    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c8ad33d9-3444-42e2-b3eb-197a3652fb42-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"c8ad33d9-3444-42e2-b3eb-197a3652fb42\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 15:36:54.271974 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:54.271953    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c8ad33d9-3444-42e2-b3eb-197a3652fb42-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"c8ad33d9-3444-42e2-b3eb-197a3652fb42\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 15:36:54.287579 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:54.287513    2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 15 15:36:54.311821 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:54.311797    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sffgh\" (UniqueName: \"kubernetes.io/projected/c8ad33d9-3444-42e2-b3eb-197a3652fb42-kube-api-access-sffgh\") pod \"alertmanager-main-0\" (UID: \"c8ad33d9-3444-42e2-b3eb-197a3652fb42\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 15:36:54.430478 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:54.430438    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fgfgf" event={"ID":"4b8da0b7-32e1-4251-9a9c-60b530dab461","Type":"ContainerStarted","Data":"42899862553b9f47f2863ccd1ab193b2eb20f7667bf8711dcf51be0971927274"}
Jul 15 15:36:54.772408 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:54.772374    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c8ad33d9-3444-42e2-b3eb-197a3652fb42-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"c8ad33d9-3444-42e2-b3eb-197a3652fb42\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 15:36:54.772408 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:54.772414    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c8ad33d9-3444-42e2-b3eb-197a3652fb42-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"c8ad33d9-3444-42e2-b3eb-197a3652fb42\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 15:36:54.773201 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:54.773172    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c8ad33d9-3444-42e2-b3eb-197a3652fb42-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"c8ad33d9-3444-42e2-b3eb-197a3652fb42\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 15:36:54.774774 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:54.774749    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c8ad33d9-3444-42e2-b3eb-197a3652fb42-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"c8ad33d9-3444-42e2-b3eb-197a3652fb42\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 15:36:55.069238 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:55.069153    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 15 15:36:55.227591 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:55.227541    2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 15 15:36:55.229878 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:36:55.229850    2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8ad33d9_3444_42e2_b3eb_197a3652fb42.slice/crio-b731f862a1a8fc224832278e26180957a53515644fe4bb9c57ae38db31aa889d WatchSource:0}: Error finding container b731f862a1a8fc224832278e26180957a53515644fe4bb9c57ae38db31aa889d: Status 404 returned error can't find the container with id b731f862a1a8fc224832278e26180957a53515644fe4bb9c57ae38db31aa889d
Jul 15 15:36:55.436523 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:55.436485    2588 generic.go:356] "Generic (PLEG): container finished" podID="4b8da0b7-32e1-4251-9a9c-60b530dab461" containerID="c69d2d9946d307f19217e7449ae386b983d8cdc1f720350c45e56578bfff77fe" exitCode=0
Jul 15 15:36:55.436728 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:55.436570    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fgfgf" event={"ID":"4b8da0b7-32e1-4251-9a9c-60b530dab461","Type":"ContainerDied","Data":"c69d2d9946d307f19217e7449ae386b983d8cdc1f720350c45e56578bfff77fe"}
Jul 15 15:36:55.437869 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:55.437844    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c8ad33d9-3444-42e2-b3eb-197a3652fb42","Type":"ContainerStarted","Data":"b731f862a1a8fc224832278e26180957a53515644fe4bb9c57ae38db31aa889d"}
Jul 15 15:36:56.443573 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:56.443528    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fgfgf" event={"ID":"4b8da0b7-32e1-4251-9a9c-60b530dab461","Type":"ContainerStarted","Data":"a39c60ac84aa618320c0f5b07382df9ba44618b84da29f5b2e048a5370f35c42"}
Jul 15 15:36:56.443967 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:56.443631    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fgfgf" event={"ID":"4b8da0b7-32e1-4251-9a9c-60b530dab461","Type":"ContainerStarted","Data":"87170263ab81122ac4c9dedcea9309c7c68c4488559d9deff97ad7a3b74f2182"}
Jul 15 15:36:56.469593 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:56.469529    2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-fgfgf" podStartSLOduration=2.64576432 podStartE2EDuration="3.469514738s" totalImagesPullingTime="759.338803ms" totalInitContainerRuntime="64.411615ms" isStatefulPod=true podCreationTimestamp="2026-07-15 15:36:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:36:56.466926306 +0000 UTC m=+102.118992065" watchObservedRunningTime="2026-07-15 15:36:56.469514738 +0000 UTC m=+102.121580519"
Jul 15 15:36:57.805713 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:57.805687    2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6bc4fbcf5c-j44pv"]
Jul 15 15:36:57.823380 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:57.823331    2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6bc4fbcf5c-j44pv"]
Jul 15 15:36:57.823513 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:57.823441    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6bc4fbcf5c-j44pv"
Jul 15 15:36:57.826248 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:57.826215    2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 15 15:36:57.826378 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:57.826279    2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-mwl68\""
Jul 15 15:36:57.826378 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:57.826230    2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 15 15:36:57.827845 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:57.827593    2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 15 15:36:57.827845 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:57.827636    2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 15 15:36:57.827845 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:57.827640    2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 15 15:36:57.827845 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:57.827761    2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 15 15:36:57.827845 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:57.827826    2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 15 15:36:57.832744 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:57.832724    2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 15 15:36:57.904009 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:57.903980    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ae980f92-fa01-4a4c-ad73-5378c3ce68fd-console-config\") pod \"console-6bc4fbcf5c-j44pv\" (UID: \"ae980f92-fa01-4a4c-ad73-5378c3ce68fd\") " pod="openshift-console/console-6bc4fbcf5c-j44pv"
Jul 15 15:36:57.904171 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:57.904021    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ae980f92-fa01-4a4c-ad73-5378c3ce68fd-console-oauth-config\") pod \"console-6bc4fbcf5c-j44pv\" (UID: \"ae980f92-fa01-4a4c-ad73-5378c3ce68fd\") " pod="openshift-console/console-6bc4fbcf5c-j44pv"
Jul 15 15:36:57.904171 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:57.904054    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ae980f92-fa01-4a4c-ad73-5378c3ce68fd-console-serving-cert\") pod \"console-6bc4fbcf5c-j44pv\" (UID: \"ae980f92-fa01-4a4c-ad73-5378c3ce68fd\") " pod="openshift-console/console-6bc4fbcf5c-j44pv"
Jul 15 15:36:57.904171 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:57.904158    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ae980f92-fa01-4a4c-ad73-5378c3ce68fd-service-ca\") pod \"console-6bc4fbcf5c-j44pv\" (UID: \"ae980f92-fa01-4a4c-ad73-5378c3ce68fd\") " pod="openshift-console/console-6bc4fbcf5c-j44pv"
Jul 15 15:36:57.904301 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:57.904191    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ae980f92-fa01-4a4c-ad73-5378c3ce68fd-oauth-serving-cert\") pod \"console-6bc4fbcf5c-j44pv\" (UID: \"ae980f92-fa01-4a4c-ad73-5378c3ce68fd\") " pod="openshift-console/console-6bc4fbcf5c-j44pv"
Jul 15 15:36:57.904301 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:57.904214    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vk52t\" (UniqueName: \"kubernetes.io/projected/ae980f92-fa01-4a4c-ad73-5378c3ce68fd-kube-api-access-vk52t\") pod \"console-6bc4fbcf5c-j44pv\" (UID: \"ae980f92-fa01-4a4c-ad73-5378c3ce68fd\") " pod="openshift-console/console-6bc4fbcf5c-j44pv"
Jul 15 15:36:57.904301 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:57.904289    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ae980f92-fa01-4a4c-ad73-5378c3ce68fd-trusted-ca-bundle\") pod \"console-6bc4fbcf5c-j44pv\" (UID: \"ae980f92-fa01-4a4c-ad73-5378c3ce68fd\") " pod="openshift-console/console-6bc4fbcf5c-j44pv"
Jul 15 15:36:58.005269 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:58.005181    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ae980f92-fa01-4a4c-ad73-5378c3ce68fd-console-config\") pod \"console-6bc4fbcf5c-j44pv\" (UID: \"ae980f92-fa01-4a4c-ad73-5378c3ce68fd\") " pod="openshift-console/console-6bc4fbcf5c-j44pv"
Jul 15 15:36:58.005269 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:58.005221    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ae980f92-fa01-4a4c-ad73-5378c3ce68fd-console-oauth-config\") pod \"console-6bc4fbcf5c-j44pv\" (UID: \"ae980f92-fa01-4a4c-ad73-5378c3ce68fd\") " pod="openshift-console/console-6bc4fbcf5c-j44pv"
Jul 15 15:36:58.005269 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:58.005241    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ae980f92-fa01-4a4c-ad73-5378c3ce68fd-console-serving-cert\") pod \"console-6bc4fbcf5c-j44pv\" (UID: \"ae980f92-fa01-4a4c-ad73-5378c3ce68fd\") " pod="openshift-console/console-6bc4fbcf5c-j44pv"
Jul 15 15:36:58.005591 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:58.005319    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ae980f92-fa01-4a4c-ad73-5378c3ce68fd-service-ca\") pod \"console-6bc4fbcf5c-j44pv\" (UID: \"ae980f92-fa01-4a4c-ad73-5378c3ce68fd\") " pod="openshift-console/console-6bc4fbcf5c-j44pv"
Jul 15 15:36:58.005591 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:58.005374    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ae980f92-fa01-4a4c-ad73-5378c3ce68fd-oauth-serving-cert\") pod \"console-6bc4fbcf5c-j44pv\" (UID: \"ae980f92-fa01-4a4c-ad73-5378c3ce68fd\") " pod="openshift-console/console-6bc4fbcf5c-j44pv"
Jul 15 15:36:58.005591 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:58.005498    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vk52t\" (UniqueName: \"kubernetes.io/projected/ae980f92-fa01-4a4c-ad73-5378c3ce68fd-kube-api-access-vk52t\") pod \"console-6bc4fbcf5c-j44pv\" (UID: \"ae980f92-fa01-4a4c-ad73-5378c3ce68fd\") " pod="openshift-console/console-6bc4fbcf5c-j44pv"
Jul 15 15:36:58.005591 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:58.005573    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ae980f92-fa01-4a4c-ad73-5378c3ce68fd-trusted-ca-bundle\") pod \"console-6bc4fbcf5c-j44pv\" (UID: \"ae980f92-fa01-4a4c-ad73-5378c3ce68fd\") " pod="openshift-console/console-6bc4fbcf5c-j44pv"
Jul 15 15:36:58.006051 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:58.006025    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ae980f92-fa01-4a4c-ad73-5378c3ce68fd-service-ca\") pod \"console-6bc4fbcf5c-j44pv\" (UID: \"ae980f92-fa01-4a4c-ad73-5378c3ce68fd\") " pod="openshift-console/console-6bc4fbcf5c-j44pv"
Jul 15 15:36:58.006155 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:58.006025    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ae980f92-fa01-4a4c-ad73-5378c3ce68fd-console-config\") pod \"console-6bc4fbcf5c-j44pv\" (UID: \"ae980f92-fa01-4a4c-ad73-5378c3ce68fd\") " pod="openshift-console/console-6bc4fbcf5c-j44pv"
Jul 15 15:36:58.006480 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:58.006455    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ae980f92-fa01-4a4c-ad73-5378c3ce68fd-oauth-serving-cert\") pod \"console-6bc4fbcf5c-j44pv\" (UID: \"ae980f92-fa01-4a4c-ad73-5378c3ce68fd\") " pod="openshift-console/console-6bc4fbcf5c-j44pv"
Jul 15 15:36:58.006643 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:58.006622    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ae980f92-fa01-4a4c-ad73-5378c3ce68fd-trusted-ca-bundle\") pod \"console-6bc4fbcf5c-j44pv\" (UID: \"ae980f92-fa01-4a4c-ad73-5378c3ce68fd\") " pod="openshift-console/console-6bc4fbcf5c-j44pv"
Jul 15 15:36:58.007820 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:58.007799    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ae980f92-fa01-4a4c-ad73-5378c3ce68fd-console-serving-cert\") pod \"console-6bc4fbcf5c-j44pv\" (UID: \"ae980f92-fa01-4a4c-ad73-5378c3ce68fd\") " pod="openshift-console/console-6bc4fbcf5c-j44pv"
Jul 15 15:36:58.007820 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:58.007815    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ae980f92-fa01-4a4c-ad73-5378c3ce68fd-console-oauth-config\") pod \"console-6bc4fbcf5c-j44pv\" (UID: \"ae980f92-fa01-4a4c-ad73-5378c3ce68fd\") " pod="openshift-console/console-6bc4fbcf5c-j44pv"
Jul 15 15:36:58.015462 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:58.015445    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vk52t\" (UniqueName: \"kubernetes.io/projected/ae980f92-fa01-4a4c-ad73-5378c3ce68fd-kube-api-access-vk52t\") pod \"console-6bc4fbcf5c-j44pv\" (UID: \"ae980f92-fa01-4a4c-ad73-5378c3ce68fd\") " pod="openshift-console/console-6bc4fbcf5c-j44pv"
Jul 15 15:36:58.135099 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:58.135066    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6bc4fbcf5c-j44pv"
Jul 15 15:36:58.290800 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:58.290775    2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6bc4fbcf5c-j44pv"]
Jul 15 15:36:58.292716 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:36:58.292687    2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae980f92_fa01_4a4c_ad73_5378c3ce68fd.slice/crio-2012a63bb49fd0ba90614b5b53d0a79be308da04b376347ebc26a624e7994564 WatchSource:0}: Error finding container 2012a63bb49fd0ba90614b5b53d0a79be308da04b376347ebc26a624e7994564: Status 404 returned error can't find the container with id 2012a63bb49fd0ba90614b5b53d0a79be308da04b376347ebc26a624e7994564
Jul 15 15:36:58.452643 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:58.452606    2588 generic.go:356] "Generic (PLEG): container finished" podID="c8ad33d9-3444-42e2-b3eb-197a3652fb42" containerID="01ee7454ac45441163a8fa87fa49d878aca24f801bb829a420f4fda94a40471c" exitCode=0
Jul 15 15:36:58.452819 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:58.452703    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c8ad33d9-3444-42e2-b3eb-197a3652fb42","Type":"ContainerDied","Data":"01ee7454ac45441163a8fa87fa49d878aca24f801bb829a420f4fda94a40471c"}
Jul 15 15:36:58.454086 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:36:58.454052    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6bc4fbcf5c-j44pv" event={"ID":"ae980f92-fa01-4a4c-ad73-5378c3ce68fd","Type":"ContainerStarted","Data":"2012a63bb49fd0ba90614b5b53d0a79be308da04b376347ebc26a624e7994564"}
Jul 15 15:37:01.470560 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:37:01.470512    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c8ad33d9-3444-42e2-b3eb-197a3652fb42","Type":"ContainerStarted","Data":"fd1fe3837bc64ff939122a5a6d1cdee7678a8bb2a62b7e24fda6c40572ae88e1"}
Jul 15 15:37:01.471126 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:37:01.470606    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c8ad33d9-3444-42e2-b3eb-197a3652fb42","Type":"ContainerStarted","Data":"7bb2ace5dd6c0005ac8e898e1d83cd38f915b0dfe89877c9ce79b5c20e933135"}
Jul 15 15:37:02.476542 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:37:02.476501    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6bc4fbcf5c-j44pv" event={"ID":"ae980f92-fa01-4a4c-ad73-5378c3ce68fd","Type":"ContainerStarted","Data":"30855e2345cc34b29db1a307bf1287d54517291f048a339b64d89313cb5dfa88"}
Jul 15 15:37:02.479839 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:37:02.479813    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c8ad33d9-3444-42e2-b3eb-197a3652fb42","Type":"ContainerStarted","Data":"13b6f6c5d123e11a1d8f9374ec899647a0df4b5764bbe0f9a67e0896c87cf19c"}
Jul 15 15:37:02.479975 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:37:02.479878    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c8ad33d9-3444-42e2-b3eb-197a3652fb42","Type":"ContainerStarted","Data":"815518cf9a63836d8ff5fab2959ff0e400135985b06ea058a4a81efa14e4d968"}
Jul 15 15:37:02.479975 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:37:02.479917    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c8ad33d9-3444-42e2-b3eb-197a3652fb42","Type":"ContainerStarted","Data":"dad2c4b663aeef6d3d1251915722f1fb06125adf03ccfbb095e886da4f910e99"}
Jul 15 15:37:02.499263 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:37:02.499218    2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6bc4fbcf5c-j44pv" podStartSLOduration=1.527781316 podStartE2EDuration="5.499203348s" totalImagesPullingTime="3.971422032s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 15:36:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:37:02.497577852 +0000 UTC m=+108.149643622" watchObservedRunningTime="2026-07-15 15:37:02.499203348 +0000 UTC m=+108.151269107"
Jul 15 15:37:04.490613 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:37:04.490565    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c8ad33d9-3444-42e2-b3eb-197a3652fb42","Type":"ContainerStarted","Data":"0e4e4f27d579b86cfaa93a1705e1c44ddc2d20b6cf5438bd228367177b124f9f"}
Jul 15 15:37:04.522440 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:37:04.522391    2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=4.979265133 podStartE2EDuration="10.522375253s" totalImagesPullingTime="5.520711174s" totalInitContainerRuntime="22.398946ms" isStatefulPod=false podCreationTimestamp="2026-07-15 15:36:54 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:37:04.51975464 +0000 UTC m=+110.171820399" watchObservedRunningTime="2026-07-15 15:37:04.522375253 +0000 UTC m=+110.174441028"
Jul 15 15:37:04.860490 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:37:04.860457    2588 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6bc4fbcf5c-j44pv"]
Jul 15 15:37:08.135844 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:37:08.135811    2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6bc4fbcf5c-j44pv"
Jul 15 15:37:08.893040 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:37:08.892981    2588 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-7497644dd6-r6f4x" podUID="dfd89595-3f0b-4bbb-b6c3-3adff5584228" containerName="registry" containerID="cri-o://cb87213abea4c2b0733e245df8dbc850a141196e172136941ea63087856b0d38" gracePeriod=30
Jul 15 15:37:09.129608 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:37:09.129583    2588 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7497644dd6-r6f4x"
Jul 15 15:37:09.199044 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:37:09.198970    2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/dfd89595-3f0b-4bbb-b6c3-3adff5584228-bound-sa-token\") pod \"dfd89595-3f0b-4bbb-b6c3-3adff5584228\" (UID: \"dfd89595-3f0b-4bbb-b6c3-3adff5584228\") "
Jul 15 15:37:09.199044 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:37:09.199030    2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/dfd89595-3f0b-4bbb-b6c3-3adff5584228-ca-trust-extracted\") pod \"dfd89595-3f0b-4bbb-b6c3-3adff5584228\" (UID: \"dfd89595-3f0b-4bbb-b6c3-3adff5584228\") "
Jul 15 15:37:09.199540 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:37:09.199059    2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/dfd89595-3f0b-4bbb-b6c3-3adff5584228-trusted-ca\") pod \"dfd89595-3f0b-4bbb-b6c3-3adff5584228\" (UID: \"dfd89595-3f0b-4bbb-b6c3-3adff5584228\") "
Jul 15 15:37:09.199540 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:37:09.199078    2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/dfd89595-3f0b-4bbb-b6c3-3adff5584228-installation-pull-secrets\") pod \"dfd89595-3f0b-4bbb-b6c3-3adff5584228\" (UID: \"dfd89595-3f0b-4bbb-b6c3-3adff5584228\") "
Jul 15 15:37:09.199540 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:37:09.199126    2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/dfd89595-3f0b-4bbb-b6c3-3adff5584228-image-registry-private-configuration\") pod \"dfd89595-3f0b-4bbb-b6c3-3adff5584228\" (UID: \"dfd89595-3f0b-4bbb-b6c3-3adff5584228\") "
Jul 15 15:37:09.199540 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:37:09.199170    2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-76b58\" (UniqueName: \"kubernetes.io/projected/dfd89595-3f0b-4bbb-b6c3-3adff5584228-kube-api-access-76b58\") pod \"dfd89595-3f0b-4bbb-b6c3-3adff5584228\" (UID: \"dfd89595-3f0b-4bbb-b6c3-3adff5584228\") "
Jul 15 15:37:09.199540 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:37:09.199185    2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/dfd89595-3f0b-4bbb-b6c3-3adff5584228-registry-certificates\") pod \"dfd89595-3f0b-4bbb-b6c3-3adff5584228\" (UID: \"dfd89595-3f0b-4bbb-b6c3-3adff5584228\") "
Jul 15 15:37:09.199540 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:37:09.199247    2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/dfd89595-3f0b-4bbb-b6c3-3adff5584228-registry-tls\") pod \"dfd89595-3f0b-4bbb-b6c3-3adff5584228\" (UID: \"dfd89595-3f0b-4bbb-b6c3-3adff5584228\") "
Jul 15 15:37:09.199823 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:37:09.199570    2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dfd89595-3f0b-4bbb-b6c3-3adff5584228-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "dfd89595-3f0b-4bbb-b6c3-3adff5584228" (UID: "dfd89595-3f0b-4bbb-b6c3-3adff5584228"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 15:37:09.199823 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:37:09.199675    2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dfd89595-3f0b-4bbb-b6c3-3adff5584228-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "dfd89595-3f0b-4bbb-b6c3-3adff5584228" (UID: "dfd89595-3f0b-4bbb-b6c3-3adff5584228"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 15:37:09.201573 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:37:09.201527    2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dfd89595-3f0b-4bbb-b6c3-3adff5584228-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "dfd89595-3f0b-4bbb-b6c3-3adff5584228" (UID: "dfd89595-3f0b-4bbb-b6c3-3adff5584228"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 15:37:09.201723 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:37:09.201699    2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dfd89595-3f0b-4bbb-b6c3-3adff5584228-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "dfd89595-3f0b-4bbb-b6c3-3adff5584228" (UID: "dfd89595-3f0b-4bbb-b6c3-3adff5584228"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 15:37:09.201785 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:37:09.201737    2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dfd89595-3f0b-4bbb-b6c3-3adff5584228-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "dfd89595-3f0b-4bbb-b6c3-3adff5584228" (UID: "dfd89595-3f0b-4bbb-b6c3-3adff5584228"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 15:37:09.201893 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:37:09.201874    2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dfd89595-3f0b-4bbb-b6c3-3adff5584228-kube-api-access-76b58" (OuterVolumeSpecName: "kube-api-access-76b58") pod "dfd89595-3f0b-4bbb-b6c3-3adff5584228" (UID: "dfd89595-3f0b-4bbb-b6c3-3adff5584228"). InnerVolumeSpecName "kube-api-access-76b58". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 15:37:09.202025 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:37:09.202007    2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dfd89595-3f0b-4bbb-b6c3-3adff5584228-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "dfd89595-3f0b-4bbb-b6c3-3adff5584228" (UID: "dfd89595-3f0b-4bbb-b6c3-3adff5584228"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 15:37:09.207269 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:37:09.207248    2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dfd89595-3f0b-4bbb-b6c3-3adff5584228-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "dfd89595-3f0b-4bbb-b6c3-3adff5584228" (UID: "dfd89595-3f0b-4bbb-b6c3-3adff5584228"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 15:37:09.300169 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:37:09.300136    2588 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-76b58\" (UniqueName: \"kubernetes.io/projected/dfd89595-3f0b-4bbb-b6c3-3adff5584228-kube-api-access-76b58\") on node \"ip-10-0-140-212.ec2.internal\" DevicePath \"\""
Jul 15 15:37:09.300169 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:37:09.300163    2588 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/dfd89595-3f0b-4bbb-b6c3-3adff5584228-registry-certificates\") on node \"ip-10-0-140-212.ec2.internal\" DevicePath \"\""
Jul 15 15:37:09.300169 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:37:09.300174    2588 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/dfd89595-3f0b-4bbb-b6c3-3adff5584228-registry-tls\") on node \"ip-10-0-140-212.ec2.internal\" DevicePath \"\""
Jul 15 15:37:09.300375 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:37:09.300183    2588 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/dfd89595-3f0b-4bbb-b6c3-3adff5584228-bound-sa-token\") on node \"ip-10-0-140-212.ec2.internal\" DevicePath \"\""
Jul 15 15:37:09.300375 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:37:09.300191    2588 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/dfd89595-3f0b-4bbb-b6c3-3adff5584228-ca-trust-extracted\") on node \"ip-10-0-140-212.ec2.internal\" DevicePath \"\""
Jul 15 15:37:09.300375 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:37:09.300199    2588 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/dfd89595-3f0b-4bbb-b6c3-3adff5584228-trusted-ca\") on node \"ip-10-0-140-212.ec2.internal\" DevicePath \"\""
Jul 15 15:37:09.300375 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:37:09.300208    2588 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/dfd89595-3f0b-4bbb-b6c3-3adff5584228-installation-pull-secrets\") on node \"ip-10-0-140-212.ec2.internal\" DevicePath \"\""
Jul 15 15:37:09.300375 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:37:09.300217    2588 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/dfd89595-3f0b-4bbb-b6c3-3adff5584228-image-registry-private-configuration\") on node \"ip-10-0-140-212.ec2.internal\" DevicePath \"\""
Jul 15 15:37:09.510544 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:37:09.510458    2588 generic.go:356] "Generic (PLEG): container finished" podID="dfd89595-3f0b-4bbb-b6c3-3adff5584228" containerID="cb87213abea4c2b0733e245df8dbc850a141196e172136941ea63087856b0d38" exitCode=0
Jul 15 15:37:09.510544 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:37:09.510508    2588 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7497644dd6-r6f4x"
Jul 15 15:37:09.510742 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:37:09.510540    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7497644dd6-r6f4x" event={"ID":"dfd89595-3f0b-4bbb-b6c3-3adff5584228","Type":"ContainerDied","Data":"cb87213abea4c2b0733e245df8dbc850a141196e172136941ea63087856b0d38"}
Jul 15 15:37:09.510742 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:37:09.510590    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7497644dd6-r6f4x" event={"ID":"dfd89595-3f0b-4bbb-b6c3-3adff5584228","Type":"ContainerDied","Data":"fdd42e2c6fcacfa9517444cbcb2d9c9bf63aa888cdc4c58a7b9b0880bdbb241e"}
Jul 15 15:37:09.510742 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:37:09.510609    2588 scope.go:117] "RemoveContainer" containerID="cb87213abea4c2b0733e245df8dbc850a141196e172136941ea63087856b0d38"
Jul 15 15:37:09.519038 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:37:09.519023    2588 scope.go:117] "RemoveContainer" containerID="cb87213abea4c2b0733e245df8dbc850a141196e172136941ea63087856b0d38"
Jul 15 15:37:09.519262 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:37:09.519245    2588 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cb87213abea4c2b0733e245df8dbc850a141196e172136941ea63087856b0d38\": container with ID starting with cb87213abea4c2b0733e245df8dbc850a141196e172136941ea63087856b0d38 not found: ID does not exist" containerID="cb87213abea4c2b0733e245df8dbc850a141196e172136941ea63087856b0d38"
Jul 15 15:37:09.519304 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:37:09.519270    2588 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cb87213abea4c2b0733e245df8dbc850a141196e172136941ea63087856b0d38"} err="failed to get container status \"cb87213abea4c2b0733e245df8dbc850a141196e172136941ea63087856b0d38\": rpc error: code = NotFound desc = could not find container \"cb87213abea4c2b0733e245df8dbc850a141196e172136941ea63087856b0d38\": container with ID starting with cb87213abea4c2b0733e245df8dbc850a141196e172136941ea63087856b0d38 not found: ID does not exist"
Jul 15 15:37:09.531875 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:37:09.531852    2588 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7497644dd6-r6f4x"]
Jul 15 15:37:09.536132 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:37:09.536110    2588 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-7497644dd6-r6f4x"]
Jul 15 15:37:10.909390 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:37:10.909359    2588 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dfd89595-3f0b-4bbb-b6c3-3adff5584228" path="/var/lib/kubelet/pods/dfd89595-3f0b-4bbb-b6c3-3adff5584228/volumes"
Jul 15 15:37:17.542405 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:37:17.542369    2588 generic.go:356] "Generic (PLEG): container finished" podID="32207a22-c82a-4d3b-a044-aa9899bcdf2d" containerID="1d2d104e8d7cb2502e206b16bb67de04cd953a45d30fca917787b9fd0da6d331" exitCode=0
Jul 15 15:37:17.542858 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:37:17.542440    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-pxkjb" event={"ID":"32207a22-c82a-4d3b-a044-aa9899bcdf2d","Type":"ContainerDied","Data":"1d2d104e8d7cb2502e206b16bb67de04cd953a45d30fca917787b9fd0da6d331"}
Jul 15 15:37:17.542858 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:37:17.542852    2588 scope.go:117] "RemoveContainer" containerID="1d2d104e8d7cb2502e206b16bb67de04cd953a45d30fca917787b9fd0da6d331"
Jul 15 15:37:18.548133 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:37:18.548098    2588 generic.go:356] "Generic (PLEG): container finished" podID="3d27b6dd-79a8-46a5-9295-7d359f472c6d" containerID="9d20bb9b24f102a6eaacc0b246d12e0015f44d44b32607e7d7eac046201e7d04" exitCode=0
Jul 15 15:37:18.548542 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:37:18.548174    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-xqhg4" event={"ID":"3d27b6dd-79a8-46a5-9295-7d359f472c6d","Type":"ContainerDied","Data":"9d20bb9b24f102a6eaacc0b246d12e0015f44d44b32607e7d7eac046201e7d04"}
Jul 15 15:37:18.548622 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:37:18.548584    2588 scope.go:117] "RemoveContainer" containerID="9d20bb9b24f102a6eaacc0b246d12e0015f44d44b32607e7d7eac046201e7d04"
Jul 15 15:37:18.550103 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:37:18.550074    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-pxkjb" event={"ID":"32207a22-c82a-4d3b-a044-aa9899bcdf2d","Type":"ContainerStarted","Data":"c0bbca38096474951ce6842b7f7272ef048bd5b702a83212ce27c512c40d3b45"}
Jul 15 15:37:18.551460 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:37:18.551443    2588 generic.go:356] "Generic (PLEG): container finished" podID="c6536c40-bac4-4b75-9914-aa2ff4363de8" containerID="945bbf410712be292c4a201e36857f904b527ce6073ab716f6cfd9e68d3f08e4" exitCode=0
Jul 15 15:37:18.551510 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:37:18.551485    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-d5wnr" event={"ID":"c6536c40-bac4-4b75-9914-aa2ff4363de8","Type":"ContainerDied","Data":"945bbf410712be292c4a201e36857f904b527ce6073ab716f6cfd9e68d3f08e4"}
Jul 15 15:37:18.551740 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:37:18.551723    2588 scope.go:117] "RemoveContainer" containerID="945bbf410712be292c4a201e36857f904b527ce6073ab716f6cfd9e68d3f08e4"
Jul 15 15:37:19.557769 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:37:19.557732    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-xqhg4" event={"ID":"3d27b6dd-79a8-46a5-9295-7d359f472c6d","Type":"ContainerStarted","Data":"7c0e61b2870eb209b9f6c3c0d1ce34fbc1c9a76d239e923de67b4261cc2a9240"}
Jul 15 15:37:19.559509 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:37:19.559484    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-d5wnr" event={"ID":"c6536c40-bac4-4b75-9914-aa2ff4363de8","Type":"ContainerStarted","Data":"6f85bf0b8000396e153fa2454714c427bb6583e05fd468b78d8c692fd63db144"}
Jul 15 15:37:29.880708 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:37:29.880650    2588 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6bc4fbcf5c-j44pv" podUID="ae980f92-fa01-4a4c-ad73-5378c3ce68fd" containerName="console" containerID="cri-o://30855e2345cc34b29db1a307bf1287d54517291f048a339b64d89313cb5dfa88" gracePeriod=15
Jul 15 15:37:30.126473 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:37:30.126444    2588 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6bc4fbcf5c-j44pv"
Jul 15 15:37:30.263606 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:37:30.263522    2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ae980f92-fa01-4a4c-ad73-5378c3ce68fd-console-serving-cert\") pod \"ae980f92-fa01-4a4c-ad73-5378c3ce68fd\" (UID: \"ae980f92-fa01-4a4c-ad73-5378c3ce68fd\") "
Jul 15 15:37:30.263606 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:37:30.263588    2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ae980f92-fa01-4a4c-ad73-5378c3ce68fd-service-ca\") pod \"ae980f92-fa01-4a4c-ad73-5378c3ce68fd\" (UID: \"ae980f92-fa01-4a4c-ad73-5378c3ce68fd\") "
Jul 15 15:37:30.263820 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:37:30.263616    2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ae980f92-fa01-4a4c-ad73-5378c3ce68fd-oauth-serving-cert\") pod \"ae980f92-fa01-4a4c-ad73-5378c3ce68fd\" (UID: \"ae980f92-fa01-4a4c-ad73-5378c3ce68fd\") "
Jul 15 15:37:30.263820 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:37:30.263650    2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ae980f92-fa01-4a4c-ad73-5378c3ce68fd-console-oauth-config\") pod \"ae980f92-fa01-4a4c-ad73-5378c3ce68fd\" (UID: \"ae980f92-fa01-4a4c-ad73-5378c3ce68fd\") "
Jul 15 15:37:30.263820 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:37:30.263682    2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ae980f92-fa01-4a4c-ad73-5378c3ce68fd-trusted-ca-bundle\") pod \"ae980f92-fa01-4a4c-ad73-5378c3ce68fd\" (UID: \"ae980f92-fa01-4a4c-ad73-5378c3ce68fd\") "
Jul 15 15:37:30.263820 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:37:30.263705    2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ae980f92-fa01-4a4c-ad73-5378c3ce68fd-console-config\") pod \"ae980f92-fa01-4a4c-ad73-5378c3ce68fd\" (UID: \"ae980f92-fa01-4a4c-ad73-5378c3ce68fd\") "
Jul 15 15:37:30.263820 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:37:30.263738    2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vk52t\" (UniqueName: \"kubernetes.io/projected/ae980f92-fa01-4a4c-ad73-5378c3ce68fd-kube-api-access-vk52t\") pod \"ae980f92-fa01-4a4c-ad73-5378c3ce68fd\" (UID: \"ae980f92-fa01-4a4c-ad73-5378c3ce68fd\") "
Jul 15 15:37:30.264065 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:37:30.264027    2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ae980f92-fa01-4a4c-ad73-5378c3ce68fd-service-ca" (OuterVolumeSpecName: "service-ca") pod "ae980f92-fa01-4a4c-ad73-5378c3ce68fd" (UID: "ae980f92-fa01-4a4c-ad73-5378c3ce68fd"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 15:37:30.264065 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:37:30.264048    2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ae980f92-fa01-4a4c-ad73-5378c3ce68fd-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "ae980f92-fa01-4a4c-ad73-5378c3ce68fd" (UID: "ae980f92-fa01-4a4c-ad73-5378c3ce68fd"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 15:37:30.264164 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:37:30.264130    2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ae980f92-fa01-4a4c-ad73-5378c3ce68fd-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "ae980f92-fa01-4a4c-ad73-5378c3ce68fd" (UID: "ae980f92-fa01-4a4c-ad73-5378c3ce68fd"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 15:37:30.264317 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:37:30.264294    2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ae980f92-fa01-4a4c-ad73-5378c3ce68fd-console-config" (OuterVolumeSpecName: "console-config") pod "ae980f92-fa01-4a4c-ad73-5378c3ce68fd" (UID: "ae980f92-fa01-4a4c-ad73-5378c3ce68fd"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 15:37:30.265901 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:37:30.265868    2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ae980f92-fa01-4a4c-ad73-5378c3ce68fd-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "ae980f92-fa01-4a4c-ad73-5378c3ce68fd" (UID: "ae980f92-fa01-4a4c-ad73-5378c3ce68fd"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 15:37:30.266134 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:37:30.266117    2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ae980f92-fa01-4a4c-ad73-5378c3ce68fd-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "ae980f92-fa01-4a4c-ad73-5378c3ce68fd" (UID: "ae980f92-fa01-4a4c-ad73-5378c3ce68fd"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 15:37:30.266176 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:37:30.266148    2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ae980f92-fa01-4a4c-ad73-5378c3ce68fd-kube-api-access-vk52t" (OuterVolumeSpecName: "kube-api-access-vk52t") pod "ae980f92-fa01-4a4c-ad73-5378c3ce68fd" (UID: "ae980f92-fa01-4a4c-ad73-5378c3ce68fd"). InnerVolumeSpecName "kube-api-access-vk52t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 15:37:30.364836 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:37:30.364802    2588 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vk52t\" (UniqueName: \"kubernetes.io/projected/ae980f92-fa01-4a4c-ad73-5378c3ce68fd-kube-api-access-vk52t\") on node \"ip-10-0-140-212.ec2.internal\" DevicePath \"\""
Jul 15 15:37:30.364836 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:37:30.364834    2588 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ae980f92-fa01-4a4c-ad73-5378c3ce68fd-console-serving-cert\") on node \"ip-10-0-140-212.ec2.internal\" DevicePath \"\""
Jul 15 15:37:30.365028 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:37:30.364847    2588 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ae980f92-fa01-4a4c-ad73-5378c3ce68fd-service-ca\") on node \"ip-10-0-140-212.ec2.internal\" DevicePath \"\""
Jul 15 15:37:30.365028 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:37:30.364856    2588 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ae980f92-fa01-4a4c-ad73-5378c3ce68fd-oauth-serving-cert\") on node \"ip-10-0-140-212.ec2.internal\" DevicePath \"\""
Jul 15 15:37:30.365028 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:37:30.364868    2588 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ae980f92-fa01-4a4c-ad73-5378c3ce68fd-console-oauth-config\") on node \"ip-10-0-140-212.ec2.internal\" DevicePath \"\""
Jul 15 15:37:30.365028 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:37:30.364882    2588 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ae980f92-fa01-4a4c-ad73-5378c3ce68fd-trusted-ca-bundle\") on node \"ip-10-0-140-212.ec2.internal\" DevicePath \"\""
Jul 15 15:37:30.365028 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:37:30.364893    2588 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ae980f92-fa01-4a4c-ad73-5378c3ce68fd-console-config\") on node \"ip-10-0-140-212.ec2.internal\" DevicePath \"\""
Jul 15 15:37:30.604249 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:37:30.604211    2588 generic.go:356] "Generic (PLEG): container finished" podID="ae980f92-fa01-4a4c-ad73-5378c3ce68fd" containerID="30855e2345cc34b29db1a307bf1287d54517291f048a339b64d89313cb5dfa88" exitCode=0
Jul 15 15:37:30.604435 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:37:30.604257    2588 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6bc4fbcf5c-j44pv"
Jul 15 15:37:30.604435 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:37:30.604298    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6bc4fbcf5c-j44pv" event={"ID":"ae980f92-fa01-4a4c-ad73-5378c3ce68fd","Type":"ContainerDied","Data":"30855e2345cc34b29db1a307bf1287d54517291f048a339b64d89313cb5dfa88"}
Jul 15 15:37:30.604435 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:37:30.604380    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6bc4fbcf5c-j44pv" event={"ID":"ae980f92-fa01-4a4c-ad73-5378c3ce68fd","Type":"ContainerDied","Data":"2012a63bb49fd0ba90614b5b53d0a79be308da04b376347ebc26a624e7994564"}
Jul 15 15:37:30.604435 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:37:30.604413    2588 scope.go:117] "RemoveContainer" containerID="30855e2345cc34b29db1a307bf1287d54517291f048a339b64d89313cb5dfa88"
Jul 15 15:37:30.615301 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:37:30.615262    2588 scope.go:117] "RemoveContainer" containerID="30855e2345cc34b29db1a307bf1287d54517291f048a339b64d89313cb5dfa88"
Jul 15 15:37:30.615667 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:37:30.615591    2588 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"30855e2345cc34b29db1a307bf1287d54517291f048a339b64d89313cb5dfa88\": container with ID starting with 30855e2345cc34b29db1a307bf1287d54517291f048a339b64d89313cb5dfa88 not found: ID does not exist" containerID="30855e2345cc34b29db1a307bf1287d54517291f048a339b64d89313cb5dfa88"
Jul 15 15:37:30.615667 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:37:30.615630    2588 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"30855e2345cc34b29db1a307bf1287d54517291f048a339b64d89313cb5dfa88"} err="failed to get container status \"30855e2345cc34b29db1a307bf1287d54517291f048a339b64d89313cb5dfa88\": rpc error: code = NotFound desc = could not find container \"30855e2345cc34b29db1a307bf1287d54517291f048a339b64d89313cb5dfa88\": container with ID starting with 30855e2345cc34b29db1a307bf1287d54517291f048a339b64d89313cb5dfa88 not found: ID does not exist"
Jul 15 15:37:30.631077 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:37:30.631048    2588 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6bc4fbcf5c-j44pv"]
Jul 15 15:37:30.635302 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:37:30.635279    2588 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6bc4fbcf5c-j44pv"]
Jul 15 15:37:30.912832 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:37:30.912749    2588 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ae980f92-fa01-4a4c-ad73-5378c3ce68fd" path="/var/lib/kubelet/pods/ae980f92-fa01-4a4c-ad73-5378c3ce68fd/volumes"
Jul 15 15:38:13.768868 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:38:13.768794    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-5f7f494dd4-lbdlp_c80ed5cd-4b7c-4981-95c6-a02cf058f709/cluster-monitoring-operator/0.log"
Jul 15 15:38:13.768868 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:38:13.768834    2588 generic.go:356] "Generic (PLEG): container finished" podID="c80ed5cd-4b7c-4981-95c6-a02cf058f709" containerID="7d7add77924189b499dda94e0a316cef02c431f2e32d07a507a26c617dfefb05" exitCode=2
Jul 15 15:38:13.768868 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:38:13.768859    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-lbdlp" event={"ID":"c80ed5cd-4b7c-4981-95c6-a02cf058f709","Type":"ContainerDied","Data":"7d7add77924189b499dda94e0a316cef02c431f2e32d07a507a26c617dfefb05"}
Jul 15 15:38:13.769311 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:38:13.769146    2588 scope.go:117] "RemoveContainer" containerID="7d7add77924189b499dda94e0a316cef02c431f2e32d07a507a26c617dfefb05"
Jul 15 15:38:14.773531 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:38:14.773505    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-5f7f494dd4-lbdlp_c80ed5cd-4b7c-4981-95c6-a02cf058f709/cluster-monitoring-operator/0.log"
Jul 15 15:38:14.773926 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:38:14.773575    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-lbdlp" event={"ID":"c80ed5cd-4b7c-4981-95c6-a02cf058f709","Type":"ContainerStarted","Data":"3d5804c2c611239c64742c37022ba97bcf8f09a274014b839dcb48db4c5eabc8"}
Jul 15 15:38:17.732967 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:38:17.732932    2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6d5df6c6f9-q9bkh"]
Jul 15 15:38:17.733318 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:38:17.733223    2588 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ae980f92-fa01-4a4c-ad73-5378c3ce68fd" containerName="console"
Jul 15 15:38:17.733318 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:38:17.733234    2588 state_mem.go:107] "Deleted CPUSet assignment" podUID="ae980f92-fa01-4a4c-ad73-5378c3ce68fd" containerName="console"
Jul 15 15:38:17.733318 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:38:17.733252    2588 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dfd89595-3f0b-4bbb-b6c3-3adff5584228" containerName="registry"
Jul 15 15:38:17.733318 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:38:17.733258    2588 state_mem.go:107] "Deleted CPUSet assignment" podUID="dfd89595-3f0b-4bbb-b6c3-3adff5584228" containerName="registry"
Jul 15 15:38:17.733318 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:38:17.733313    2588 memory_manager.go:368] "RemoveStaleState removing state" podUID="ae980f92-fa01-4a4c-ad73-5378c3ce68fd" containerName="console"
Jul 15 15:38:17.733318 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:38:17.733320    2588 memory_manager.go:368] "RemoveStaleState removing state" podUID="dfd89595-3f0b-4bbb-b6c3-3adff5584228" containerName="registry"
Jul 15 15:38:17.737500 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:38:17.737477    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d5df6c6f9-q9bkh"
Jul 15 15:38:17.740546 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:38:17.740521    2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 15 15:38:17.740668 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:38:17.740561    2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 15 15:38:17.742202 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:38:17.742157    2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 15 15:38:17.742202 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:38:17.742167    2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 15 15:38:17.742435 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:38:17.742207    2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 15 15:38:17.742435 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:38:17.742164    2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 15 15:38:17.742435 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:38:17.742157    2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-mwl68\""
Jul 15 15:38:17.742435 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:38:17.742172    2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 15 15:38:17.748227 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:38:17.748209    2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 15 15:38:17.751494 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:38:17.751473    2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6d5df6c6f9-q9bkh"]
Jul 15 15:38:17.836520 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:38:17.836478    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7e699a92-6f6d-4c02-ad16-1c48c4204fc6-service-ca\") pod \"console-6d5df6c6f9-q9bkh\" (UID: \"7e699a92-6f6d-4c02-ad16-1c48c4204fc6\") " pod="openshift-console/console-6d5df6c6f9-q9bkh"
Jul 15 15:38:17.836520 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:38:17.836524    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7e699a92-6f6d-4c02-ad16-1c48c4204fc6-console-config\") pod \"console-6d5df6c6f9-q9bkh\" (UID: \"7e699a92-6f6d-4c02-ad16-1c48c4204fc6\") " pod="openshift-console/console-6d5df6c6f9-q9bkh"
Jul 15 15:38:17.836740 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:38:17.836618    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7e699a92-6f6d-4c02-ad16-1c48c4204fc6-console-oauth-config\") pod \"console-6d5df6c6f9-q9bkh\" (UID: \"7e699a92-6f6d-4c02-ad16-1c48c4204fc6\") " pod="openshift-console/console-6d5df6c6f9-q9bkh"
Jul 15 15:38:17.836740 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:38:17.836642    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5848b\" (UniqueName: \"kubernetes.io/projected/7e699a92-6f6d-4c02-ad16-1c48c4204fc6-kube-api-access-5848b\") pod \"console-6d5df6c6f9-q9bkh\" (UID: \"7e699a92-6f6d-4c02-ad16-1c48c4204fc6\") " pod="openshift-console/console-6d5df6c6f9-q9bkh"
Jul 15 15:38:17.836740 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:38:17.836683    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7e699a92-6f6d-4c02-ad16-1c48c4204fc6-trusted-ca-bundle\") pod \"console-6d5df6c6f9-q9bkh\" (UID: \"7e699a92-6f6d-4c02-ad16-1c48c4204fc6\") " pod="openshift-console/console-6d5df6c6f9-q9bkh"
Jul 15 15:38:17.836740 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:38:17.836704    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7e699a92-6f6d-4c02-ad16-1c48c4204fc6-oauth-serving-cert\") pod \"console-6d5df6c6f9-q9bkh\" (UID: \"7e699a92-6f6d-4c02-ad16-1c48c4204fc6\") " pod="openshift-console/console-6d5df6c6f9-q9bkh"
Jul 15 15:38:17.836740 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:38:17.836727    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7e699a92-6f6d-4c02-ad16-1c48c4204fc6-console-serving-cert\") pod \"console-6d5df6c6f9-q9bkh\" (UID: \"7e699a92-6f6d-4c02-ad16-1c48c4204fc6\") " pod="openshift-console/console-6d5df6c6f9-q9bkh"
Jul 15 15:38:17.937765 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:38:17.937727    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7e699a92-6f6d-4c02-ad16-1c48c4204fc6-service-ca\") pod \"console-6d5df6c6f9-q9bkh\" (UID: \"7e699a92-6f6d-4c02-ad16-1c48c4204fc6\") " pod="openshift-console/console-6d5df6c6f9-q9bkh"
Jul 15 15:38:17.937765 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:38:17.937763    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7e699a92-6f6d-4c02-ad16-1c48c4204fc6-console-config\") pod \"console-6d5df6c6f9-q9bkh\" (UID: \"7e699a92-6f6d-4c02-ad16-1c48c4204fc6\") " pod="openshift-console/console-6d5df6c6f9-q9bkh"
Jul 15 15:38:17.937945 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:38:17.937796    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7e699a92-6f6d-4c02-ad16-1c48c4204fc6-console-oauth-config\") pod \"console-6d5df6c6f9-q9bkh\" (UID: \"7e699a92-6f6d-4c02-ad16-1c48c4204fc6\") " pod="openshift-console/console-6d5df6c6f9-q9bkh"
Jul 15 15:38:17.937945 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:38:17.937812    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5848b\" (UniqueName: \"kubernetes.io/projected/7e699a92-6f6d-4c02-ad16-1c48c4204fc6-kube-api-access-5848b\") pod \"console-6d5df6c6f9-q9bkh\" (UID: \"7e699a92-6f6d-4c02-ad16-1c48c4204fc6\") " pod="openshift-console/console-6d5df6c6f9-q9bkh"
Jul 15 15:38:17.938013 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:38:17.937997    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7e699a92-6f6d-4c02-ad16-1c48c4204fc6-trusted-ca-bundle\") pod \"console-6d5df6c6f9-q9bkh\" (UID: \"7e699a92-6f6d-4c02-ad16-1c48c4204fc6\") " pod="openshift-console/console-6d5df6c6f9-q9bkh"
Jul 15 15:38:17.938071 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:38:17.938054    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7e699a92-6f6d-4c02-ad16-1c48c4204fc6-oauth-serving-cert\") pod \"console-6d5df6c6f9-q9bkh\" (UID: \"7e699a92-6f6d-4c02-ad16-1c48c4204fc6\") " pod="openshift-console/console-6d5df6c6f9-q9bkh"
Jul 15 15:38:17.938112 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:38:17.938099    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7e699a92-6f6d-4c02-ad16-1c48c4204fc6-console-serving-cert\") pod \"console-6d5df6c6f9-q9bkh\" (UID: \"7e699a92-6f6d-4c02-ad16-1c48c4204fc6\") " pod="openshift-console/console-6d5df6c6f9-q9bkh"
Jul 15 15:38:17.938567 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:38:17.938537    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7e699a92-6f6d-4c02-ad16-1c48c4204fc6-service-ca\") pod \"console-6d5df6c6f9-q9bkh\" (UID: \"7e699a92-6f6d-4c02-ad16-1c48c4204fc6\") " pod="openshift-console/console-6d5df6c6f9-q9bkh"
Jul 15 15:38:17.938695 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:38:17.938602    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7e699a92-6f6d-4c02-ad16-1c48c4204fc6-console-config\") pod \"console-6d5df6c6f9-q9bkh\" (UID: \"7e699a92-6f6d-4c02-ad16-1c48c4204fc6\") " pod="openshift-console/console-6d5df6c6f9-q9bkh"
Jul 15 15:38:17.938823 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:38:17.938792    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7e699a92-6f6d-4c02-ad16-1c48c4204fc6-oauth-serving-cert\") pod \"console-6d5df6c6f9-q9bkh\" (UID: \"7e699a92-6f6d-4c02-ad16-1c48c4204fc6\") " pod="openshift-console/console-6d5df6c6f9-q9bkh"
Jul 15 15:38:17.938936 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:38:17.938837    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7e699a92-6f6d-4c02-ad16-1c48c4204fc6-trusted-ca-bundle\") pod \"console-6d5df6c6f9-q9bkh\" (UID: \"7e699a92-6f6d-4c02-ad16-1c48c4204fc6\") " pod="openshift-console/console-6d5df6c6f9-q9bkh"
Jul 15 15:38:17.940234 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:38:17.940215    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7e699a92-6f6d-4c02-ad16-1c48c4204fc6-console-oauth-config\") pod \"console-6d5df6c6f9-q9bkh\" (UID: \"7e699a92-6f6d-4c02-ad16-1c48c4204fc6\") " pod="openshift-console/console-6d5df6c6f9-q9bkh"
Jul 15 15:38:17.940398 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:38:17.940382    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7e699a92-6f6d-4c02-ad16-1c48c4204fc6-console-serving-cert\") pod \"console-6d5df6c6f9-q9bkh\" (UID: \"7e699a92-6f6d-4c02-ad16-1c48c4204fc6\") " pod="openshift-console/console-6d5df6c6f9-q9bkh"
Jul 15 15:38:17.952644 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:38:17.952618    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5848b\" (UniqueName: \"kubernetes.io/projected/7e699a92-6f6d-4c02-ad16-1c48c4204fc6-kube-api-access-5848b\") pod \"console-6d5df6c6f9-q9bkh\" (UID: \"7e699a92-6f6d-4c02-ad16-1c48c4204fc6\") " pod="openshift-console/console-6d5df6c6f9-q9bkh"
Jul 15 15:38:18.048559 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:38:18.048470    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d5df6c6f9-q9bkh"
Jul 15 15:38:18.175547 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:38:18.175521    2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6d5df6c6f9-q9bkh"]
Jul 15 15:38:18.177959 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:38:18.177937    2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e699a92_6f6d_4c02_ad16_1c48c4204fc6.slice/crio-43e7d65f8620c2be5cbe9ccab1e6eec99dd288c29189f1fcca47f98b28521bdc WatchSource:0}: Error finding container 43e7d65f8620c2be5cbe9ccab1e6eec99dd288c29189f1fcca47f98b28521bdc: Status 404 returned error can't find the container with id 43e7d65f8620c2be5cbe9ccab1e6eec99dd288c29189f1fcca47f98b28521bdc
Jul 15 15:38:18.791132 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:38:18.791098    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d5df6c6f9-q9bkh" event={"ID":"7e699a92-6f6d-4c02-ad16-1c48c4204fc6","Type":"ContainerStarted","Data":"224d0c64c70f022bfd69f461d1489fd8653637a6a0b5124973988606c5e51f8b"}
Jul 15 15:38:18.791542 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:38:18.791146    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d5df6c6f9-q9bkh" event={"ID":"7e699a92-6f6d-4c02-ad16-1c48c4204fc6","Type":"ContainerStarted","Data":"43e7d65f8620c2be5cbe9ccab1e6eec99dd288c29189f1fcca47f98b28521bdc"}
Jul 15 15:38:18.812832 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:38:18.812781    2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6d5df6c6f9-q9bkh" podStartSLOduration=1.812765344 podStartE2EDuration="1.812765344s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 15:38:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:38:18.81154842 +0000 UTC m=+184.463614181" watchObservedRunningTime="2026-07-15 15:38:18.812765344 +0000 UTC m=+184.464831102"
Jul 15 15:38:28.048791 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:38:28.048748    2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6d5df6c6f9-q9bkh"
Jul 15 15:38:28.049165 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:38:28.048849    2588 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6d5df6c6f9-q9bkh"
Jul 15 15:38:28.053518 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:38:28.053491    2588 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6d5df6c6f9-q9bkh"
Jul 15 15:38:28.832969 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:38:28.832942    2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6d5df6c6f9-q9bkh"
Jul 15 15:39:08.124824 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:39:08.124791    2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rf7lt"]
Jul 15 15:39:08.127978 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:39:08.127958    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rf7lt"
Jul 15 15:39:08.131736 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:39:08.131716    2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-ztswp\""
Jul 15 15:39:08.131874 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:39:08.131748    2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 15 15:39:08.132925 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:39:08.132908    2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 15 15:39:08.139011 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:39:08.138988    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h47mm\" (UniqueName: \"kubernetes.io/projected/9cc5aac4-caaa-4511-b175-7162285526ef-kube-api-access-h47mm\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rf7lt\" (UID: \"9cc5aac4-caaa-4511-b175-7162285526ef\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rf7lt"
Jul 15 15:39:08.139098 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:39:08.139074    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9cc5aac4-caaa-4511-b175-7162285526ef-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rf7lt\" (UID: \"9cc5aac4-caaa-4511-b175-7162285526ef\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rf7lt"
Jul 15 15:39:08.139137 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:39:08.139102    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9cc5aac4-caaa-4511-b175-7162285526ef-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rf7lt\" (UID: \"9cc5aac4-caaa-4511-b175-7162285526ef\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rf7lt"
Jul 15 15:39:08.145196 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:39:08.145174    2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rf7lt"]
Jul 15 15:39:08.240008 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:39:08.239976    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9cc5aac4-caaa-4511-b175-7162285526ef-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rf7lt\" (UID: \"9cc5aac4-caaa-4511-b175-7162285526ef\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rf7lt"
Jul 15 15:39:08.240008 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:39:08.240015    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9cc5aac4-caaa-4511-b175-7162285526ef-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rf7lt\" (UID: \"9cc5aac4-caaa-4511-b175-7162285526ef\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rf7lt"
Jul 15 15:39:08.240320 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:39:08.240053    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h47mm\" (UniqueName: \"kubernetes.io/projected/9cc5aac4-caaa-4511-b175-7162285526ef-kube-api-access-h47mm\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rf7lt\" (UID: \"9cc5aac4-caaa-4511-b175-7162285526ef\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rf7lt"
Jul 15 15:39:08.240418 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:39:08.240367    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9cc5aac4-caaa-4511-b175-7162285526ef-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rf7lt\" (UID: \"9cc5aac4-caaa-4511-b175-7162285526ef\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rf7lt"
Jul 15 15:39:08.240478 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:39:08.240440    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9cc5aac4-caaa-4511-b175-7162285526ef-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rf7lt\" (UID: \"9cc5aac4-caaa-4511-b175-7162285526ef\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rf7lt"
Jul 15 15:39:08.249652 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:39:08.249629    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h47mm\" (UniqueName: \"kubernetes.io/projected/9cc5aac4-caaa-4511-b175-7162285526ef-kube-api-access-h47mm\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rf7lt\" (UID: \"9cc5aac4-caaa-4511-b175-7162285526ef\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rf7lt"
Jul 15 15:39:08.437518 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:39:08.437427    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rf7lt"
Jul 15 15:39:08.565141 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:39:08.565089    2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rf7lt"]
Jul 15 15:39:08.567386 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:39:08.567356    2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9cc5aac4_caaa_4511_b175_7162285526ef.slice/crio-2820678f74c45d8a48fe4548d1682146a1079d182a84fbbc19c68816f0547733 WatchSource:0}: Error finding container 2820678f74c45d8a48fe4548d1682146a1079d182a84fbbc19c68816f0547733: Status 404 returned error can't find the container with id 2820678f74c45d8a48fe4548d1682146a1079d182a84fbbc19c68816f0547733
Jul 15 15:39:08.977980 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:39:08.977946    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rf7lt" event={"ID":"9cc5aac4-caaa-4511-b175-7162285526ef","Type":"ContainerStarted","Data":"2820678f74c45d8a48fe4548d1682146a1079d182a84fbbc19c68816f0547733"}
Jul 15 15:39:15.004010 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:39:15.003929    2588 generic.go:356] "Generic (PLEG): container finished" podID="9cc5aac4-caaa-4511-b175-7162285526ef" containerID="55387018e677a19e873b31d6a5ac0ca69d0d871b2c3177bc5de18522cfdaf69c" exitCode=0
Jul 15 15:39:15.004010 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:39:15.003974    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rf7lt" event={"ID":"9cc5aac4-caaa-4511-b175-7162285526ef","Type":"ContainerDied","Data":"55387018e677a19e873b31d6a5ac0ca69d0d871b2c3177bc5de18522cfdaf69c"}
Jul 15 15:39:25.044497 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:39:25.044458    2588 generic.go:356] "Generic (PLEG): container finished" podID="9cc5aac4-caaa-4511-b175-7162285526ef" containerID="947b12e082992374604de9ea70ca6cdfffc3e49bd488b8026c8fa2baa36bea00" exitCode=0
Jul 15 15:39:25.044878 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:39:25.044551    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rf7lt" event={"ID":"9cc5aac4-caaa-4511-b175-7162285526ef","Type":"ContainerDied","Data":"947b12e082992374604de9ea70ca6cdfffc3e49bd488b8026c8fa2baa36bea00"}
Jul 15 15:39:32.075759 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:39:32.075728    2588 generic.go:356] "Generic (PLEG): container finished" podID="9cc5aac4-caaa-4511-b175-7162285526ef" containerID="19ba8118a298a0e41aba1812e5773972312d1bc9bea80ef379a2376db832997d" exitCode=0
Jul 15 15:39:32.076106 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:39:32.075808    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rf7lt" event={"ID":"9cc5aac4-caaa-4511-b175-7162285526ef","Type":"ContainerDied","Data":"19ba8118a298a0e41aba1812e5773972312d1bc9bea80ef379a2376db832997d"}
Jul 15 15:39:33.199431 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:39:33.199399    2588 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rf7lt"
Jul 15 15:39:33.363560 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:39:33.363488    2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h47mm\" (UniqueName: \"kubernetes.io/projected/9cc5aac4-caaa-4511-b175-7162285526ef-kube-api-access-h47mm\") pod \"9cc5aac4-caaa-4511-b175-7162285526ef\" (UID: \"9cc5aac4-caaa-4511-b175-7162285526ef\") "
Jul 15 15:39:33.363686 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:39:33.363573    2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9cc5aac4-caaa-4511-b175-7162285526ef-util\") pod \"9cc5aac4-caaa-4511-b175-7162285526ef\" (UID: \"9cc5aac4-caaa-4511-b175-7162285526ef\") "
Jul 15 15:39:33.363686 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:39:33.363590    2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9cc5aac4-caaa-4511-b175-7162285526ef-bundle\") pod \"9cc5aac4-caaa-4511-b175-7162285526ef\" (UID: \"9cc5aac4-caaa-4511-b175-7162285526ef\") "
Jul 15 15:39:33.364269 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:39:33.364237    2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9cc5aac4-caaa-4511-b175-7162285526ef-bundle" (OuterVolumeSpecName: "bundle") pod "9cc5aac4-caaa-4511-b175-7162285526ef" (UID: "9cc5aac4-caaa-4511-b175-7162285526ef"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 15:39:33.365596 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:39:33.365570    2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9cc5aac4-caaa-4511-b175-7162285526ef-kube-api-access-h47mm" (OuterVolumeSpecName: "kube-api-access-h47mm") pod "9cc5aac4-caaa-4511-b175-7162285526ef" (UID: "9cc5aac4-caaa-4511-b175-7162285526ef"). InnerVolumeSpecName "kube-api-access-h47mm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 15:39:33.367725 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:39:33.367700    2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9cc5aac4-caaa-4511-b175-7162285526ef-util" (OuterVolumeSpecName: "util") pod "9cc5aac4-caaa-4511-b175-7162285526ef" (UID: "9cc5aac4-caaa-4511-b175-7162285526ef"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 15:39:33.464220 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:39:33.464187    2588 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9cc5aac4-caaa-4511-b175-7162285526ef-util\") on node \"ip-10-0-140-212.ec2.internal\" DevicePath \"\""
Jul 15 15:39:33.464220 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:39:33.464214    2588 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9cc5aac4-caaa-4511-b175-7162285526ef-bundle\") on node \"ip-10-0-140-212.ec2.internal\" DevicePath \"\""
Jul 15 15:39:33.464402 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:39:33.464227    2588 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h47mm\" (UniqueName: \"kubernetes.io/projected/9cc5aac4-caaa-4511-b175-7162285526ef-kube-api-access-h47mm\") on node \"ip-10-0-140-212.ec2.internal\" DevicePath \"\""
Jul 15 15:39:34.085166 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:39:34.085136    2588 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rf7lt"
Jul 15 15:39:34.085166 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:39:34.085154    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rf7lt" event={"ID":"9cc5aac4-caaa-4511-b175-7162285526ef","Type":"ContainerDied","Data":"2820678f74c45d8a48fe4548d1682146a1079d182a84fbbc19c68816f0547733"}
Jul 15 15:39:34.085393 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:39:34.085204    2588 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2820678f74c45d8a48fe4548d1682146a1079d182a84fbbc19c68816f0547733"
Jul 15 15:39:45.328219 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:39:45.328143    2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7ngmt"]
Jul 15 15:39:45.328707 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:39:45.328495    2588 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9cc5aac4-caaa-4511-b175-7162285526ef" containerName="extract"
Jul 15 15:39:45.328707 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:39:45.328508    2588 state_mem.go:107] "Deleted CPUSet assignment" podUID="9cc5aac4-caaa-4511-b175-7162285526ef" containerName="extract"
Jul 15 15:39:45.328707 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:39:45.328520    2588 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9cc5aac4-caaa-4511-b175-7162285526ef" containerName="util"
Jul 15 15:39:45.328707 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:39:45.328526    2588 state_mem.go:107] "Deleted CPUSet assignment" podUID="9cc5aac4-caaa-4511-b175-7162285526ef" containerName="util"
Jul 15 15:39:45.328707 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:39:45.328548    2588 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9cc5aac4-caaa-4511-b175-7162285526ef" containerName="pull"
Jul 15 15:39:45.328707 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:39:45.328554    2588 state_mem.go:107] "Deleted CPUSet assignment" podUID="9cc5aac4-caaa-4511-b175-7162285526ef" containerName="pull"
Jul 15 15:39:45.328707 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:39:45.328604    2588 memory_manager.go:368] "RemoveStaleState removing state" podUID="9cc5aac4-caaa-4511-b175-7162285526ef" containerName="extract"
Jul 15 15:39:45.334472 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:39:45.334452    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7ngmt"
Jul 15 15:39:45.337232 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:39:45.337211    2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-ztswp\""
Jul 15 15:39:45.337505 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:39:45.337486    2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 15 15:39:45.338559 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:39:45.338543    2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 15 15:39:45.350982 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:39:45.350955    2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7ngmt"]
Jul 15 15:39:45.460639 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:39:45.460601    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d8ea0141-234e-4caf-b970-dc6d466d8a7d-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7ngmt\" (UID: \"d8ea0141-234e-4caf-b970-dc6d466d8a7d\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7ngmt"
Jul 15 15:39:45.460792 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:39:45.460652    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5bwc8\" (UniqueName: \"kubernetes.io/projected/d8ea0141-234e-4caf-b970-dc6d466d8a7d-kube-api-access-5bwc8\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7ngmt\" (UID: \"d8ea0141-234e-4caf-b970-dc6d466d8a7d\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7ngmt"
Jul 15 15:39:45.460792 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:39:45.460734    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d8ea0141-234e-4caf-b970-dc6d466d8a7d-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7ngmt\" (UID: \"d8ea0141-234e-4caf-b970-dc6d466d8a7d\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7ngmt"
Jul 15 15:39:45.561589 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:39:45.561558    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d8ea0141-234e-4caf-b970-dc6d466d8a7d-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7ngmt\" (UID: \"d8ea0141-234e-4caf-b970-dc6d466d8a7d\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7ngmt"
Jul 15 15:39:45.561725 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:39:45.561600    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d8ea0141-234e-4caf-b970-dc6d466d8a7d-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7ngmt\" (UID: \"d8ea0141-234e-4caf-b970-dc6d466d8a7d\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7ngmt"
Jul 15 15:39:45.561725 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:39:45.561630    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5bwc8\" (UniqueName: \"kubernetes.io/projected/d8ea0141-234e-4caf-b970-dc6d466d8a7d-kube-api-access-5bwc8\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7ngmt\" (UID: \"d8ea0141-234e-4caf-b970-dc6d466d8a7d\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7ngmt"
Jul 15 15:39:45.562005 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:39:45.561984    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d8ea0141-234e-4caf-b970-dc6d466d8a7d-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7ngmt\" (UID: \"d8ea0141-234e-4caf-b970-dc6d466d8a7d\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7ngmt"
Jul 15 15:39:45.562042 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:39:45.561987    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d8ea0141-234e-4caf-b970-dc6d466d8a7d-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7ngmt\" (UID: \"d8ea0141-234e-4caf-b970-dc6d466d8a7d\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7ngmt"
Jul 15 15:39:45.572689 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:39:45.572666    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5bwc8\" (UniqueName: \"kubernetes.io/projected/d8ea0141-234e-4caf-b970-dc6d466d8a7d-kube-api-access-5bwc8\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7ngmt\" (UID: \"d8ea0141-234e-4caf-b970-dc6d466d8a7d\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7ngmt"
Jul 15 15:39:45.628098 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:39:45.628040    2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-sl9fj"]
Jul 15 15:39:45.631885 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:39:45.631870    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-sl9fj"
Jul 15 15:39:45.637097 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:39:45.637074    2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-7cfxh\""
Jul 15 15:39:45.642131 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:39:45.642091    2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 15 15:39:45.642424 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:39:45.642408    2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 15 15:39:45.643464 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:39:45.643449    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7ngmt"
Jul 15 15:39:45.652366 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:39:45.652333    2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-sl9fj"]
Jul 15 15:39:45.762747 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:39:45.762714    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pvk75\" (UniqueName: \"kubernetes.io/projected/13547d97-0566-4b00-a94f-c0e5f4698d5b-kube-api-access-pvk75\") pod \"cert-manager-webhook-6486ffd997-sl9fj\" (UID: \"13547d97-0566-4b00-a94f-c0e5f4698d5b\") " pod="cert-manager/cert-manager-webhook-6486ffd997-sl9fj"
Jul 15 15:39:45.762889 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:39:45.762761    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/13547d97-0566-4b00-a94f-c0e5f4698d5b-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-sl9fj\" (UID: \"13547d97-0566-4b00-a94f-c0e5f4698d5b\") " pod="cert-manager/cert-manager-webhook-6486ffd997-sl9fj"
Jul 15 15:39:45.771536 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:39:45.771515    2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7ngmt"]
Jul 15 15:39:45.773747 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:39:45.773722    2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8ea0141_234e_4caf_b970_dc6d466d8a7d.slice/crio-2bbbcd99a494e259b44b36473ce21421139b5b722a5039c6e1dc319cd1afcf95 WatchSource:0}: Error finding container 2bbbcd99a494e259b44b36473ce21421139b5b722a5039c6e1dc319cd1afcf95: Status 404 returned error can't find the container with id 2bbbcd99a494e259b44b36473ce21421139b5b722a5039c6e1dc319cd1afcf95
Jul 15 15:39:45.864169 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:39:45.864147    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pvk75\" (UniqueName: \"kubernetes.io/projected/13547d97-0566-4b00-a94f-c0e5f4698d5b-kube-api-access-pvk75\") pod \"cert-manager-webhook-6486ffd997-sl9fj\" (UID: \"13547d97-0566-4b00-a94f-c0e5f4698d5b\") " pod="cert-manager/cert-manager-webhook-6486ffd997-sl9fj"
Jul 15 15:39:45.864283 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:39:45.864183    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/13547d97-0566-4b00-a94f-c0e5f4698d5b-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-sl9fj\" (UID: \"13547d97-0566-4b00-a94f-c0e5f4698d5b\") " pod="cert-manager/cert-manager-webhook-6486ffd997-sl9fj"
Jul 15 15:39:45.875585 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:39:45.875559    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/13547d97-0566-4b00-a94f-c0e5f4698d5b-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-sl9fj\" (UID: \"13547d97-0566-4b00-a94f-c0e5f4698d5b\") " pod="cert-manager/cert-manager-webhook-6486ffd997-sl9fj"
Jul 15 15:39:45.875727 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:39:45.875710    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pvk75\" (UniqueName: \"kubernetes.io/projected/13547d97-0566-4b00-a94f-c0e5f4698d5b-kube-api-access-pvk75\") pod \"cert-manager-webhook-6486ffd997-sl9fj\" (UID: \"13547d97-0566-4b00-a94f-c0e5f4698d5b\") " pod="cert-manager/cert-manager-webhook-6486ffd997-sl9fj"
Jul 15 15:39:45.947664 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:39:45.947635    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-sl9fj"
Jul 15 15:39:46.095498 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:39:46.095475    2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-sl9fj"]
Jul 15 15:39:46.097460 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:39:46.097433    2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod13547d97_0566_4b00_a94f_c0e5f4698d5b.slice/crio-c751627af15194f5df6131c5a4d81e67c1e64b8fc37f2665e275bd9950bd8800 WatchSource:0}: Error finding container c751627af15194f5df6131c5a4d81e67c1e64b8fc37f2665e275bd9950bd8800: Status 404 returned error can't find the container with id c751627af15194f5df6131c5a4d81e67c1e64b8fc37f2665e275bd9950bd8800
Jul 15 15:39:46.131159 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:39:46.131123    2588 generic.go:356] "Generic (PLEG): container finished" podID="d8ea0141-234e-4caf-b970-dc6d466d8a7d" containerID="19660490c8b42300f6db012002dc46f9a9a273ddc4ac962ff999b43992696c91" exitCode=0
Jul 15 15:39:46.131283 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:39:46.131200    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7ngmt" event={"ID":"d8ea0141-234e-4caf-b970-dc6d466d8a7d","Type":"ContainerDied","Data":"19660490c8b42300f6db012002dc46f9a9a273ddc4ac962ff999b43992696c91"}
Jul 15 15:39:46.131283 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:39:46.131248    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7ngmt" event={"ID":"d8ea0141-234e-4caf-b970-dc6d466d8a7d","Type":"ContainerStarted","Data":"2bbbcd99a494e259b44b36473ce21421139b5b722a5039c6e1dc319cd1afcf95"}
Jul 15 15:39:46.132448 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:39:46.132427    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-sl9fj" event={"ID":"13547d97-0566-4b00-a94f-c0e5f4698d5b","Type":"ContainerStarted","Data":"c751627af15194f5df6131c5a4d81e67c1e64b8fc37f2665e275bd9950bd8800"}
Jul 15 15:39:50.154212 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:39:50.154178    2588 generic.go:356] "Generic (PLEG): container finished" podID="d8ea0141-234e-4caf-b970-dc6d466d8a7d" containerID="addb9bb70354648262d4386843ad2f21a00725a10a422500e5e6d650e997e9a0" exitCode=0
Jul 15 15:39:50.154638 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:39:50.154264    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7ngmt" event={"ID":"d8ea0141-234e-4caf-b970-dc6d466d8a7d","Type":"ContainerDied","Data":"addb9bb70354648262d4386843ad2f21a00725a10a422500e5e6d650e997e9a0"}
Jul 15 15:39:50.155813 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:39:50.155763    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-sl9fj" event={"ID":"13547d97-0566-4b00-a94f-c0e5f4698d5b","Type":"ContainerStarted","Data":"4853f6bba1a0b18722a32021574a2a4ac1226fc27480eb4f4db5c55343a78050"}
Jul 15 15:39:50.155868 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:39:50.155814    2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-sl9fj"
Jul 15 15:39:50.192111 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:39:50.192056    2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-sl9fj" podStartSLOduration=2.165708319 podStartE2EDuration="5.192036596s" totalImagesPullingTime="3.026328277s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 15:39:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:39:50.189679219 +0000 UTC m=+275.841744979" watchObservedRunningTime="2026-07-15 15:39:50.192036596 +0000 UTC m=+275.844102356"
Jul 15 15:39:51.162039 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:39:51.162007    2588 generic.go:356] "Generic (PLEG): container finished" podID="d8ea0141-234e-4caf-b970-dc6d466d8a7d" containerID="2df7d96f6ca5061f21d84817b6e75b7d315d7935885b5d553f4dbfea1c8107b2" exitCode=0
Jul 15 15:39:51.162413 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:39:51.162055    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7ngmt" event={"ID":"d8ea0141-234e-4caf-b970-dc6d466d8a7d","Type":"ContainerDied","Data":"2df7d96f6ca5061f21d84817b6e75b7d315d7935885b5d553f4dbfea1c8107b2"}
Jul 15 15:39:52.287398 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:39:52.287328    2588 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7ngmt"
Jul 15 15:39:52.415934 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:39:52.415904    2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d8ea0141-234e-4caf-b970-dc6d466d8a7d-bundle\") pod \"d8ea0141-234e-4caf-b970-dc6d466d8a7d\" (UID: \"d8ea0141-234e-4caf-b970-dc6d466d8a7d\") "
Jul 15 15:39:52.416107 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:39:52.415982    2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5bwc8\" (UniqueName: \"kubernetes.io/projected/d8ea0141-234e-4caf-b970-dc6d466d8a7d-kube-api-access-5bwc8\") pod \"d8ea0141-234e-4caf-b970-dc6d466d8a7d\" (UID: \"d8ea0141-234e-4caf-b970-dc6d466d8a7d\") "
Jul 15 15:39:52.416107 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:39:52.416033    2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d8ea0141-234e-4caf-b970-dc6d466d8a7d-util\") pod \"d8ea0141-234e-4caf-b970-dc6d466d8a7d\" (UID: \"d8ea0141-234e-4caf-b970-dc6d466d8a7d\") "
Jul 15 15:39:52.416334 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:39:52.416307    2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d8ea0141-234e-4caf-b970-dc6d466d8a7d-bundle" (OuterVolumeSpecName: "bundle") pod "d8ea0141-234e-4caf-b970-dc6d466d8a7d" (UID: "d8ea0141-234e-4caf-b970-dc6d466d8a7d"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 15:39:52.417946 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:39:52.417921    2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d8ea0141-234e-4caf-b970-dc6d466d8a7d-kube-api-access-5bwc8" (OuterVolumeSpecName: "kube-api-access-5bwc8") pod "d8ea0141-234e-4caf-b970-dc6d466d8a7d" (UID: "d8ea0141-234e-4caf-b970-dc6d466d8a7d"). InnerVolumeSpecName "kube-api-access-5bwc8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 15:39:52.419970 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:39:52.419930    2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d8ea0141-234e-4caf-b970-dc6d466d8a7d-util" (OuterVolumeSpecName: "util") pod "d8ea0141-234e-4caf-b970-dc6d466d8a7d" (UID: "d8ea0141-234e-4caf-b970-dc6d466d8a7d"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 15:39:52.517096 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:39:52.517065    2588 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5bwc8\" (UniqueName: \"kubernetes.io/projected/d8ea0141-234e-4caf-b970-dc6d466d8a7d-kube-api-access-5bwc8\") on node \"ip-10-0-140-212.ec2.internal\" DevicePath \"\""
Jul 15 15:39:52.517096 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:39:52.517091    2588 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d8ea0141-234e-4caf-b970-dc6d466d8a7d-util\") on node \"ip-10-0-140-212.ec2.internal\" DevicePath \"\""
Jul 15 15:39:52.517096 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:39:52.517100    2588 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d8ea0141-234e-4caf-b970-dc6d466d8a7d-bundle\") on node \"ip-10-0-140-212.ec2.internal\" DevicePath \"\""
Jul 15 15:39:53.171242 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:39:53.171163    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7ngmt" event={"ID":"d8ea0141-234e-4caf-b970-dc6d466d8a7d","Type":"ContainerDied","Data":"2bbbcd99a494e259b44b36473ce21421139b5b722a5039c6e1dc319cd1afcf95"}
Jul 15 15:39:53.171242 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:39:53.171209    2588 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2bbbcd99a494e259b44b36473ce21421139b5b722a5039c6e1dc319cd1afcf95"
Jul 15 15:39:53.171242 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:39:53.171213    2588 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7ngmt"
Jul 15 15:39:56.164846 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:39:56.164812    2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-sl9fj"
Jul 15 15:39:58.337422 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:39:58.337390    2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-zsxsb"]
Jul 15 15:39:58.337778 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:39:58.337714    2588 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d8ea0141-234e-4caf-b970-dc6d466d8a7d" containerName="util"
Jul 15 15:39:58.337778 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:39:58.337728    2588 state_mem.go:107] "Deleted CPUSet assignment" podUID="d8ea0141-234e-4caf-b970-dc6d466d8a7d" containerName="util"
Jul 15 15:39:58.337778 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:39:58.337740    2588 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d8ea0141-234e-4caf-b970-dc6d466d8a7d" containerName="extract"
Jul 15 15:39:58.337778 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:39:58.337748    2588 state_mem.go:107] "Deleted CPUSet assignment" podUID="d8ea0141-234e-4caf-b970-dc6d466d8a7d" containerName="extract"
Jul 15 15:39:58.337778 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:39:58.337759    2588 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d8ea0141-234e-4caf-b970-dc6d466d8a7d" containerName="pull"
Jul 15 15:39:58.337778 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:39:58.337766    2588 state_mem.go:107] "Deleted CPUSet assignment" podUID="d8ea0141-234e-4caf-b970-dc6d466d8a7d" containerName="pull"
Jul 15 15:39:58.337968 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:39:58.337832    2588 memory_manager.go:368] "RemoveStaleState removing state" podUID="d8ea0141-234e-4caf-b970-dc6d466d8a7d" containerName="extract"
Jul 15 15:39:58.344432 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:39:58.344408    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-zsxsb"
Jul 15 15:39:58.348692 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:39:58.348667    2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-jhzsz\""
Jul 15 15:39:58.367484 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:39:58.367452    2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-zsxsb"]
Jul 15 15:39:58.367776 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:39:58.367752    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/be4ec991-d0c5-47ae-a453-3ad062ad77c1-bound-sa-token\") pod \"cert-manager-55b4d954d5-zsxsb\" (UID: \"be4ec991-d0c5-47ae-a453-3ad062ad77c1\") " pod="cert-manager/cert-manager-55b4d954d5-zsxsb"
Jul 15 15:39:58.367839 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:39:58.367784    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xbwdn\" (UniqueName: \"kubernetes.io/projected/be4ec991-d0c5-47ae-a453-3ad062ad77c1-kube-api-access-xbwdn\") pod \"cert-manager-55b4d954d5-zsxsb\" (UID: \"be4ec991-d0c5-47ae-a453-3ad062ad77c1\") " pod="cert-manager/cert-manager-55b4d954d5-zsxsb"
Jul 15 15:39:58.468648 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:39:58.468609    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/be4ec991-d0c5-47ae-a453-3ad062ad77c1-bound-sa-token\") pod \"cert-manager-55b4d954d5-zsxsb\" (UID: \"be4ec991-d0c5-47ae-a453-3ad062ad77c1\") " pod="cert-manager/cert-manager-55b4d954d5-zsxsb"
Jul 15 15:39:58.468648 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:39:58.468646    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xbwdn\" (UniqueName: \"kubernetes.io/projected/be4ec991-d0c5-47ae-a453-3ad062ad77c1-kube-api-access-xbwdn\") pod \"cert-manager-55b4d954d5-zsxsb\" (UID: \"be4ec991-d0c5-47ae-a453-3ad062ad77c1\") " pod="cert-manager/cert-manager-55b4d954d5-zsxsb"
Jul 15 15:39:58.478156 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:39:58.478127    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xbwdn\" (UniqueName: \"kubernetes.io/projected/be4ec991-d0c5-47ae-a453-3ad062ad77c1-kube-api-access-xbwdn\") pod \"cert-manager-55b4d954d5-zsxsb\" (UID: \"be4ec991-d0c5-47ae-a453-3ad062ad77c1\") " pod="cert-manager/cert-manager-55b4d954d5-zsxsb"
Jul 15 15:39:58.478309 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:39:58.478180    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/be4ec991-d0c5-47ae-a453-3ad062ad77c1-bound-sa-token\") pod \"cert-manager-55b4d954d5-zsxsb\" (UID: \"be4ec991-d0c5-47ae-a453-3ad062ad77c1\") " pod="cert-manager/cert-manager-55b4d954d5-zsxsb"
Jul 15 15:39:58.653606 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:39:58.653517    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-zsxsb"
Jul 15 15:39:58.782917 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:39:58.782886    2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-zsxsb"]
Jul 15 15:39:58.784209 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:39:58.784175    2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbe4ec991_d0c5_47ae_a453_3ad062ad77c1.slice/crio-5dc7375022fd892e68a3c27fcacb837c06cc9b74981d5803a92afe728cf040c2 WatchSource:0}: Error finding container 5dc7375022fd892e68a3c27fcacb837c06cc9b74981d5803a92afe728cf040c2: Status 404 returned error can't find the container with id 5dc7375022fd892e68a3c27fcacb837c06cc9b74981d5803a92afe728cf040c2
Jul 15 15:39:59.196236 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:39:59.196201    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-zsxsb" event={"ID":"be4ec991-d0c5-47ae-a453-3ad062ad77c1","Type":"ContainerStarted","Data":"79284a6a9b9bffd03ba3aafba0fb197d0c04be1dbf7aba930340e3a47847cfa1"}
Jul 15 15:39:59.196409 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:39:59.196246    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-zsxsb" event={"ID":"be4ec991-d0c5-47ae-a453-3ad062ad77c1","Type":"ContainerStarted","Data":"5dc7375022fd892e68a3c27fcacb837c06cc9b74981d5803a92afe728cf040c2"}
Jul 15 15:39:59.228645 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:39:59.228595    2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-zsxsb" podStartSLOduration=1.2285803 podStartE2EDuration="1.2285803s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 15:39:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:39:59.228063157 +0000 UTC m=+284.880128916" watchObservedRunningTime="2026-07-15 15:39:59.2285803 +0000 UTC m=+284.880646057"
Jul 15 15:40:06.039286 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:40:06.039247    2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzqcfw"]
Jul 15 15:40:06.055292 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:40:06.055257    2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzqcfw"]
Jul 15 15:40:06.055449 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:40:06.055381    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzqcfw"
Jul 15 15:40:06.058697 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:40:06.058665    2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 15 15:40:06.058829 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:40:06.058716    2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-ztswp\""
Jul 15 15:40:06.060628 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:40:06.060605    2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 15 15:40:06.133303 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:40:06.133270    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sn76b\" (UniqueName: \"kubernetes.io/projected/1de253be-5035-4551-a897-21b5413ca18a-kube-api-access-sn76b\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzqcfw\" (UID: \"1de253be-5035-4551-a897-21b5413ca18a\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzqcfw"
Jul 15 15:40:06.133483 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:40:06.133321    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1de253be-5035-4551-a897-21b5413ca18a-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzqcfw\" (UID: \"1de253be-5035-4551-a897-21b5413ca18a\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzqcfw"
Jul 15 15:40:06.133483 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:40:06.133426    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1de253be-5035-4551-a897-21b5413ca18a-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzqcfw\" (UID: \"1de253be-5035-4551-a897-21b5413ca18a\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzqcfw"
Jul 15 15:40:06.234045 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:40:06.234014    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1de253be-5035-4551-a897-21b5413ca18a-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzqcfw\" (UID: \"1de253be-5035-4551-a897-21b5413ca18a\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzqcfw"
Jul 15 15:40:06.234233 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:40:06.234094    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sn76b\" (UniqueName: \"kubernetes.io/projected/1de253be-5035-4551-a897-21b5413ca18a-kube-api-access-sn76b\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzqcfw\" (UID: \"1de253be-5035-4551-a897-21b5413ca18a\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzqcfw"
Jul 15 15:40:06.234233 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:40:06.234138    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1de253be-5035-4551-a897-21b5413ca18a-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzqcfw\" (UID: \"1de253be-5035-4551-a897-21b5413ca18a\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzqcfw"
Jul 15 15:40:06.234412 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:40:06.234394    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1de253be-5035-4551-a897-21b5413ca18a-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzqcfw\" (UID: \"1de253be-5035-4551-a897-21b5413ca18a\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzqcfw"
Jul 15 15:40:06.234507 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:40:06.234486    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1de253be-5035-4551-a897-21b5413ca18a-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzqcfw\" (UID: \"1de253be-5035-4551-a897-21b5413ca18a\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzqcfw"
Jul 15 15:40:06.249243 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:40:06.249210    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sn76b\" (UniqueName: \"kubernetes.io/projected/1de253be-5035-4551-a897-21b5413ca18a-kube-api-access-sn76b\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzqcfw\" (UID: \"1de253be-5035-4551-a897-21b5413ca18a\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzqcfw"
Jul 15 15:40:06.366133 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:40:06.366097    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzqcfw"
Jul 15 15:40:06.500909 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:40:06.500878    2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzqcfw"]
Jul 15 15:40:06.503823 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:40:06.503790    2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1de253be_5035_4551_a897_21b5413ca18a.slice/crio-cc5fcc194df11e3b97e59dc5bb83561c06ed2b86cceaf17edad0270d1ad15d2b WatchSource:0}: Error finding container cc5fcc194df11e3b97e59dc5bb83561c06ed2b86cceaf17edad0270d1ad15d2b: Status 404 returned error can't find the container with id cc5fcc194df11e3b97e59dc5bb83561c06ed2b86cceaf17edad0270d1ad15d2b
Jul 15 15:40:07.230888 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:40:07.230853    2588 generic.go:356] "Generic (PLEG): container finished" podID="1de253be-5035-4551-a897-21b5413ca18a" containerID="743a1ab8121e5151453f04b9c046fb418a0fe5aefbc9c3224eb56358fe008d03" exitCode=0
Jul 15 15:40:07.231257 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:40:07.230943    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzqcfw" event={"ID":"1de253be-5035-4551-a897-21b5413ca18a","Type":"ContainerDied","Data":"743a1ab8121e5151453f04b9c046fb418a0fe5aefbc9c3224eb56358fe008d03"}
Jul 15 15:40:07.231257 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:40:07.230995    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzqcfw" event={"ID":"1de253be-5035-4551-a897-21b5413ca18a","Type":"ContainerStarted","Data":"cc5fcc194df11e3b97e59dc5bb83561c06ed2b86cceaf17edad0270d1ad15d2b"}
Jul 15 15:40:08.237661 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:40:08.237624    2588 generic.go:356] "Generic (PLEG): container finished" podID="1de253be-5035-4551-a897-21b5413ca18a" containerID="69eb54a31a41a12b2aebde92fcc6224a4215b441c3220a7597d05099b4859b6d" exitCode=0
Jul 15 15:40:08.238060 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:40:08.237686    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzqcfw" event={"ID":"1de253be-5035-4551-a897-21b5413ca18a","Type":"ContainerDied","Data":"69eb54a31a41a12b2aebde92fcc6224a4215b441c3220a7597d05099b4859b6d"}
Jul 15 15:40:09.244203 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:40:09.244169    2588 generic.go:356] "Generic (PLEG): container finished" podID="1de253be-5035-4551-a897-21b5413ca18a" containerID="c0fab7c179e79788bca918e70b1e2c3b050f34b04874c8215ca066b535a1f5e5" exitCode=0
Jul 15 15:40:09.244618 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:40:09.244254    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzqcfw" event={"ID":"1de253be-5035-4551-a897-21b5413ca18a","Type":"ContainerDied","Data":"c0fab7c179e79788bca918e70b1e2c3b050f34b04874c8215ca066b535a1f5e5"}
Jul 15 15:40:10.366211 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:40:10.366186    2588 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzqcfw"
Jul 15 15:40:10.470046 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:40:10.470009    2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sn76b\" (UniqueName: \"kubernetes.io/projected/1de253be-5035-4551-a897-21b5413ca18a-kube-api-access-sn76b\") pod \"1de253be-5035-4551-a897-21b5413ca18a\" (UID: \"1de253be-5035-4551-a897-21b5413ca18a\") "
Jul 15 15:40:10.470236 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:40:10.470065    2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1de253be-5035-4551-a897-21b5413ca18a-util\") pod \"1de253be-5035-4551-a897-21b5413ca18a\" (UID: \"1de253be-5035-4551-a897-21b5413ca18a\") "
Jul 15 15:40:10.470236 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:40:10.470103    2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1de253be-5035-4551-a897-21b5413ca18a-bundle\") pod \"1de253be-5035-4551-a897-21b5413ca18a\" (UID: \"1de253be-5035-4551-a897-21b5413ca18a\") "
Jul 15 15:40:10.470818 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:40:10.470786    2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1de253be-5035-4551-a897-21b5413ca18a-bundle" (OuterVolumeSpecName: "bundle") pod "1de253be-5035-4551-a897-21b5413ca18a" (UID: "1de253be-5035-4551-a897-21b5413ca18a"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 15:40:10.472151 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:40:10.472131    2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1de253be-5035-4551-a897-21b5413ca18a-kube-api-access-sn76b" (OuterVolumeSpecName: "kube-api-access-sn76b") pod "1de253be-5035-4551-a897-21b5413ca18a" (UID: "1de253be-5035-4551-a897-21b5413ca18a"). InnerVolumeSpecName "kube-api-access-sn76b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 15:40:10.476066 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:40:10.476029    2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1de253be-5035-4551-a897-21b5413ca18a-util" (OuterVolumeSpecName: "util") pod "1de253be-5035-4551-a897-21b5413ca18a" (UID: "1de253be-5035-4551-a897-21b5413ca18a"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 15:40:10.570902 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:40:10.570799    2588 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1de253be-5035-4551-a897-21b5413ca18a-bundle\") on node \"ip-10-0-140-212.ec2.internal\" DevicePath \"\""
Jul 15 15:40:10.570902 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:40:10.570845    2588 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sn76b\" (UniqueName: \"kubernetes.io/projected/1de253be-5035-4551-a897-21b5413ca18a-kube-api-access-sn76b\") on node \"ip-10-0-140-212.ec2.internal\" DevicePath \"\""
Jul 15 15:40:10.570902 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:40:10.570858    2588 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1de253be-5035-4551-a897-21b5413ca18a-util\") on node \"ip-10-0-140-212.ec2.internal\" DevicePath \"\""
Jul 15 15:40:11.254355 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:40:11.254249    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzqcfw" event={"ID":"1de253be-5035-4551-a897-21b5413ca18a","Type":"ContainerDied","Data":"cc5fcc194df11e3b97e59dc5bb83561c06ed2b86cceaf17edad0270d1ad15d2b"}
Jul 15 15:40:11.254355 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:40:11.254292    2588 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzqcfw"
Jul 15 15:40:11.254355 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:40:11.254306    2588 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cc5fcc194df11e3b97e59dc5bb83561c06ed2b86cceaf17edad0270d1ad15d2b"
Jul 15 15:40:14.731220 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:40:14.731193    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-5f7f494dd4-lbdlp_c80ed5cd-4b7c-4981-95c6-a02cf058f709/cluster-monitoring-operator/0.log"
Jul 15 15:40:14.732407 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:40:14.732385    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-5f7f494dd4-lbdlp_c80ed5cd-4b7c-4981-95c6-a02cf058f709/cluster-monitoring-operator/0.log"
Jul 15 15:40:14.743868 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:40:14.743846    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-qcvqk_eb866034-d7d1-4bee-b8b7-616b355d371d/console-operator/1.log"
Jul 15 15:40:14.744610 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:40:14.744593    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-qcvqk_eb866034-d7d1-4bee-b8b7-616b355d371d/console-operator/1.log"
Jul 15 15:40:14.746510 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:40:14.746487    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dthn7_ec82e02f-7632-41be-8e7d-8c9d59c569b6/ovn-acl-logging/0.log"
Jul 15 15:40:14.747378 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:40:14.747358    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dthn7_ec82e02f-7632-41be-8e7d-8c9d59c569b6/ovn-acl-logging/0.log"
Jul 15 15:40:14.753862 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:40:14.753838    2588 kubelet.go:1648] "Image garbage collection succeeded"
Jul 15 15:40:22.279199 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:40:22.279158    2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5ccf5c88b7-gvhbs"]
Jul 15 15:40:22.331752 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:40:22.279621    2588 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1de253be-5035-4551-a897-21b5413ca18a" containerName="util"
Jul 15 15:40:22.331752 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:40:22.279640    2588 state_mem.go:107] "Deleted CPUSet assignment" podUID="1de253be-5035-4551-a897-21b5413ca18a" containerName="util"
Jul 15 15:40:22.331752 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:40:22.279660    2588 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1de253be-5035-4551-a897-21b5413ca18a" containerName="pull"
Jul 15 15:40:22.331752 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:40:22.279665    2588 state_mem.go:107] "Deleted CPUSet assignment" podUID="1de253be-5035-4551-a897-21b5413ca18a" containerName="pull"
Jul 15 15:40:22.331752 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:40:22.279679    2588 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1de253be-5035-4551-a897-21b5413ca18a" containerName="extract"
Jul 15 15:40:22.331752 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:40:22.279684    2588 state_mem.go:107] "Deleted CPUSet assignment" podUID="1de253be-5035-4551-a897-21b5413ca18a" containerName="extract"
Jul 15 15:40:22.331752 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:40:22.279738    2588 memory_manager.go:368] "RemoveStaleState removing state" podUID="1de253be-5035-4551-a897-21b5413ca18a" containerName="extract"
Jul 15 15:40:22.331752 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:40:22.331745    2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5ccf5c88b7-gvhbs"]
Jul 15 15:40:22.332087 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:40:22.331863    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5ccf5c88b7-gvhbs"
Jul 15 15:40:22.335022 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:40:22.335003    2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 15 15:40:22.335119 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:40:22.335104    2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 15 15:40:22.335158 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:40:22.335120    2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-jkffr\""
Jul 15 15:40:22.335416 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:40:22.335392    2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 15 15:40:22.335513 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:40:22.335396    2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 15 15:40:22.466081 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:40:22.466044    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cc9da0b6-3217-4453-a94b-88b45bfdc6c5-tmp\") pod \"opendatahub-operator-controller-manager-5ccf5c88b7-gvhbs\" (UID: \"cc9da0b6-3217-4453-a94b-88b45bfdc6c5\") " pod="opendatahub/opendatahub-operator-controller-manager-5ccf5c88b7-gvhbs"
Jul 15 15:40:22.466081 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:40:22.466079    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/cc9da0b6-3217-4453-a94b-88b45bfdc6c5-webhook-cert\") pod \"opendatahub-operator-controller-manager-5ccf5c88b7-gvhbs\" (UID: \"cc9da0b6-3217-4453-a94b-88b45bfdc6c5\") " pod="opendatahub/opendatahub-operator-controller-manager-5ccf5c88b7-gvhbs"
Jul 15 15:40:22.466305 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:40:22.466167    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2czbj\" (UniqueName: \"kubernetes.io/projected/cc9da0b6-3217-4453-a94b-88b45bfdc6c5-kube-api-access-2czbj\") pod \"opendatahub-operator-controller-manager-5ccf5c88b7-gvhbs\" (UID: \"cc9da0b6-3217-4453-a94b-88b45bfdc6c5\") " pod="opendatahub/opendatahub-operator-controller-manager-5ccf5c88b7-gvhbs"
Jul 15 15:40:22.466305 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:40:22.466212    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/cc9da0b6-3217-4453-a94b-88b45bfdc6c5-manifests\") pod \"opendatahub-operator-controller-manager-5ccf5c88b7-gvhbs\" (UID: \"cc9da0b6-3217-4453-a94b-88b45bfdc6c5\") " pod="opendatahub/opendatahub-operator-controller-manager-5ccf5c88b7-gvhbs"
Jul 15 15:40:22.466305 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:40:22.466281    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/cc9da0b6-3217-4453-a94b-88b45bfdc6c5-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5ccf5c88b7-gvhbs\" (UID: \"cc9da0b6-3217-4453-a94b-88b45bfdc6c5\") " pod="opendatahub/opendatahub-operator-controller-manager-5ccf5c88b7-gvhbs"
Jul 15 15:40:22.567754 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:40:22.567666    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/cc9da0b6-3217-4453-a94b-88b45bfdc6c5-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5ccf5c88b7-gvhbs\" (UID: \"cc9da0b6-3217-4453-a94b-88b45bfdc6c5\") " pod="opendatahub/opendatahub-operator-controller-manager-5ccf5c88b7-gvhbs"
Jul 15 15:40:22.567754 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:40:22.567711    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cc9da0b6-3217-4453-a94b-88b45bfdc6c5-tmp\") pod \"opendatahub-operator-controller-manager-5ccf5c88b7-gvhbs\" (UID: \"cc9da0b6-3217-4453-a94b-88b45bfdc6c5\") " pod="opendatahub/opendatahub-operator-controller-manager-5ccf5c88b7-gvhbs"
Jul 15 15:40:22.567754 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:40:22.567728    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/cc9da0b6-3217-4453-a94b-88b45bfdc6c5-webhook-cert\") pod \"opendatahub-operator-controller-manager-5ccf5c88b7-gvhbs\" (UID: \"cc9da0b6-3217-4453-a94b-88b45bfdc6c5\") " pod="opendatahub/opendatahub-operator-controller-manager-5ccf5c88b7-gvhbs"
Jul 15 15:40:22.567971 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:40:22.567782    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2czbj\" (UniqueName: \"kubernetes.io/projected/cc9da0b6-3217-4453-a94b-88b45bfdc6c5-kube-api-access-2czbj\") pod \"opendatahub-operator-controller-manager-5ccf5c88b7-gvhbs\" (UID: \"cc9da0b6-3217-4453-a94b-88b45bfdc6c5\") " pod="opendatahub/opendatahub-operator-controller-manager-5ccf5c88b7-gvhbs"
Jul 15 15:40:22.567971 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:40:22.567815    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/cc9da0b6-3217-4453-a94b-88b45bfdc6c5-manifests\") pod \"opendatahub-operator-controller-manager-5ccf5c88b7-gvhbs\" (UID: \"cc9da0b6-3217-4453-a94b-88b45bfdc6c5\") " pod="opendatahub/opendatahub-operator-controller-manager-5ccf5c88b7-gvhbs"
Jul 15 15:40:22.568217 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:40:22.568190    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/cc9da0b6-3217-4453-a94b-88b45bfdc6c5-manifests\") pod \"opendatahub-operator-controller-manager-5ccf5c88b7-gvhbs\" (UID: \"cc9da0b6-3217-4453-a94b-88b45bfdc6c5\") " pod="opendatahub/opendatahub-operator-controller-manager-5ccf5c88b7-gvhbs"
Jul 15 15:40:22.570005 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:40:22.569984    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cc9da0b6-3217-4453-a94b-88b45bfdc6c5-tmp\") pod \"opendatahub-operator-controller-manager-5ccf5c88b7-gvhbs\" (UID: \"cc9da0b6-3217-4453-a94b-88b45bfdc6c5\") " pod="opendatahub/opendatahub-operator-controller-manager-5ccf5c88b7-gvhbs"
Jul 15 15:40:22.570285 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:40:22.570268    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/cc9da0b6-3217-4453-a94b-88b45bfdc6c5-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5ccf5c88b7-gvhbs\" (UID: \"cc9da0b6-3217-4453-a94b-88b45bfdc6c5\") " pod="opendatahub/opendatahub-operator-controller-manager-5ccf5c88b7-gvhbs"
Jul 15 15:40:22.570447 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:40:22.570425    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/cc9da0b6-3217-4453-a94b-88b45bfdc6c5-webhook-cert\") pod \"opendatahub-operator-controller-manager-5ccf5c88b7-gvhbs\" (UID: \"cc9da0b6-3217-4453-a94b-88b45bfdc6c5\") " pod="opendatahub/opendatahub-operator-controller-manager-5ccf5c88b7-gvhbs"
Jul 15 15:40:22.576802 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:40:22.576781    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2czbj\" (UniqueName: \"kubernetes.io/projected/cc9da0b6-3217-4453-a94b-88b45bfdc6c5-kube-api-access-2czbj\") pod \"opendatahub-operator-controller-manager-5ccf5c88b7-gvhbs\" (UID: \"cc9da0b6-3217-4453-a94b-88b45bfdc6c5\") " pod="opendatahub/opendatahub-operator-controller-manager-5ccf5c88b7-gvhbs"
Jul 15 15:40:22.642171 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:40:22.642130    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5ccf5c88b7-gvhbs"
Jul 15 15:40:22.805309 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:40:22.805282    2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5ccf5c88b7-gvhbs"]
Jul 15 15:40:22.806625 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:40:22.806601    2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc9da0b6_3217_4453_a94b_88b45bfdc6c5.slice/crio-87f778ae38f126e9c8c814ecee2d23ab472d6176cd0261f36f20108ec8d047b7 WatchSource:0}: Error finding container 87f778ae38f126e9c8c814ecee2d23ab472d6176cd0261f36f20108ec8d047b7: Status 404 returned error can't find the container with id 87f778ae38f126e9c8c814ecee2d23ab472d6176cd0261f36f20108ec8d047b7
Jul 15 15:40:22.808305 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:40:22.808287    2588 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 15 15:40:23.312362 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:40:23.312312    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5ccf5c88b7-gvhbs" event={"ID":"cc9da0b6-3217-4453-a94b-88b45bfdc6c5","Type":"ContainerStarted","Data":"87f778ae38f126e9c8c814ecee2d23ab472d6176cd0261f36f20108ec8d047b7"}
Jul 15 15:40:26.328391 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:40:26.328330    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5ccf5c88b7-gvhbs" event={"ID":"cc9da0b6-3217-4453-a94b-88b45bfdc6c5","Type":"ContainerStarted","Data":"a53e3c41e520c4e443eccff26baa08a82074575cb6284776e2effcfd431e1e51"}
Jul 15 15:40:27.334603 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:40:27.334568    2588 generic.go:356] "Generic (PLEG): container finished" podID="cc9da0b6-3217-4453-a94b-88b45bfdc6c5" containerID="a53e3c41e520c4e443eccff26baa08a82074575cb6284776e2effcfd431e1e51" exitCode=0
Jul 15 15:40:27.335024 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:40:27.334651    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5ccf5c88b7-gvhbs" event={"ID":"cc9da0b6-3217-4453-a94b-88b45bfdc6c5","Type":"ContainerDied","Data":"a53e3c41e520c4e443eccff26baa08a82074575cb6284776e2effcfd431e1e51"}
Jul 15 15:40:29.347009 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:40:29.346974    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5ccf5c88b7-gvhbs" event={"ID":"cc9da0b6-3217-4453-a94b-88b45bfdc6c5","Type":"ContainerStarted","Data":"6a1584f4cadc07155cdbdb44c3ec3bffe39f8f9dfa4d73b17b9b0dd2ffe1a49a"}
Jul 15 15:40:29.347508 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:40:29.347106    2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-5ccf5c88b7-gvhbs"
Jul 15 15:40:29.378759 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:40:29.378702    2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-5ccf5c88b7-gvhbs" podStartSLOduration=2.236391039 podStartE2EDuration="7.378683424s" totalImagesPullingTime="4.055613468s" totalInitContainerRuntime="1.086678917s" isStatefulPod=false podCreationTimestamp="2026-07-15 15:40:22 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:40:29.376182278 +0000 UTC m=+315.028248036" watchObservedRunningTime="2026-07-15 15:40:29.378683424 +0000 UTC m=+315.030749182"
Jul 15 15:40:40.353977 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:40:40.353942    2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-5ccf5c88b7-gvhbs"
Jul 15 15:40:42.416522 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:40:42.416487    2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-7cbcc54d95-fvdjg"]
Jul 15 15:40:42.421008 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:40:42.420979    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7cbcc54d95-fvdjg"
Jul 15 15:40:42.424989 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:40:42.424959    2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 15 15:40:42.425271 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:40:42.425253    2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 15 15:40:42.427068 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:40:42.427050    2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-qn2m8\""
Jul 15 15:40:42.437517 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:40:42.437494    2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7cbcc54d95-fvdjg"]
Jul 15 15:40:42.541984 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:40:42.541951    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b73ec7e0-b8b7-48c1-8e9b-59fac8eee5c2-tmp\") pod \"kube-auth-proxy-7cbcc54d95-fvdjg\" (UID: \"b73ec7e0-b8b7-48c1-8e9b-59fac8eee5c2\") " pod="openshift-ingress/kube-auth-proxy-7cbcc54d95-fvdjg"
Jul 15 15:40:42.542123 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:40:42.542036    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b73ec7e0-b8b7-48c1-8e9b-59fac8eee5c2-tls-certs\") pod \"kube-auth-proxy-7cbcc54d95-fvdjg\" (UID: \"b73ec7e0-b8b7-48c1-8e9b-59fac8eee5c2\") " pod="openshift-ingress/kube-auth-proxy-7cbcc54d95-fvdjg"
Jul 15 15:40:42.542123 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:40:42.542059    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2h9v6\" (UniqueName: \"kubernetes.io/projected/b73ec7e0-b8b7-48c1-8e9b-59fac8eee5c2-kube-api-access-2h9v6\") pod \"kube-auth-proxy-7cbcc54d95-fvdjg\" (UID: \"b73ec7e0-b8b7-48c1-8e9b-59fac8eee5c2\") " pod="openshift-ingress/kube-auth-proxy-7cbcc54d95-fvdjg"
Jul 15 15:40:42.643031 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:40:42.642996    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b73ec7e0-b8b7-48c1-8e9b-59fac8eee5c2-tls-certs\") pod \"kube-auth-proxy-7cbcc54d95-fvdjg\" (UID: \"b73ec7e0-b8b7-48c1-8e9b-59fac8eee5c2\") " pod="openshift-ingress/kube-auth-proxy-7cbcc54d95-fvdjg"
Jul 15 15:40:42.643031 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:40:42.643036    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2h9v6\" (UniqueName: \"kubernetes.io/projected/b73ec7e0-b8b7-48c1-8e9b-59fac8eee5c2-kube-api-access-2h9v6\") pod \"kube-auth-proxy-7cbcc54d95-fvdjg\" (UID: \"b73ec7e0-b8b7-48c1-8e9b-59fac8eee5c2\") " pod="openshift-ingress/kube-auth-proxy-7cbcc54d95-fvdjg"
Jul 15 15:40:42.643210 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:40:42.643073    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b73ec7e0-b8b7-48c1-8e9b-59fac8eee5c2-tmp\") pod \"kube-auth-proxy-7cbcc54d95-fvdjg\" (UID: \"b73ec7e0-b8b7-48c1-8e9b-59fac8eee5c2\") " pod="openshift-ingress/kube-auth-proxy-7cbcc54d95-fvdjg"
Jul 15 15:40:42.645361 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:40:42.645314    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b73ec7e0-b8b7-48c1-8e9b-59fac8eee5c2-tmp\") pod \"kube-auth-proxy-7cbcc54d95-fvdjg\" (UID: \"b73ec7e0-b8b7-48c1-8e9b-59fac8eee5c2\") " pod="openshift-ingress/kube-auth-proxy-7cbcc54d95-fvdjg"
Jul 15 15:40:42.645491 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:40:42.645472    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b73ec7e0-b8b7-48c1-8e9b-59fac8eee5c2-tls-certs\") pod \"kube-auth-proxy-7cbcc54d95-fvdjg\" (UID: \"b73ec7e0-b8b7-48c1-8e9b-59fac8eee5c2\") " pod="openshift-ingress/kube-auth-proxy-7cbcc54d95-fvdjg"
Jul 15 15:40:42.657187 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:40:42.657163    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2h9v6\" (UniqueName: \"kubernetes.io/projected/b73ec7e0-b8b7-48c1-8e9b-59fac8eee5c2-kube-api-access-2h9v6\") pod \"kube-auth-proxy-7cbcc54d95-fvdjg\" (UID: \"b73ec7e0-b8b7-48c1-8e9b-59fac8eee5c2\") " pod="openshift-ingress/kube-auth-proxy-7cbcc54d95-fvdjg"
Jul 15 15:40:42.696222 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:40:42.696148    2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-bhhnq"]
Jul 15 15:40:42.699491 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:40:42.699474    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-bhhnq"
Jul 15 15:40:42.702596 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:40:42.702576    2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Jul 15 15:40:42.703081 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:40:42.703067    2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-b6ctr\""
Jul 15 15:40:42.720710 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:40:42.720686    2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-bhhnq"]
Jul 15 15:40:42.730596 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:40:42.730577    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7cbcc54d95-fvdjg"
Jul 15 15:40:42.844866 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:40:42.844835    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/24cea7a7-5f27-4068-86c3-e30347ad29ee-cert\") pod \"odh-model-controller-7998c67dc4-bhhnq\" (UID: \"24cea7a7-5f27-4068-86c3-e30347ad29ee\") " pod="opendatahub/odh-model-controller-7998c67dc4-bhhnq"
Jul 15 15:40:42.845029 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:40:42.844967    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kshnc\" (UniqueName: \"kubernetes.io/projected/24cea7a7-5f27-4068-86c3-e30347ad29ee-kube-api-access-kshnc\") pod \"odh-model-controller-7998c67dc4-bhhnq\" (UID: \"24cea7a7-5f27-4068-86c3-e30347ad29ee\") " pod="opendatahub/odh-model-controller-7998c67dc4-bhhnq"
Jul 15 15:40:42.882887 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:40:42.882865    2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7cbcc54d95-fvdjg"]
Jul 15 15:40:42.885136 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:40:42.885108    2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb73ec7e0_b8b7_48c1_8e9b_59fac8eee5c2.slice/crio-81fbcaa0c28480db3b651c9d2d9c18500f0afaece975912b9031fe2875169e69 WatchSource:0}: Error finding container 81fbcaa0c28480db3b651c9d2d9c18500f0afaece975912b9031fe2875169e69: Status 404 returned error can't find the container with id 81fbcaa0c28480db3b651c9d2d9c18500f0afaece975912b9031fe2875169e69
Jul 15 15:40:42.946479 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:40:42.946402    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/24cea7a7-5f27-4068-86c3-e30347ad29ee-cert\") pod \"odh-model-controller-7998c67dc4-bhhnq\" (UID: \"24cea7a7-5f27-4068-86c3-e30347ad29ee\") " pod="opendatahub/odh-model-controller-7998c67dc4-bhhnq"
Jul 15 15:40:42.946615 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:40:42.946504    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kshnc\" (UniqueName: \"kubernetes.io/projected/24cea7a7-5f27-4068-86c3-e30347ad29ee-kube-api-access-kshnc\") pod \"odh-model-controller-7998c67dc4-bhhnq\" (UID: \"24cea7a7-5f27-4068-86c3-e30347ad29ee\") " pod="opendatahub/odh-model-controller-7998c67dc4-bhhnq"
Jul 15 15:40:42.946615 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:40:42.946563    2588 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Jul 15 15:40:42.946687 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:40:42.946629    2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/24cea7a7-5f27-4068-86c3-e30347ad29ee-cert podName:24cea7a7-5f27-4068-86c3-e30347ad29ee nodeName:}" failed. No retries permitted until 2026-07-15 15:40:43.446607728 +0000 UTC m=+329.098673487 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/24cea7a7-5f27-4068-86c3-e30347ad29ee-cert") pod "odh-model-controller-7998c67dc4-bhhnq" (UID: "24cea7a7-5f27-4068-86c3-e30347ad29ee") : secret "odh-model-controller-webhook-cert" not found
Jul 15 15:40:42.968031 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:40:42.968005    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kshnc\" (UniqueName: \"kubernetes.io/projected/24cea7a7-5f27-4068-86c3-e30347ad29ee-kube-api-access-kshnc\") pod \"odh-model-controller-7998c67dc4-bhhnq\" (UID: \"24cea7a7-5f27-4068-86c3-e30347ad29ee\") " pod="opendatahub/odh-model-controller-7998c67dc4-bhhnq"
Jul 15 15:40:43.414412 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:40:43.414369    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7cbcc54d95-fvdjg" event={"ID":"b73ec7e0-b8b7-48c1-8e9b-59fac8eee5c2","Type":"ContainerStarted","Data":"81fbcaa0c28480db3b651c9d2d9c18500f0afaece975912b9031fe2875169e69"}
Jul 15 15:40:43.450712 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:40:43.450677    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/24cea7a7-5f27-4068-86c3-e30347ad29ee-cert\") pod \"odh-model-controller-7998c67dc4-bhhnq\" (UID: \"24cea7a7-5f27-4068-86c3-e30347ad29ee\") " pod="opendatahub/odh-model-controller-7998c67dc4-bhhnq"
Jul 15 15:40:43.453045 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:40:43.453019    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/24cea7a7-5f27-4068-86c3-e30347ad29ee-cert\") pod \"odh-model-controller-7998c67dc4-bhhnq\" (UID: \"24cea7a7-5f27-4068-86c3-e30347ad29ee\") " pod="opendatahub/odh-model-controller-7998c67dc4-bhhnq"
Jul 15 15:40:43.609771 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:40:43.609731    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-bhhnq"
Jul 15 15:40:43.760568 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:40:43.760534    2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-bhhnq"]
Jul 15 15:40:43.762580 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:40:43.762551    2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod24cea7a7_5f27_4068_86c3_e30347ad29ee.slice/crio-53526546cdd3d559badf2f2478959a8beff50c63aaf84ca8b933dbf0946ae671 WatchSource:0}: Error finding container 53526546cdd3d559badf2f2478959a8beff50c63aaf84ca8b933dbf0946ae671: Status 404 returned error can't find the container with id 53526546cdd3d559badf2f2478959a8beff50c63aaf84ca8b933dbf0946ae671
Jul 15 15:40:43.910496 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:40:43.910459    2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-grgn6"]
Jul 15 15:40:43.915414 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:40:43.915389    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-grgn6"
Jul 15 15:40:43.918552 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:40:43.918396    2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Jul 15 15:40:43.918552 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:40:43.918445    2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-9z82j\""
Jul 15 15:40:43.926458 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:40:43.926402    2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-grgn6"]
Jul 15 15:40:44.057549 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:40:44.057461    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ghwn6\" (UniqueName: \"kubernetes.io/projected/614f35e9-c64c-4d97-91d6-81180d6e13b3-kube-api-access-ghwn6\") pod \"model-serving-api-54d89bd5fc-grgn6\" (UID: \"614f35e9-c64c-4d97-91d6-81180d6e13b3\") " pod="opendatahub/model-serving-api-54d89bd5fc-grgn6"
Jul 15 15:40:44.057549 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:40:44.057522    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/614f35e9-c64c-4d97-91d6-81180d6e13b3-tls-certs\") pod \"model-serving-api-54d89bd5fc-grgn6\" (UID: \"614f35e9-c64c-4d97-91d6-81180d6e13b3\") " pod="opendatahub/model-serving-api-54d89bd5fc-grgn6"
Jul 15 15:40:44.139527 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:40:44.139495    2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-fz6hk"]
Jul 15 15:40:44.143034 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:40:44.143016    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-fz6hk"
Jul 15 15:40:44.146066 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:40:44.146039    2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 15 15:40:44.146166 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:40:44.146044    2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-6nnmz\""
Jul 15 15:40:44.146166 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:40:44.146043    2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 15 15:40:44.146288 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:40:44.146043    2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 15 15:40:44.146288 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:40:44.146091    2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 15 15:40:44.157781 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:40:44.157751    2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-fz6hk"]
Jul 15 15:40:44.158148 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:40:44.158114    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/614f35e9-c64c-4d97-91d6-81180d6e13b3-tls-certs\") pod \"model-serving-api-54d89bd5fc-grgn6\" (UID: \"614f35e9-c64c-4d97-91d6-81180d6e13b3\") " pod="opendatahub/model-serving-api-54d89bd5fc-grgn6"
Jul 15 15:40:44.158264 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:40:44.158214    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ghwn6\" (UniqueName: \"kubernetes.io/projected/614f35e9-c64c-4d97-91d6-81180d6e13b3-kube-api-access-ghwn6\") pod \"model-serving-api-54d89bd5fc-grgn6\" (UID: \"614f35e9-c64c-4d97-91d6-81180d6e13b3\") " pod="opendatahub/model-serving-api-54d89bd5fc-grgn6"
Jul 15 15:40:44.158264 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:40:44.158249    2588 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found
Jul 15 15:40:44.158411 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:40:44.158335    2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/614f35e9-c64c-4d97-91d6-81180d6e13b3-tls-certs podName:614f35e9-c64c-4d97-91d6-81180d6e13b3 nodeName:}" failed. No retries permitted until 2026-07-15 15:40:44.658313253 +0000 UTC m=+330.310379005 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/614f35e9-c64c-4d97-91d6-81180d6e13b3-tls-certs") pod "model-serving-api-54d89bd5fc-grgn6" (UID: "614f35e9-c64c-4d97-91d6-81180d6e13b3") : secret "model-serving-api-tls" not found
Jul 15 15:40:44.177819 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:40:44.177794    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ghwn6\" (UniqueName: \"kubernetes.io/projected/614f35e9-c64c-4d97-91d6-81180d6e13b3-kube-api-access-ghwn6\") pod \"model-serving-api-54d89bd5fc-grgn6\" (UID: \"614f35e9-c64c-4d97-91d6-81180d6e13b3\") " pod="opendatahub/model-serving-api-54d89bd5fc-grgn6"
Jul 15 15:40:44.259510 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:40:44.259471    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/61b7df65-bf6b-461b-8482-0dfda6082e36-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-fz6hk\" (UID: \"61b7df65-bf6b-461b-8482-0dfda6082e36\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-fz6hk"
Jul 15 15:40:44.259674 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:40:44.259601    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jkkz9\" (UniqueName: \"kubernetes.io/projected/61b7df65-bf6b-461b-8482-0dfda6082e36-kube-api-access-jkkz9\") pod \"istiod-openshift-gateway-7574459656-fz6hk\" (UID: \"61b7df65-bf6b-461b-8482-0dfda6082e36\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-fz6hk"
Jul 15 15:40:44.259735 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:40:44.259678    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/61b7df65-bf6b-461b-8482-0dfda6082e36-istio-token\") pod \"istiod-openshift-gateway-7574459656-fz6hk\" (UID: \"61b7df65-bf6b-461b-8482-0dfda6082e36\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-fz6hk"
Jul 15 15:40:44.259779 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:40:44.259732    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/61b7df65-bf6b-461b-8482-0dfda6082e36-local-certs\") pod \"istiod-openshift-gateway-7574459656-fz6hk\" (UID: \"61b7df65-bf6b-461b-8482-0dfda6082e36\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-fz6hk"
Jul 15 15:40:44.259779 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:40:44.259759    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/61b7df65-bf6b-461b-8482-0dfda6082e36-cacerts\") pod \"istiod-openshift-gateway-7574459656-fz6hk\" (UID: \"61b7df65-bf6b-461b-8482-0dfda6082e36\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-fz6hk"
Jul 15 15:40:44.259853 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:40:44.259814    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/61b7df65-bf6b-461b-8482-0dfda6082e36-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-fz6hk\" (UID: \"61b7df65-bf6b-461b-8482-0dfda6082e36\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-fz6hk"
Jul 15 15:40:44.259904 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:40:44.259847    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/61b7df65-bf6b-461b-8482-0dfda6082e36-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-fz6hk\" (UID: \"61b7df65-bf6b-461b-8482-0dfda6082e36\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-fz6hk"
Jul 15 15:40:44.360798 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:40:44.360760    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/61b7df65-bf6b-461b-8482-0dfda6082e36-istio-token\") pod \"istiod-openshift-gateway-7574459656-fz6hk\" (UID: \"61b7df65-bf6b-461b-8482-0dfda6082e36\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-fz6hk"
Jul 15 15:40:44.361004 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:40:44.360830    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/61b7df65-bf6b-461b-8482-0dfda6082e36-local-certs\") pod \"istiod-openshift-gateway-7574459656-fz6hk\" (UID: \"61b7df65-bf6b-461b-8482-0dfda6082e36\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-fz6hk"
Jul 15 15:40:44.361004 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:40:44.360861    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/61b7df65-bf6b-461b-8482-0dfda6082e36-cacerts\") pod \"istiod-openshift-gateway-7574459656-fz6hk\" (UID: \"61b7df65-bf6b-461b-8482-0dfda6082e36\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-fz6hk"
Jul 15 15:40:44.361004 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:40:44.360893    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/61b7df65-bf6b-461b-8482-0dfda6082e36-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-fz6hk\" (UID: \"61b7df65-bf6b-461b-8482-0dfda6082e36\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-fz6hk"
Jul 15 15:40:44.361004 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:40:44.360927    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/61b7df65-bf6b-461b-8482-0dfda6082e36-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-fz6hk\" (UID: \"61b7df65-bf6b-461b-8482-0dfda6082e36\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-fz6hk"
Jul 15 15:40:44.361269 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:40:44.361061    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/61b7df65-bf6b-461b-8482-0dfda6082e36-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-fz6hk\" (UID: \"61b7df65-bf6b-461b-8482-0dfda6082e36\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-fz6hk"
Jul 15 15:40:44.361269 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:40:44.361139    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jkkz9\" (UniqueName: \"kubernetes.io/projected/61b7df65-bf6b-461b-8482-0dfda6082e36-kube-api-access-jkkz9\") pod \"istiod-openshift-gateway-7574459656-fz6hk\" (UID: \"61b7df65-bf6b-461b-8482-0dfda6082e36\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-fz6hk"
Jul 15 15:40:44.361627 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:40:44.361569    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/61b7df65-bf6b-461b-8482-0dfda6082e36-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-fz6hk\" (UID: \"61b7df65-bf6b-461b-8482-0dfda6082e36\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-fz6hk"
Jul 15 15:40:44.363776 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:40:44.363751    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/61b7df65-bf6b-461b-8482-0dfda6082e36-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-fz6hk\" (UID: \"61b7df65-bf6b-461b-8482-0dfda6082e36\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-fz6hk"
Jul 15 15:40:44.363776 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:40:44.363769    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/61b7df65-bf6b-461b-8482-0dfda6082e36-local-certs\") pod \"istiod-openshift-gateway-7574459656-fz6hk\" (UID: \"61b7df65-bf6b-461b-8482-0dfda6082e36\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-fz6hk"
Jul 15 15:40:44.363915 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:40:44.363873    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/61b7df65-bf6b-461b-8482-0dfda6082e36-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-fz6hk\" (UID: \"61b7df65-bf6b-461b-8482-0dfda6082e36\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-fz6hk"
Jul 15 15:40:44.363964 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:40:44.363928    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/61b7df65-bf6b-461b-8482-0dfda6082e36-cacerts\") pod \"istiod-openshift-gateway-7574459656-fz6hk\" (UID: \"61b7df65-bf6b-461b-8482-0dfda6082e36\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-fz6hk"
Jul 15 15:40:44.372631 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:40:44.372588    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/61b7df65-bf6b-461b-8482-0dfda6082e36-istio-token\") pod \"istiod-openshift-gateway-7574459656-fz6hk\" (UID: \"61b7df65-bf6b-461b-8482-0dfda6082e36\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-fz6hk"
Jul 15 15:40:44.372746 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:40:44.372646    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jkkz9\" (UniqueName: \"kubernetes.io/projected/61b7df65-bf6b-461b-8482-0dfda6082e36-kube-api-access-jkkz9\") pod \"istiod-openshift-gateway-7574459656-fz6hk\" (UID: \"61b7df65-bf6b-461b-8482-0dfda6082e36\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-fz6hk"
Jul 15 15:40:44.420033 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:40:44.419997    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-bhhnq" event={"ID":"24cea7a7-5f27-4068-86c3-e30347ad29ee","Type":"ContainerStarted","Data":"53526546cdd3d559badf2f2478959a8beff50c63aaf84ca8b933dbf0946ae671"}
Jul 15 15:40:44.453213 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:40:44.453184    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-fz6hk"
Jul 15 15:40:44.608734 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:40:44.608710    2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-fz6hk"]
Jul 15 15:40:44.610646 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:40:44.610614    2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61b7df65_bf6b_461b_8482_0dfda6082e36.slice/crio-8646f29e2ad2f28559d55df7546e3ad95bd280c61e78e3886444b07e38680790 WatchSource:0}: Error finding container 8646f29e2ad2f28559d55df7546e3ad95bd280c61e78e3886444b07e38680790: Status 404 returned error can't find the container with id 8646f29e2ad2f28559d55df7546e3ad95bd280c61e78e3886444b07e38680790
Jul 15 15:40:44.665068 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:40:44.665032    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/614f35e9-c64c-4d97-91d6-81180d6e13b3-tls-certs\") pod \"model-serving-api-54d89bd5fc-grgn6\" (UID: \"614f35e9-c64c-4d97-91d6-81180d6e13b3\") " pod="opendatahub/model-serving-api-54d89bd5fc-grgn6"
Jul 15 15:40:44.668546 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:40:44.668518    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/614f35e9-c64c-4d97-91d6-81180d6e13b3-tls-certs\") pod \"model-serving-api-54d89bd5fc-grgn6\" (UID: \"614f35e9-c64c-4d97-91d6-81180d6e13b3\") " pod="opendatahub/model-serving-api-54d89bd5fc-grgn6"
Jul 15 15:40:44.829715 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:40:44.829684    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-grgn6"
Jul 15 15:40:44.972504 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:40:44.972463    2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-grgn6"]
Jul 15 15:40:44.976286 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:40:44.976254    2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod614f35e9_c64c_4d97_91d6_81180d6e13b3.slice/crio-ef47aa51ae8c43022ca466126b440a6570b4e515e8c13579e28f127306adb8fb WatchSource:0}: Error finding container ef47aa51ae8c43022ca466126b440a6570b4e515e8c13579e28f127306adb8fb: Status 404 returned error can't find the container with id ef47aa51ae8c43022ca466126b440a6570b4e515e8c13579e28f127306adb8fb
Jul 15 15:40:45.428200 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:40:45.428158    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-grgn6" event={"ID":"614f35e9-c64c-4d97-91d6-81180d6e13b3","Type":"ContainerStarted","Data":"ef47aa51ae8c43022ca466126b440a6570b4e515e8c13579e28f127306adb8fb"}
Jul 15 15:40:45.429668 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:40:45.429637    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-fz6hk" event={"ID":"61b7df65-bf6b-461b-8482-0dfda6082e36","Type":"ContainerStarted","Data":"8646f29e2ad2f28559d55df7546e3ad95bd280c61e78e3886444b07e38680790"}
Jul 15 15:40:46.442453 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:40:46.442407    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7cbcc54d95-fvdjg" event={"ID":"b73ec7e0-b8b7-48c1-8e9b-59fac8eee5c2","Type":"ContainerStarted","Data":"c529905e91a389cdd4c818b5bb71a8099e18ac98868b53165c4445568322c85c"}
Jul 15 15:40:46.462582 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:40:46.462519    2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-7cbcc54d95-fvdjg" podStartSLOduration=1.6140426350000001 podStartE2EDuration="4.462500369s" totalImagesPullingTime="2.848457734s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 15:40:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:40:46.460919232 +0000 UTC m=+332.112984992" watchObservedRunningTime="2026-07-15 15:40:46.462500369 +0000 UTC m=+332.114566131"
Jul 15 15:40:48.457633 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:40:48.457597    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-grgn6" event={"ID":"614f35e9-c64c-4d97-91d6-81180d6e13b3","Type":"ContainerStarted","Data":"d1d7d15ae1c1372fdd27888bd4494705833c6f251b6c77447c24d4d285e22200"}
Jul 15 15:40:48.458080 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:40:48.457749    2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-grgn6"
Jul 15 15:40:48.477132 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:40:48.477068    2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-grgn6" podStartSLOduration=3.07247249 podStartE2EDuration="5.477047082s" totalImagesPullingTime="2.404574592s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 15:40:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:40:48.476068285 +0000 UTC m=+334.128134065" watchObservedRunningTime="2026-07-15 15:40:48.477047082 +0000 UTC m=+334.129112843"
Jul 15 15:40:49.540316 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:40:49.540250    2588 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 15 15:40:49.540707 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:40:49.540373    2588 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 15 15:40:50.469563 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:40:50.469500    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-bhhnq" event={"ID":"24cea7a7-5f27-4068-86c3-e30347ad29ee","Type":"ContainerStarted","Data":"389548f6053bd7d03aa9c3ac0d7f08a0d35331591cddfcb308d141b660a52510"}
Jul 15 15:40:50.469970 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:40:50.469949    2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-bhhnq"
Jul 15 15:40:50.473098 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:40:50.473030    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-fz6hk" event={"ID":"61b7df65-bf6b-461b-8482-0dfda6082e36","Type":"ContainerStarted","Data":"571e055c4a61cb2bb4c714102e247a4381ad5e4cb8774cda1e52f8ea16ee6865"}
Jul 15 15:40:50.473098 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:40:50.473082    2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-fz6hk"
Jul 15 15:40:50.474764 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:40:50.474728    2588 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-fz6hk container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 15 15:40:50.474937 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:40:50.474799    2588 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-fz6hk" podUID="61b7df65-bf6b-461b-8482-0dfda6082e36" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 15 15:40:50.495871 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:40:50.495816    2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-bhhnq" podStartSLOduration=2.720361102 podStartE2EDuration="8.49580126s" totalImagesPullingTime="5.775440158s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 15:40:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:40:50.493621828 +0000 UTC m=+336.145687618" watchObservedRunningTime="2026-07-15 15:40:50.49580126 +0000 UTC m=+336.147867018"
Jul 15 15:40:50.520095 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:40:50.520037    2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7574459656-fz6hk" podStartSLOduration=1.592707076 podStartE2EDuration="6.520020192s" totalImagesPullingTime="4.927313116s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 15:40:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:40:50.519152356 +0000 UTC m=+336.171218117" watchObservedRunningTime="2026-07-15 15:40:50.520020192 +0000 UTC m=+336.172085950"
Jul 15 15:40:51.477426 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:40:51.477397    2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-fz6hk"
Jul 15 15:40:52.755794 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:40:52.755756    2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-c74867c7d-msd8j"]
Jul 15 15:40:52.759633 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:40:52.759611    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-c74867c7d-msd8j"
Jul 15 15:40:52.764536 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:40:52.764511    2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 15 15:40:52.764685 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:40:52.764567    2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 15 15:40:52.764837 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:40:52.764818    2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 15 15:40:52.764922 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:40:52.764847    2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 15 15:40:52.764922 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:40:52.764895    2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 15 15:40:52.764922 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:40:52.764911    2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-h2wn9\""
Jul 15 15:40:52.776447 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:40:52.776424    2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-c74867c7d-msd8j"]
Jul 15 15:40:52.943665 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:40:52.943631    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4dbwd\" (UniqueName: \"kubernetes.io/projected/4cee1b47-85ae-4812-90d7-be743f29db4f-kube-api-access-4dbwd\") pod \"lws-controller-manager-c74867c7d-msd8j\" (UID: \"4cee1b47-85ae-4812-90d7-be743f29db4f\") " pod="openshift-lws-operator/lws-controller-manager-c74867c7d-msd8j"
Jul 15 15:40:52.943665 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:40:52.943668    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/4cee1b47-85ae-4812-90d7-be743f29db4f-manager-config\") pod \"lws-controller-manager-c74867c7d-msd8j\" (UID: \"4cee1b47-85ae-4812-90d7-be743f29db4f\") " pod="openshift-lws-operator/lws-controller-manager-c74867c7d-msd8j"
Jul 15 15:40:52.943865 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:40:52.943686    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/4cee1b47-85ae-4812-90d7-be743f29db4f-metrics-cert\") pod \"lws-controller-manager-c74867c7d-msd8j\" (UID: \"4cee1b47-85ae-4812-90d7-be743f29db4f\") " pod="openshift-lws-operator/lws-controller-manager-c74867c7d-msd8j"
Jul 15 15:40:52.943865 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:40:52.943840    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4cee1b47-85ae-4812-90d7-be743f29db4f-cert\") pod \"lws-controller-manager-c74867c7d-msd8j\" (UID: \"4cee1b47-85ae-4812-90d7-be743f29db4f\") " pod="openshift-lws-operator/lws-controller-manager-c74867c7d-msd8j"
Jul 15 15:40:53.045107 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:40:53.045013    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/4cee1b47-85ae-4812-90d7-be743f29db4f-metrics-cert\") pod \"lws-controller-manager-c74867c7d-msd8j\" (UID: \"4cee1b47-85ae-4812-90d7-be743f29db4f\") " pod="openshift-lws-operator/lws-controller-manager-c74867c7d-msd8j"
Jul 15 15:40:53.045391 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:40:53.045152    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4cee1b47-85ae-4812-90d7-be743f29db4f-cert\") pod \"lws-controller-manager-c74867c7d-msd8j\" (UID: \"4cee1b47-85ae-4812-90d7-be743f29db4f\") " pod="openshift-lws-operator/lws-controller-manager-c74867c7d-msd8j"
Jul 15 15:40:53.045391 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:40:53.045185    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4dbwd\" (UniqueName: \"kubernetes.io/projected/4cee1b47-85ae-4812-90d7-be743f29db4f-kube-api-access-4dbwd\") pod \"lws-controller-manager-c74867c7d-msd8j\" (UID: \"4cee1b47-85ae-4812-90d7-be743f29db4f\") " pod="openshift-lws-operator/lws-controller-manager-c74867c7d-msd8j"
Jul 15 15:40:53.045391 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:40:53.045216    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/4cee1b47-85ae-4812-90d7-be743f29db4f-manager-config\") pod \"lws-controller-manager-c74867c7d-msd8j\" (UID: \"4cee1b47-85ae-4812-90d7-be743f29db4f\") " pod="openshift-lws-operator/lws-controller-manager-c74867c7d-msd8j"
Jul 15 15:40:53.046156 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:40:53.046125    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/4cee1b47-85ae-4812-90d7-be743f29db4f-manager-config\") pod \"lws-controller-manager-c74867c7d-msd8j\" (UID: \"4cee1b47-85ae-4812-90d7-be743f29db4f\") " pod="openshift-lws-operator/lws-controller-manager-c74867c7d-msd8j"
Jul 15 15:40:53.047998 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:40:53.047975    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/4cee1b47-85ae-4812-90d7-be743f29db4f-metrics-cert\") pod \"lws-controller-manager-c74867c7d-msd8j\" (UID: \"4cee1b47-85ae-4812-90d7-be743f29db4f\") " pod="openshift-lws-operator/lws-controller-manager-c74867c7d-msd8j"
Jul 15 15:40:53.048365 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:40:53.048329    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4cee1b47-85ae-4812-90d7-be743f29db4f-cert\") pod \"lws-controller-manager-c74867c7d-msd8j\" (UID: \"4cee1b47-85ae-4812-90d7-be743f29db4f\") " pod="openshift-lws-operator/lws-controller-manager-c74867c7d-msd8j"
Jul 15 15:40:53.074663 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:40:53.074638    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4dbwd\" (UniqueName: \"kubernetes.io/projected/4cee1b47-85ae-4812-90d7-be743f29db4f-kube-api-access-4dbwd\") pod \"lws-controller-manager-c74867c7d-msd8j\" (UID: \"4cee1b47-85ae-4812-90d7-be743f29db4f\") " pod="openshift-lws-operator/lws-controller-manager-c74867c7d-msd8j"
Jul 15 15:40:53.369680 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:40:53.369646    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-c74867c7d-msd8j"
Jul 15 15:40:53.554121 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:40:53.554096    2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-c74867c7d-msd8j"]
Jul 15 15:40:53.555631 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:40:53.555607    2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4cee1b47_85ae_4812_90d7_be743f29db4f.slice/crio-d5c69e586b15a5f1f58aae9e604383dafe02738d1efcab073f315b7a18ebac1a WatchSource:0}: Error finding container d5c69e586b15a5f1f58aae9e604383dafe02738d1efcab073f315b7a18ebac1a: Status 404 returned error can't find the container with id d5c69e586b15a5f1f58aae9e604383dafe02738d1efcab073f315b7a18ebac1a
Jul 15 15:40:54.492195 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:40:54.492157    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-c74867c7d-msd8j" event={"ID":"4cee1b47-85ae-4812-90d7-be743f29db4f","Type":"ContainerStarted","Data":"d5c69e586b15a5f1f58aae9e604383dafe02738d1efcab073f315b7a18ebac1a"}
Jul 15 15:40:54.918119 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:40:54.918086    2588 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-fz6hk"]
Jul 15 15:40:54.918312 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:40:54.918252    2588 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7574459656-fz6hk" podUID="61b7df65-bf6b-461b-8482-0dfda6082e36" containerName="discovery" containerID="cri-o://571e055c4a61cb2bb4c714102e247a4381ad5e4cb8774cda1e52f8ea16ee6865" gracePeriod=30
Jul 15 15:40:55.176261 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:40:55.176197    2588 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-fz6hk"
Jul 15 15:40:55.268801 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:40:55.268764    2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/61b7df65-bf6b-461b-8482-0dfda6082e36-local-certs\") pod \"61b7df65-bf6b-461b-8482-0dfda6082e36\" (UID: \"61b7df65-bf6b-461b-8482-0dfda6082e36\") "
Jul 15 15:40:55.268801 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:40:55.268806    2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/61b7df65-bf6b-461b-8482-0dfda6082e36-istio-kubeconfig\") pod \"61b7df65-bf6b-461b-8482-0dfda6082e36\" (UID: \"61b7df65-bf6b-461b-8482-0dfda6082e36\") "
Jul 15 15:40:55.268996 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:40:55.268823    2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/61b7df65-bf6b-461b-8482-0dfda6082e36-istio-token\") pod \"61b7df65-bf6b-461b-8482-0dfda6082e36\" (UID: \"61b7df65-bf6b-461b-8482-0dfda6082e36\") "
Jul 15 15:40:55.268996 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:40:55.268936    2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/61b7df65-bf6b-461b-8482-0dfda6082e36-istio-csr-ca-configmap\") pod \"61b7df65-bf6b-461b-8482-0dfda6082e36\" (UID: \"61b7df65-bf6b-461b-8482-0dfda6082e36\") "
Jul 15 15:40:55.268996 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:40:55.268976    2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jkkz9\" (UniqueName: \"kubernetes.io/projected/61b7df65-bf6b-461b-8482-0dfda6082e36-kube-api-access-jkkz9\") pod \"61b7df65-bf6b-461b-8482-0dfda6082e36\" (UID: \"61b7df65-bf6b-461b-8482-0dfda6082e36\") "
Jul 15 15:40:55.269174 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:40:55.269007    2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/61b7df65-bf6b-461b-8482-0dfda6082e36-istio-csr-dns-cert\") pod \"61b7df65-bf6b-461b-8482-0dfda6082e36\" (UID: \"61b7df65-bf6b-461b-8482-0dfda6082e36\") "
Jul 15 15:40:55.269174 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:40:55.269044    2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/61b7df65-bf6b-461b-8482-0dfda6082e36-cacerts\") pod \"61b7df65-bf6b-461b-8482-0dfda6082e36\" (UID: \"61b7df65-bf6b-461b-8482-0dfda6082e36\") "
Jul 15 15:40:55.269378 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:40:55.269313    2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/61b7df65-bf6b-461b-8482-0dfda6082e36-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "61b7df65-bf6b-461b-8482-0dfda6082e36" (UID: "61b7df65-bf6b-461b-8482-0dfda6082e36"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 15:40:55.271237 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:40:55.271212    2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/61b7df65-bf6b-461b-8482-0dfda6082e36-cacerts" (OuterVolumeSpecName: "cacerts") pod "61b7df65-bf6b-461b-8482-0dfda6082e36" (UID: "61b7df65-bf6b-461b-8482-0dfda6082e36"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 15:40:55.271401 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:40:55.271235    2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/61b7df65-bf6b-461b-8482-0dfda6082e36-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "61b7df65-bf6b-461b-8482-0dfda6082e36" (UID: "61b7df65-bf6b-461b-8482-0dfda6082e36"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 15:40:55.271401 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:40:55.271391    2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/61b7df65-bf6b-461b-8482-0dfda6082e36-istio-token" (OuterVolumeSpecName: "istio-token") pod "61b7df65-bf6b-461b-8482-0dfda6082e36" (UID: "61b7df65-bf6b-461b-8482-0dfda6082e36"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 15:40:55.271523 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:40:55.271405    2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/61b7df65-bf6b-461b-8482-0dfda6082e36-kube-api-access-jkkz9" (OuterVolumeSpecName: "kube-api-access-jkkz9") pod "61b7df65-bf6b-461b-8482-0dfda6082e36" (UID: "61b7df65-bf6b-461b-8482-0dfda6082e36"). InnerVolumeSpecName "kube-api-access-jkkz9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 15:40:55.271523 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:40:55.271497    2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/61b7df65-bf6b-461b-8482-0dfda6082e36-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "61b7df65-bf6b-461b-8482-0dfda6082e36" (UID: "61b7df65-bf6b-461b-8482-0dfda6082e36"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 15:40:55.271596 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:40:55.271552    2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/61b7df65-bf6b-461b-8482-0dfda6082e36-local-certs" (OuterVolumeSpecName: "local-certs") pod "61b7df65-bf6b-461b-8482-0dfda6082e36" (UID: "61b7df65-bf6b-461b-8482-0dfda6082e36"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 15:40:55.370640 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:40:55.370594    2588 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/61b7df65-bf6b-461b-8482-0dfda6082e36-istio-csr-ca-configmap\") on node \"ip-10-0-140-212.ec2.internal\" DevicePath \"\""
Jul 15 15:40:55.370640 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:40:55.370636    2588 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jkkz9\" (UniqueName: \"kubernetes.io/projected/61b7df65-bf6b-461b-8482-0dfda6082e36-kube-api-access-jkkz9\") on node \"ip-10-0-140-212.ec2.internal\" DevicePath \"\""
Jul 15 15:40:55.370640 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:40:55.370650    2588 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/61b7df65-bf6b-461b-8482-0dfda6082e36-istio-csr-dns-cert\") on node \"ip-10-0-140-212.ec2.internal\" DevicePath \"\""
Jul 15 15:40:55.370906 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:40:55.370659    2588 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/61b7df65-bf6b-461b-8482-0dfda6082e36-cacerts\") on node \"ip-10-0-140-212.ec2.internal\" DevicePath \"\""
Jul 15 15:40:55.370906 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:40:55.370671    2588 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/61b7df65-bf6b-461b-8482-0dfda6082e36-local-certs\") on node \"ip-10-0-140-212.ec2.internal\" DevicePath \"\""
Jul 15 15:40:55.370906 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:40:55.370679    2588 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/61b7df65-bf6b-461b-8482-0dfda6082e36-istio-kubeconfig\") on node \"ip-10-0-140-212.ec2.internal\" DevicePath \"\""
Jul 15 15:40:55.370906 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:40:55.370686    2588 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/61b7df65-bf6b-461b-8482-0dfda6082e36-istio-token\") on node \"ip-10-0-140-212.ec2.internal\" DevicePath \"\""
Jul 15 15:40:55.498432 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:40:55.498316    2588 generic.go:356] "Generic (PLEG): container finished" podID="61b7df65-bf6b-461b-8482-0dfda6082e36" containerID="571e055c4a61cb2bb4c714102e247a4381ad5e4cb8774cda1e52f8ea16ee6865" exitCode=0
Jul 15 15:40:55.498432 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:40:55.498376    2588 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-fz6hk"
Jul 15 15:40:55.498432 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:40:55.498387    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-fz6hk" event={"ID":"61b7df65-bf6b-461b-8482-0dfda6082e36","Type":"ContainerDied","Data":"571e055c4a61cb2bb4c714102e247a4381ad5e4cb8774cda1e52f8ea16ee6865"}
Jul 15 15:40:55.498432 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:40:55.498435    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-fz6hk" event={"ID":"61b7df65-bf6b-461b-8482-0dfda6082e36","Type":"ContainerDied","Data":"8646f29e2ad2f28559d55df7546e3ad95bd280c61e78e3886444b07e38680790"}
Jul 15 15:40:55.498964 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:40:55.498457    2588 scope.go:117] "RemoveContainer" containerID="571e055c4a61cb2bb4c714102e247a4381ad5e4cb8774cda1e52f8ea16ee6865"
Jul 15 15:40:55.500468 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:40:55.500433    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-c74867c7d-msd8j" event={"ID":"4cee1b47-85ae-4812-90d7-be743f29db4f","Type":"ContainerStarted","Data":"085c5bcffdb7a13df04f1f32eb4108de0a59f2ccf0a44d5b6aebca9b01d6c000"}
Jul 15 15:40:55.500591 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:40:55.500569    2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-c74867c7d-msd8j"
Jul 15 15:40:55.509722 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:40:55.508580    2588 scope.go:117] "RemoveContainer" containerID="571e055c4a61cb2bb4c714102e247a4381ad5e4cb8774cda1e52f8ea16ee6865"
Jul 15 15:40:55.509722 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:40:55.508908    2588 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"571e055c4a61cb2bb4c714102e247a4381ad5e4cb8774cda1e52f8ea16ee6865\": container with ID starting with 571e055c4a61cb2bb4c714102e247a4381ad5e4cb8774cda1e52f8ea16ee6865 not found: ID does not exist" containerID="571e055c4a61cb2bb4c714102e247a4381ad5e4cb8774cda1e52f8ea16ee6865"
Jul 15 15:40:55.509722 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:40:55.508936    2588 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"571e055c4a61cb2bb4c714102e247a4381ad5e4cb8774cda1e52f8ea16ee6865"} err="failed to get container status \"571e055c4a61cb2bb4c714102e247a4381ad5e4cb8774cda1e52f8ea16ee6865\": rpc error: code = NotFound desc = could not find container \"571e055c4a61cb2bb4c714102e247a4381ad5e4cb8774cda1e52f8ea16ee6865\": container with ID starting with 571e055c4a61cb2bb4c714102e247a4381ad5e4cb8774cda1e52f8ea16ee6865 not found: ID does not exist"
Jul 15 15:40:55.559659 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:40:55.559607    2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-c74867c7d-msd8j" podStartSLOduration=2.076817408 podStartE2EDuration="3.559592282s" totalImagesPullingTime="1.482774874s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 15:40:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:40:55.558275847 +0000 UTC m=+341.210341606" watchObservedRunningTime="2026-07-15 15:40:55.559592282 +0000 UTC m=+341.211658040"
Jul 15 15:40:55.593216 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:40:55.593187    2588 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-fz6hk"]
Jul 15 15:40:55.633479 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:40:55.633452    2588 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-fz6hk"]
Jul 15 15:40:56.909908 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:40:56.909877    2588 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="61b7df65-bf6b-461b-8482-0dfda6082e36" path="/var/lib/kubelet/pods/61b7df65-bf6b-461b-8482-0dfda6082e36/volumes"
Jul 15 15:40:59.467164 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:40:59.467136    2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-grgn6"
Jul 15 15:41:01.478703 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:41:01.478670    2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-bhhnq"
Jul 15 15:41:06.507884 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:41:06.507851    2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-c74867c7d-msd8j"
Jul 15 15:41:58.754885 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:41:58.754849    2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vr5sr"]
Jul 15 15:41:58.755323 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:41:58.755175    2588 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="61b7df65-bf6b-461b-8482-0dfda6082e36" containerName="discovery"
Jul 15 15:41:58.755323 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:41:58.755186    2588 state_mem.go:107] "Deleted CPUSet assignment" podUID="61b7df65-bf6b-461b-8482-0dfda6082e36" containerName="discovery"
Jul 15 15:41:58.755323 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:41:58.755249    2588 memory_manager.go:368] "RemoveStaleState removing state" podUID="61b7df65-bf6b-461b-8482-0dfda6082e36" containerName="discovery"
Jul 15 15:41:58.759051 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:41:58.759020    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vr5sr"
Jul 15 15:41:58.764110 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:41:58.764087    2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 15 15:41:58.765177 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:41:58.765157    2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 15 15:41:58.765284 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:41:58.765158    2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-nflhn\""
Jul 15 15:41:58.768460 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:41:58.768430    2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vr5sr"]
Jul 15 15:41:58.822749 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:41:58.822712    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xdjqj\" (UniqueName: \"kubernetes.io/projected/1bf0fbc5-cbf0-42fb-87c6-901e0d9be3d6-kube-api-access-xdjqj\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vr5sr\" (UID: \"1bf0fbc5-cbf0-42fb-87c6-901e0d9be3d6\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vr5sr"
Jul 15 15:41:58.822895 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:41:58.822779    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1bf0fbc5-cbf0-42fb-87c6-901e0d9be3d6-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vr5sr\" (UID: \"1bf0fbc5-cbf0-42fb-87c6-901e0d9be3d6\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vr5sr"
Jul 15 15:41:58.822895 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:41:58.822829    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1bf0fbc5-cbf0-42fb-87c6-901e0d9be3d6-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vr5sr\" (UID: \"1bf0fbc5-cbf0-42fb-87c6-901e0d9be3d6\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vr5sr"
Jul 15 15:41:58.923660 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:41:58.923626    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xdjqj\" (UniqueName: \"kubernetes.io/projected/1bf0fbc5-cbf0-42fb-87c6-901e0d9be3d6-kube-api-access-xdjqj\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vr5sr\" (UID: \"1bf0fbc5-cbf0-42fb-87c6-901e0d9be3d6\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vr5sr"
Jul 15 15:41:58.923821 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:41:58.923690    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1bf0fbc5-cbf0-42fb-87c6-901e0d9be3d6-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vr5sr\" (UID: \"1bf0fbc5-cbf0-42fb-87c6-901e0d9be3d6\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vr5sr"
Jul 15 15:41:58.923821 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:41:58.923716    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1bf0fbc5-cbf0-42fb-87c6-901e0d9be3d6-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vr5sr\" (UID: \"1bf0fbc5-cbf0-42fb-87c6-901e0d9be3d6\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vr5sr"
Jul 15 15:41:58.924090 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:41:58.924074    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1bf0fbc5-cbf0-42fb-87c6-901e0d9be3d6-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vr5sr\" (UID: \"1bf0fbc5-cbf0-42fb-87c6-901e0d9be3d6\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vr5sr"
Jul 15 15:41:58.924130 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:41:58.924097    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1bf0fbc5-cbf0-42fb-87c6-901e0d9be3d6-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vr5sr\" (UID: \"1bf0fbc5-cbf0-42fb-87c6-901e0d9be3d6\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vr5sr"
Jul 15 15:41:58.937102 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:41:58.937071    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xdjqj\" (UniqueName: \"kubernetes.io/projected/1bf0fbc5-cbf0-42fb-87c6-901e0d9be3d6-kube-api-access-xdjqj\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vr5sr\" (UID: \"1bf0fbc5-cbf0-42fb-87c6-901e0d9be3d6\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vr5sr"
Jul 15 15:41:59.071157 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:41:59.071076    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vr5sr"
Jul 15 15:41:59.204940 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:41:59.204915    2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vr5sr"]
Jul 15 15:41:59.206852 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:41:59.206827    2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1bf0fbc5_cbf0_42fb_87c6_901e0d9be3d6.slice/crio-4b692bc58342d4b20377112a727f21c43dbaae3161c74f542b342a20940d8efa WatchSource:0}: Error finding container 4b692bc58342d4b20377112a727f21c43dbaae3161c74f542b342a20940d8efa: Status 404 returned error can't find the container with id 4b692bc58342d4b20377112a727f21c43dbaae3161c74f542b342a20940d8efa
Jul 15 15:41:59.560967 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:41:59.560935    2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lnl6d"]
Jul 15 15:41:59.564347 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:41:59.564320    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lnl6d"
Jul 15 15:41:59.573959 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:41:59.573934    2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lnl6d"]
Jul 15 15:41:59.630252 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:41:59.630221    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4c394478-25d7-47d9-ad1f-49a257c2a5b3-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lnl6d\" (UID: \"4c394478-25d7-47d9-ad1f-49a257c2a5b3\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lnl6d"
Jul 15 15:41:59.630406 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:41:59.630274    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gpjd9\" (UniqueName: \"kubernetes.io/projected/4c394478-25d7-47d9-ad1f-49a257c2a5b3-kube-api-access-gpjd9\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lnl6d\" (UID: \"4c394478-25d7-47d9-ad1f-49a257c2a5b3\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lnl6d"
Jul 15 15:41:59.630406 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:41:59.630383    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4c394478-25d7-47d9-ad1f-49a257c2a5b3-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lnl6d\" (UID: \"4c394478-25d7-47d9-ad1f-49a257c2a5b3\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lnl6d"
Jul 15 15:41:59.730895 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:41:59.730861    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4c394478-25d7-47d9-ad1f-49a257c2a5b3-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lnl6d\" (UID: \"4c394478-25d7-47d9-ad1f-49a257c2a5b3\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lnl6d"
Jul 15 15:41:59.731026 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:41:59.730908    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4c394478-25d7-47d9-ad1f-49a257c2a5b3-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lnl6d\" (UID: \"4c394478-25d7-47d9-ad1f-49a257c2a5b3\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lnl6d"
Jul 15 15:41:59.731026 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:41:59.730944    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gpjd9\" (UniqueName: \"kubernetes.io/projected/4c394478-25d7-47d9-ad1f-49a257c2a5b3-kube-api-access-gpjd9\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lnl6d\" (UID: \"4c394478-25d7-47d9-ad1f-49a257c2a5b3\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lnl6d"
Jul 15 15:41:59.731307 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:41:59.731286    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4c394478-25d7-47d9-ad1f-49a257c2a5b3-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lnl6d\" (UID: \"4c394478-25d7-47d9-ad1f-49a257c2a5b3\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lnl6d"
Jul 15 15:41:59.731365 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:41:59.731297    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4c394478-25d7-47d9-ad1f-49a257c2a5b3-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lnl6d\" (UID: \"4c394478-25d7-47d9-ad1f-49a257c2a5b3\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lnl6d"
Jul 15 15:41:59.740155 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:41:59.740131    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gpjd9\" (UniqueName: \"kubernetes.io/projected/4c394478-25d7-47d9-ad1f-49a257c2a5b3-kube-api-access-gpjd9\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lnl6d\" (UID: \"4c394478-25d7-47d9-ad1f-49a257c2a5b3\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lnl6d"
Jul 15 15:41:59.803800 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:41:59.803766    2588 generic.go:356] "Generic (PLEG): container finished" podID="1bf0fbc5-cbf0-42fb-87c6-901e0d9be3d6" containerID="315e86cd54ce54a48e209143ab1c6709eaa7296bff5c990073cf6fd0da3ed4c8" exitCode=0
Jul 15 15:41:59.804152 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:41:59.803850    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vr5sr" event={"ID":"1bf0fbc5-cbf0-42fb-87c6-901e0d9be3d6","Type":"ContainerDied","Data":"315e86cd54ce54a48e209143ab1c6709eaa7296bff5c990073cf6fd0da3ed4c8"}
Jul 15 15:41:59.804152 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:41:59.803899    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vr5sr" event={"ID":"1bf0fbc5-cbf0-42fb-87c6-901e0d9be3d6","Type":"ContainerStarted","Data":"4b692bc58342d4b20377112a727f21c43dbaae3161c74f542b342a20940d8efa"}
Jul 15 15:41:59.873432 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:41:59.873410    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lnl6d"
Jul 15 15:41:59.957470 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:41:59.957439    2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zm68w"]
Jul 15 15:41:59.964261 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:41:59.964233    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zm68w"
Jul 15 15:41:59.970031 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:41:59.970007    2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zm68w"]
Jul 15 15:42:00.007322 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:42:00.007299    2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lnl6d"]
Jul 15 15:42:00.009383 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:42:00.009353    2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c394478_25d7_47d9_ad1f_49a257c2a5b3.slice/crio-8a574e5297e0e6664437801bce7664e419fdbb45f544571c7fd59bb9af8fbeb8 WatchSource:0}: Error finding container 8a574e5297e0e6664437801bce7664e419fdbb45f544571c7fd59bb9af8fbeb8: Status 404 returned error can't find the container with id 8a574e5297e0e6664437801bce7664e419fdbb45f544571c7fd59bb9af8fbeb8
Jul 15 15:42:00.034549 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:42:00.034521    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fl6hx\" (UniqueName: \"kubernetes.io/projected/77f49f85-48dc-40d2-b3c7-8b3e03624144-kube-api-access-fl6hx\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zm68w\" (UID: \"77f49f85-48dc-40d2-b3c7-8b3e03624144\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zm68w"
Jul 15 15:42:00.034650 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:42:00.034586    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/77f49f85-48dc-40d2-b3c7-8b3e03624144-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zm68w\" (UID: \"77f49f85-48dc-40d2-b3c7-8b3e03624144\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zm68w"
Jul 15 15:42:00.034650 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:42:00.034629    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/77f49f85-48dc-40d2-b3c7-8b3e03624144-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zm68w\" (UID: \"77f49f85-48dc-40d2-b3c7-8b3e03624144\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zm68w"
Jul 15 15:42:00.135727 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:42:00.135666    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fl6hx\" (UniqueName: \"kubernetes.io/projected/77f49f85-48dc-40d2-b3c7-8b3e03624144-kube-api-access-fl6hx\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zm68w\" (UID: \"77f49f85-48dc-40d2-b3c7-8b3e03624144\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zm68w"
Jul 15 15:42:00.135727 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:42:00.135724    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/77f49f85-48dc-40d2-b3c7-8b3e03624144-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zm68w\" (UID: \"77f49f85-48dc-40d2-b3c7-8b3e03624144\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zm68w"
Jul 15 15:42:00.135858 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:42:00.135764    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/77f49f85-48dc-40d2-b3c7-8b3e03624144-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zm68w\" (UID: \"77f49f85-48dc-40d2-b3c7-8b3e03624144\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zm68w"
Jul 15 15:42:00.136078 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:42:00.136064    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/77f49f85-48dc-40d2-b3c7-8b3e03624144-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zm68w\" (UID: \"77f49f85-48dc-40d2-b3c7-8b3e03624144\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zm68w"
Jul 15 15:42:00.136153 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:42:00.136101    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/77f49f85-48dc-40d2-b3c7-8b3e03624144-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zm68w\" (UID: \"77f49f85-48dc-40d2-b3c7-8b3e03624144\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zm68w"
Jul 15 15:42:00.144750 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:42:00.144732    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fl6hx\" (UniqueName: \"kubernetes.io/projected/77f49f85-48dc-40d2-b3c7-8b3e03624144-kube-api-access-fl6hx\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zm68w\" (UID: \"77f49f85-48dc-40d2-b3c7-8b3e03624144\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zm68w"
Jul 15 15:42:00.276870 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:42:00.276838    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zm68w"
Jul 15 15:42:00.353366 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:42:00.353318    2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15dt5r"]
Jul 15 15:42:00.358238 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:42:00.358216    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15dt5r"
Jul 15 15:42:00.368701 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:42:00.368648    2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15dt5r"]
Jul 15 15:42:00.414149 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:42:00.414120    2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zm68w"]
Jul 15 15:42:00.415064 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:42:00.415036    2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77f49f85_48dc_40d2_b3c7_8b3e03624144.slice/crio-cfbb1d09b0b35457ca50ca79ca84f461631f5b8358ee98fa596151e7af86f587 WatchSource:0}: Error finding container cfbb1d09b0b35457ca50ca79ca84f461631f5b8358ee98fa596151e7af86f587: Status 404 returned error can't find the container with id cfbb1d09b0b35457ca50ca79ca84f461631f5b8358ee98fa596151e7af86f587
Jul 15 15:42:00.439448 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:42:00.439423    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/660f3793-9fbe-4bb7-8447-cc68f416e9ce-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15dt5r\" (UID: \"660f3793-9fbe-4bb7-8447-cc68f416e9ce\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15dt5r"
Jul 15 15:42:00.439555 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:42:00.439468    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/660f3793-9fbe-4bb7-8447-cc68f416e9ce-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15dt5r\" (UID: \"660f3793-9fbe-4bb7-8447-cc68f416e9ce\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15dt5r"
Jul 15 15:42:00.439617 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:42:00.439557    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m795l\" (UniqueName: \"kubernetes.io/projected/660f3793-9fbe-4bb7-8447-cc68f416e9ce-kube-api-access-m795l\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15dt5r\" (UID: \"660f3793-9fbe-4bb7-8447-cc68f416e9ce\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15dt5r"
Jul 15 15:42:00.540261 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:42:00.540233    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/660f3793-9fbe-4bb7-8447-cc68f416e9ce-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15dt5r\" (UID: \"660f3793-9fbe-4bb7-8447-cc68f416e9ce\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15dt5r"
Jul 15 15:42:00.540382 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:42:00.540278    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m795l\" (UniqueName: \"kubernetes.io/projected/660f3793-9fbe-4bb7-8447-cc68f416e9ce-kube-api-access-m795l\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15dt5r\" (UID: \"660f3793-9fbe-4bb7-8447-cc68f416e9ce\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15dt5r"
Jul 15 15:42:00.540382 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:42:00.540337    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/660f3793-9fbe-4bb7-8447-cc68f416e9ce-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15dt5r\" (UID: \"660f3793-9fbe-4bb7-8447-cc68f416e9ce\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15dt5r"
Jul 15 15:42:00.540701 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:42:00.540687    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/660f3793-9fbe-4bb7-8447-cc68f416e9ce-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15dt5r\" (UID: \"660f3793-9fbe-4bb7-8447-cc68f416e9ce\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15dt5r"
Jul 15 15:42:00.540736 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:42:00.540685    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/660f3793-9fbe-4bb7-8447-cc68f416e9ce-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15dt5r\" (UID: \"660f3793-9fbe-4bb7-8447-cc68f416e9ce\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15dt5r"
Jul 15 15:42:00.549049 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:42:00.549028    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m795l\" (UniqueName: \"kubernetes.io/projected/660f3793-9fbe-4bb7-8447-cc68f416e9ce-kube-api-access-m795l\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15dt5r\" (UID: \"660f3793-9fbe-4bb7-8447-cc68f416e9ce\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15dt5r"
Jul 15 15:42:00.671405 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:42:00.671277    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15dt5r"
Jul 15 15:42:00.802336 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:42:00.802311    2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15dt5r"]
Jul 15 15:42:00.804414 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:42:00.804387    2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod660f3793_9fbe_4bb7_8447_cc68f416e9ce.slice/crio-c8968b5956f34257816739e76f58ccd31ebdd610dc2ef1e359f691f179799730 WatchSource:0}: Error finding container c8968b5956f34257816739e76f58ccd31ebdd610dc2ef1e359f691f179799730: Status 404 returned error can't find the container with id c8968b5956f34257816739e76f58ccd31ebdd610dc2ef1e359f691f179799730
Jul 15 15:42:00.810796 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:42:00.810771    2588 generic.go:356] "Generic (PLEG): container finished" podID="77f49f85-48dc-40d2-b3c7-8b3e03624144" containerID="6826600dcf0026e4c6fa036ee6a09dd80f397fbae2721701b9529947e646b85b" exitCode=0
Jul 15 15:42:00.810905 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:42:00.810852    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zm68w" event={"ID":"77f49f85-48dc-40d2-b3c7-8b3e03624144","Type":"ContainerDied","Data":"6826600dcf0026e4c6fa036ee6a09dd80f397fbae2721701b9529947e646b85b"}
Jul 15 15:42:00.810905 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:42:00.810903    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zm68w" event={"ID":"77f49f85-48dc-40d2-b3c7-8b3e03624144","Type":"ContainerStarted","Data":"cfbb1d09b0b35457ca50ca79ca84f461631f5b8358ee98fa596151e7af86f587"}
Jul 15 15:42:00.812378 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:42:00.812353    2588 generic.go:356] "Generic (PLEG): container finished" podID="4c394478-25d7-47d9-ad1f-49a257c2a5b3" containerID="2e9e33c67d3fad57a73f6f1eb8cbfdedd80bda714ef4c1eecdd96435b9bd715d" exitCode=0
Jul 15 15:42:00.812474 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:42:00.812378    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lnl6d" event={"ID":"4c394478-25d7-47d9-ad1f-49a257c2a5b3","Type":"ContainerDied","Data":"2e9e33c67d3fad57a73f6f1eb8cbfdedd80bda714ef4c1eecdd96435b9bd715d"}
Jul 15 15:42:00.812474 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:42:00.812429    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lnl6d" event={"ID":"4c394478-25d7-47d9-ad1f-49a257c2a5b3","Type":"ContainerStarted","Data":"8a574e5297e0e6664437801bce7664e419fdbb45f544571c7fd59bb9af8fbeb8"}
Jul 15 15:42:01.820821 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:42:01.820788    2588 generic.go:356] "Generic (PLEG): container finished" podID="660f3793-9fbe-4bb7-8447-cc68f416e9ce" containerID="b794c9ebf79cd33282c92191790b4b44d19d61bafecfb05380a36498c1c06981" exitCode=0
Jul 15 15:42:01.821183 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:42:01.820860    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15dt5r" event={"ID":"660f3793-9fbe-4bb7-8447-cc68f416e9ce","Type":"ContainerDied","Data":"b794c9ebf79cd33282c92191790b4b44d19d61bafecfb05380a36498c1c06981"}
Jul 15 15:42:01.821183 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:42:01.820902    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15dt5r" event={"ID":"660f3793-9fbe-4bb7-8447-cc68f416e9ce","Type":"ContainerStarted","Data":"c8968b5956f34257816739e76f58ccd31ebdd610dc2ef1e359f691f179799730"}
Jul 15 15:42:02.574566 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:42:02.574531    2588 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77f49f85_48dc_40d2_b3c7_8b3e03624144.slice/crio-conmon-9d0054692f774ec75fdc567af49d0582837fa6b95c066691ec068f35dfb47173.scope\": RecentStats: unable to find data in memory cache]"
Jul 15 15:42:02.827327 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:42:02.827244    2588 generic.go:356] "Generic (PLEG): container finished" podID="77f49f85-48dc-40d2-b3c7-8b3e03624144" containerID="9d0054692f774ec75fdc567af49d0582837fa6b95c066691ec068f35dfb47173" exitCode=0
Jul 15 15:42:02.827775 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:42:02.827326    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zm68w" event={"ID":"77f49f85-48dc-40d2-b3c7-8b3e03624144","Type":"ContainerDied","Data":"9d0054692f774ec75fdc567af49d0582837fa6b95c066691ec068f35dfb47173"}
Jul 15 15:42:03.833629 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:42:03.833596    2588 generic.go:356] "Generic (PLEG): container finished" podID="660f3793-9fbe-4bb7-8447-cc68f416e9ce" containerID="b39d05c1de31ebc59619ae679c6e646ac98a572b54f3b94d5f9e916d676351ac" exitCode=0
Jul 15 15:42:03.834030 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:42:03.833678    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15dt5r" event={"ID":"660f3793-9fbe-4bb7-8447-cc68f416e9ce","Type":"ContainerDied","Data":"b39d05c1de31ebc59619ae679c6e646ac98a572b54f3b94d5f9e916d676351ac"}
Jul 15 15:42:03.835940 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:42:03.835922    2588 generic.go:356] "Generic (PLEG): container finished" podID="77f49f85-48dc-40d2-b3c7-8b3e03624144" containerID="ebb2ef882310d61698de8a80b95bf75e32c74c81c411e85db38b6d0a6e343e6b" exitCode=0
Jul 15 15:42:03.836044 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:42:03.836000    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zm68w" event={"ID":"77f49f85-48dc-40d2-b3c7-8b3e03624144","Type":"ContainerDied","Data":"ebb2ef882310d61698de8a80b95bf75e32c74c81c411e85db38b6d0a6e343e6b"}
Jul 15 15:42:03.837774 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:42:03.837756    2588 generic.go:356] "Generic (PLEG): container finished" podID="1bf0fbc5-cbf0-42fb-87c6-901e0d9be3d6" containerID="79bb46ba13d30441ed537161de011bb446514844d5d350cca0ab1a17adebba2e" exitCode=0
Jul 15 15:42:03.837864 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:42:03.837804    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vr5sr" event={"ID":"1bf0fbc5-cbf0-42fb-87c6-901e0d9be3d6","Type":"ContainerDied","Data":"79bb46ba13d30441ed537161de011bb446514844d5d350cca0ab1a17adebba2e"}
Jul 15 15:42:03.839826 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:42:03.839806    2588 generic.go:356] "Generic (PLEG): container finished" podID="4c394478-25d7-47d9-ad1f-49a257c2a5b3" containerID="cc2b771e87d5172e0daff23aebdd4a590b887d72198a11121c8b8ed4806d31ce" exitCode=0
Jul 15 15:42:03.839935 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:42:03.839868    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lnl6d" event={"ID":"4c394478-25d7-47d9-ad1f-49a257c2a5b3","Type":"ContainerDied","Data":"cc2b771e87d5172e0daff23aebdd4a590b887d72198a11121c8b8ed4806d31ce"}
Jul 15 15:42:04.847025 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:42:04.846991    2588 generic.go:356] "Generic (PLEG): container finished" podID="660f3793-9fbe-4bb7-8447-cc68f416e9ce" containerID="f8ce82059145c7ed0ac835f0426af27807b44bff8707aa4e449dedab76eef2c2" exitCode=0
Jul 15 15:42:04.847514 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:42:04.847084    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15dt5r" event={"ID":"660f3793-9fbe-4bb7-8447-cc68f416e9ce","Type":"ContainerDied","Data":"f8ce82059145c7ed0ac835f0426af27807b44bff8707aa4e449dedab76eef2c2"}
Jul 15 15:42:04.849176 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:42:04.849154    2588 generic.go:356] "Generic (PLEG): container finished" podID="1bf0fbc5-cbf0-42fb-87c6-901e0d9be3d6" containerID="ccb81569fc5421e4980aee4cef877f0d3279511f84523e8f1ce04cf8ac315c27" exitCode=0
Jul 15 15:42:04.849298 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:42:04.849219    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vr5sr" event={"ID":"1bf0fbc5-cbf0-42fb-87c6-901e0d9be3d6","Type":"ContainerDied","Data":"ccb81569fc5421e4980aee4cef877f0d3279511f84523e8f1ce04cf8ac315c27"}
Jul 15 15:42:04.851150 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:42:04.851129    2588 generic.go:356] "Generic (PLEG): container finished" podID="4c394478-25d7-47d9-ad1f-49a257c2a5b3" containerID="0bd20655d17be5a0533d0e2890f44e978366834ff046f62dc9cb0086da83c495" exitCode=0
Jul 15 15:42:04.851245 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:42:04.851159    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lnl6d" event={"ID":"4c394478-25d7-47d9-ad1f-49a257c2a5b3","Type":"ContainerDied","Data":"0bd20655d17be5a0533d0e2890f44e978366834ff046f62dc9cb0086da83c495"}
Jul 15 15:42:04.990379 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:42:04.990350    2588 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zm68w"
Jul 15 15:42:05.077048 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:42:05.077019    2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fl6hx\" (UniqueName: \"kubernetes.io/projected/77f49f85-48dc-40d2-b3c7-8b3e03624144-kube-api-access-fl6hx\") pod \"77f49f85-48dc-40d2-b3c7-8b3e03624144\" (UID: \"77f49f85-48dc-40d2-b3c7-8b3e03624144\") "
Jul 15 15:42:05.077227 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:42:05.077113    2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/77f49f85-48dc-40d2-b3c7-8b3e03624144-util\") pod \"77f49f85-48dc-40d2-b3c7-8b3e03624144\" (UID: \"77f49f85-48dc-40d2-b3c7-8b3e03624144\") "
Jul 15 15:42:05.077227 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:42:05.077129    2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/77f49f85-48dc-40d2-b3c7-8b3e03624144-bundle\") pod \"77f49f85-48dc-40d2-b3c7-8b3e03624144\" (UID: \"77f49f85-48dc-40d2-b3c7-8b3e03624144\") "
Jul 15 15:42:05.077709 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:42:05.077677    2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/77f49f85-48dc-40d2-b3c7-8b3e03624144-bundle" (OuterVolumeSpecName: "bundle") pod "77f49f85-48dc-40d2-b3c7-8b3e03624144" (UID: "77f49f85-48dc-40d2-b3c7-8b3e03624144"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 15:42:05.079178 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:42:05.079148    2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/77f49f85-48dc-40d2-b3c7-8b3e03624144-kube-api-access-fl6hx" (OuterVolumeSpecName: "kube-api-access-fl6hx") pod "77f49f85-48dc-40d2-b3c7-8b3e03624144" (UID: "77f49f85-48dc-40d2-b3c7-8b3e03624144"). InnerVolumeSpecName "kube-api-access-fl6hx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 15:42:05.082477 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:42:05.082454    2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/77f49f85-48dc-40d2-b3c7-8b3e03624144-util" (OuterVolumeSpecName: "util") pod "77f49f85-48dc-40d2-b3c7-8b3e03624144" (UID: "77f49f85-48dc-40d2-b3c7-8b3e03624144"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 15:42:05.177915 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:42:05.177831    2588 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/77f49f85-48dc-40d2-b3c7-8b3e03624144-util\") on node \"ip-10-0-140-212.ec2.internal\" DevicePath \"\""
Jul 15 15:42:05.177915 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:42:05.177871    2588 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/77f49f85-48dc-40d2-b3c7-8b3e03624144-bundle\") on node \"ip-10-0-140-212.ec2.internal\" DevicePath \"\""
Jul 15 15:42:05.177915 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:42:05.177882    2588 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fl6hx\" (UniqueName: \"kubernetes.io/projected/77f49f85-48dc-40d2-b3c7-8b3e03624144-kube-api-access-fl6hx\") on node \"ip-10-0-140-212.ec2.internal\" DevicePath \"\""
Jul 15 15:42:05.858543 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:42:05.858516    2588 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zm68w"
Jul 15 15:42:05.858908 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:42:05.858570    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zm68w" event={"ID":"77f49f85-48dc-40d2-b3c7-8b3e03624144","Type":"ContainerDied","Data":"cfbb1d09b0b35457ca50ca79ca84f461631f5b8358ee98fa596151e7af86f587"}
Jul 15 15:42:05.858908 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:42:05.858654    2588 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cfbb1d09b0b35457ca50ca79ca84f461631f5b8358ee98fa596151e7af86f587"
Jul 15 15:42:06.017453 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:42:06.017430    2588 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15dt5r"
Jul 15 15:42:06.020503 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:42:06.020486    2588 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lnl6d"
Jul 15 15:42:06.052882 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:42:06.052813    2588 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vr5sr"
Jul 15 15:42:06.086128 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:42:06.086103    2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/660f3793-9fbe-4bb7-8447-cc68f416e9ce-bundle\") pod \"660f3793-9fbe-4bb7-8447-cc68f416e9ce\" (UID: \"660f3793-9fbe-4bb7-8447-cc68f416e9ce\") "
Jul 15 15:42:06.086295 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:42:06.086168    2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gpjd9\" (UniqueName: \"kubernetes.io/projected/4c394478-25d7-47d9-ad1f-49a257c2a5b3-kube-api-access-gpjd9\") pod \"4c394478-25d7-47d9-ad1f-49a257c2a5b3\" (UID: \"4c394478-25d7-47d9-ad1f-49a257c2a5b3\") "
Jul 15 15:42:06.086295 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:42:06.086212    2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/660f3793-9fbe-4bb7-8447-cc68f416e9ce-util\") pod \"660f3793-9fbe-4bb7-8447-cc68f416e9ce\" (UID: \"660f3793-9fbe-4bb7-8447-cc68f416e9ce\") "
Jul 15 15:42:06.086295 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:42:06.086251    2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4c394478-25d7-47d9-ad1f-49a257c2a5b3-bundle\") pod \"4c394478-25d7-47d9-ad1f-49a257c2a5b3\" (UID: \"4c394478-25d7-47d9-ad1f-49a257c2a5b3\") "
Jul 15 15:42:06.086295 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:42:06.086267    2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m795l\" (UniqueName: \"kubernetes.io/projected/660f3793-9fbe-4bb7-8447-cc68f416e9ce-kube-api-access-m795l\") pod \"660f3793-9fbe-4bb7-8447-cc68f416e9ce\" (UID: \"660f3793-9fbe-4bb7-8447-cc68f416e9ce\") "
Jul 15 15:42:06.086539 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:42:06.086297    2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4c394478-25d7-47d9-ad1f-49a257c2a5b3-util\") pod \"4c394478-25d7-47d9-ad1f-49a257c2a5b3\" (UID: \"4c394478-25d7-47d9-ad1f-49a257c2a5b3\") "
Jul 15 15:42:06.086846 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:42:06.086821    2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/660f3793-9fbe-4bb7-8447-cc68f416e9ce-bundle" (OuterVolumeSpecName: "bundle") pod "660f3793-9fbe-4bb7-8447-cc68f416e9ce" (UID: "660f3793-9fbe-4bb7-8447-cc68f416e9ce"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 15:42:06.086986 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:42:06.086830    2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4c394478-25d7-47d9-ad1f-49a257c2a5b3-bundle" (OuterVolumeSpecName: "bundle") pod "4c394478-25d7-47d9-ad1f-49a257c2a5b3" (UID: "4c394478-25d7-47d9-ad1f-49a257c2a5b3"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 15:42:06.088565 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:42:06.088535    2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4c394478-25d7-47d9-ad1f-49a257c2a5b3-kube-api-access-gpjd9" (OuterVolumeSpecName: "kube-api-access-gpjd9") pod "4c394478-25d7-47d9-ad1f-49a257c2a5b3" (UID: "4c394478-25d7-47d9-ad1f-49a257c2a5b3"). InnerVolumeSpecName "kube-api-access-gpjd9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 15:42:06.088639 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:42:06.088590    2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/660f3793-9fbe-4bb7-8447-cc68f416e9ce-kube-api-access-m795l" (OuterVolumeSpecName: "kube-api-access-m795l") pod "660f3793-9fbe-4bb7-8447-cc68f416e9ce" (UID: "660f3793-9fbe-4bb7-8447-cc68f416e9ce"). InnerVolumeSpecName "kube-api-access-m795l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 15:42:06.092943 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:42:06.092894    2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4c394478-25d7-47d9-ad1f-49a257c2a5b3-util" (OuterVolumeSpecName: "util") pod "4c394478-25d7-47d9-ad1f-49a257c2a5b3" (UID: "4c394478-25d7-47d9-ad1f-49a257c2a5b3"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 15:42:06.187321 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:42:06.187250    2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1bf0fbc5-cbf0-42fb-87c6-901e0d9be3d6-util\") pod \"1bf0fbc5-cbf0-42fb-87c6-901e0d9be3d6\" (UID: \"1bf0fbc5-cbf0-42fb-87c6-901e0d9be3d6\") "
Jul 15 15:42:06.187321 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:42:06.187286    2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xdjqj\" (UniqueName: \"kubernetes.io/projected/1bf0fbc5-cbf0-42fb-87c6-901e0d9be3d6-kube-api-access-xdjqj\") pod \"1bf0fbc5-cbf0-42fb-87c6-901e0d9be3d6\" (UID: \"1bf0fbc5-cbf0-42fb-87c6-901e0d9be3d6\") "
Jul 15 15:42:06.187321 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:42:06.187303    2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1bf0fbc5-cbf0-42fb-87c6-901e0d9be3d6-bundle\") pod \"1bf0fbc5-cbf0-42fb-87c6-901e0d9be3d6\" (UID: \"1bf0fbc5-cbf0-42fb-87c6-901e0d9be3d6\") "
Jul 15 15:42:06.187619 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:42:06.187598    2588 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4c394478-25d7-47d9-ad1f-49a257c2a5b3-bundle\") on node \"ip-10-0-140-212.ec2.internal\" DevicePath \"\""
Jul 15 15:42:06.187680 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:42:06.187625    2588 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m795l\" (UniqueName: \"kubernetes.io/projected/660f3793-9fbe-4bb7-8447-cc68f416e9ce-kube-api-access-m795l\") on node \"ip-10-0-140-212.ec2.internal\" DevicePath \"\""
Jul 15 15:42:06.187680 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:42:06.187639    2588 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4c394478-25d7-47d9-ad1f-49a257c2a5b3-util\") on node \"ip-10-0-140-212.ec2.internal\" DevicePath \"\""
Jul 15 15:42:06.187680 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:42:06.187652    2588 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/660f3793-9fbe-4bb7-8447-cc68f416e9ce-bundle\") on node \"ip-10-0-140-212.ec2.internal\" DevicePath \"\""
Jul 15 15:42:06.187680 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:42:06.187665    2588 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gpjd9\" (UniqueName: \"kubernetes.io/projected/4c394478-25d7-47d9-ad1f-49a257c2a5b3-kube-api-access-gpjd9\") on node \"ip-10-0-140-212.ec2.internal\" DevicePath \"\""
Jul 15 15:42:06.187944 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:42:06.187920    2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1bf0fbc5-cbf0-42fb-87c6-901e0d9be3d6-bundle" (OuterVolumeSpecName: "bundle") pod "1bf0fbc5-cbf0-42fb-87c6-901e0d9be3d6" (UID: "1bf0fbc5-cbf0-42fb-87c6-901e0d9be3d6"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 15:42:06.189370 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:42:06.189333    2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1bf0fbc5-cbf0-42fb-87c6-901e0d9be3d6-kube-api-access-xdjqj" (OuterVolumeSpecName: "kube-api-access-xdjqj") pod "1bf0fbc5-cbf0-42fb-87c6-901e0d9be3d6" (UID: "1bf0fbc5-cbf0-42fb-87c6-901e0d9be3d6"). InnerVolumeSpecName "kube-api-access-xdjqj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 15:42:06.192451 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:42:06.192423    2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1bf0fbc5-cbf0-42fb-87c6-901e0d9be3d6-util" (OuterVolumeSpecName: "util") pod "1bf0fbc5-cbf0-42fb-87c6-901e0d9be3d6" (UID: "1bf0fbc5-cbf0-42fb-87c6-901e0d9be3d6"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 15:42:06.205178 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:42:06.205144    2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/660f3793-9fbe-4bb7-8447-cc68f416e9ce-util" (OuterVolumeSpecName: "util") pod "660f3793-9fbe-4bb7-8447-cc68f416e9ce" (UID: "660f3793-9fbe-4bb7-8447-cc68f416e9ce"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 15:42:06.288332 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:42:06.288294    2588 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1bf0fbc5-cbf0-42fb-87c6-901e0d9be3d6-util\") on node \"ip-10-0-140-212.ec2.internal\" DevicePath \"\""
Jul 15 15:42:06.288332 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:42:06.288329    2588 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xdjqj\" (UniqueName: \"kubernetes.io/projected/1bf0fbc5-cbf0-42fb-87c6-901e0d9be3d6-kube-api-access-xdjqj\") on node \"ip-10-0-140-212.ec2.internal\" DevicePath \"\""
Jul 15 15:42:06.288332 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:42:06.288359    2588 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1bf0fbc5-cbf0-42fb-87c6-901e0d9be3d6-bundle\") on node \"ip-10-0-140-212.ec2.internal\" DevicePath \"\""
Jul 15 15:42:06.288553 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:42:06.288368    2588 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/660f3793-9fbe-4bb7-8447-cc68f416e9ce-util\") on node \"ip-10-0-140-212.ec2.internal\" DevicePath \"\""
Jul 15 15:42:06.865386 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:42:06.865352    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vr5sr" event={"ID":"1bf0fbc5-cbf0-42fb-87c6-901e0d9be3d6","Type":"ContainerDied","Data":"4b692bc58342d4b20377112a727f21c43dbaae3161c74f542b342a20940d8efa"}
Jul 15 15:42:06.865793 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:42:06.865410    2588 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4b692bc58342d4b20377112a727f21c43dbaae3161c74f542b342a20940d8efa"
Jul 15 15:42:06.865793 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:42:06.865363    2588 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vr5sr"
Jul 15 15:42:06.867264 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:42:06.867244    2588 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lnl6d"
Jul 15 15:42:06.867397 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:42:06.867280    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lnl6d" event={"ID":"4c394478-25d7-47d9-ad1f-49a257c2a5b3","Type":"ContainerDied","Data":"8a574e5297e0e6664437801bce7664e419fdbb45f544571c7fd59bb9af8fbeb8"}
Jul 15 15:42:06.867397 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:42:06.867321    2588 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8a574e5297e0e6664437801bce7664e419fdbb45f544571c7fd59bb9af8fbeb8"
Jul 15 15:42:06.869137 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:42:06.869115    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15dt5r" event={"ID":"660f3793-9fbe-4bb7-8447-cc68f416e9ce","Type":"ContainerDied","Data":"c8968b5956f34257816739e76f58ccd31ebdd610dc2ef1e359f691f179799730"}
Jul 15 15:42:06.869217 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:42:06.869156    2588 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c8968b5956f34257816739e76f58ccd31ebdd610dc2ef1e359f691f179799730"
Jul 15 15:42:06.869217 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:42:06.869123    2588 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15dt5r"
Jul 15 15:42:28.279060 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:42:28.279029    2588 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6d5df6c6f9-q9bkh"]
Jul 15 15:42:32.375312 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:42:32.375273    2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-vhw97"]
Jul 15 15:42:32.375836 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:42:32.375656    2588 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="660f3793-9fbe-4bb7-8447-cc68f416e9ce" containerName="util"
Jul 15 15:42:32.375836 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:42:32.375672    2588 state_mem.go:107] "Deleted CPUSet assignment" podUID="660f3793-9fbe-4bb7-8447-cc68f416e9ce" containerName="util"
Jul 15 15:42:32.375836 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:42:32.375680    2588 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="660f3793-9fbe-4bb7-8447-cc68f416e9ce" containerName="pull"
Jul 15 15:42:32.375836 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:42:32.375685    2588 state_mem.go:107] "Deleted CPUSet assignment" podUID="660f3793-9fbe-4bb7-8447-cc68f416e9ce" containerName="pull"
Jul 15 15:42:32.375836 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:42:32.375691    2588 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4c394478-25d7-47d9-ad1f-49a257c2a5b3" containerName="extract"
Jul 15 15:42:32.375836 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:42:32.375696    2588 state_mem.go:107] "Deleted CPUSet assignment" podUID="4c394478-25d7-47d9-ad1f-49a257c2a5b3" containerName="extract"
Jul 15 15:42:32.375836 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:42:32.375706    2588 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4c394478-25d7-47d9-ad1f-49a257c2a5b3" containerName="util"
Jul 15 15:42:32.375836 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:42:32.375711    2588 state_mem.go:107] "Deleted CPUSet assignment" podUID="4c394478-25d7-47d9-ad1f-49a257c2a5b3" containerName="util"
Jul 15 15:42:32.375836 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:42:32.375721    2588 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="77f49f85-48dc-40d2-b3c7-8b3e03624144" containerName="pull"
Jul 15 15:42:32.375836 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:42:32.375728    2588 state_mem.go:107] "Deleted CPUSet assignment" podUID="77f49f85-48dc-40d2-b3c7-8b3e03624144" containerName="pull"
Jul 15 15:42:32.375836 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:42:32.375739    2588 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4c394478-25d7-47d9-ad1f-49a257c2a5b3" containerName="pull"
Jul 15 15:42:32.375836 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:42:32.375747    2588 state_mem.go:107] "Deleted CPUSet assignment" podUID="4c394478-25d7-47d9-ad1f-49a257c2a5b3" containerName="pull"
Jul 15 15:42:32.375836 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:42:32.375755    2588 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1bf0fbc5-cbf0-42fb-87c6-901e0d9be3d6" containerName="extract"
Jul 15 15:42:32.375836 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:42:32.375759    2588 state_mem.go:107] "Deleted CPUSet assignment" podUID="1bf0fbc5-cbf0-42fb-87c6-901e0d9be3d6" containerName="extract"
Jul 15 15:42:32.375836 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:42:32.375767    2588 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="77f49f85-48dc-40d2-b3c7-8b3e03624144" containerName="util"
Jul 15 15:42:32.375836 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:42:32.375772    2588 state_mem.go:107] "Deleted CPUSet assignment" podUID="77f49f85-48dc-40d2-b3c7-8b3e03624144" containerName="util"
Jul 15 15:42:32.375836 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:42:32.375778    2588 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1bf0fbc5-cbf0-42fb-87c6-901e0d9be3d6" containerName="pull"
Jul 15 15:42:32.375836 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:42:32.375782    2588 state_mem.go:107] "Deleted CPUSet assignment" podUID="1bf0fbc5-cbf0-42fb-87c6-901e0d9be3d6" containerName="pull"
Jul 15 15:42:32.375836 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:42:32.375791    2588 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1bf0fbc5-cbf0-42fb-87c6-901e0d9be3d6" containerName="util"
Jul 15 15:42:32.375836 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:42:32.375796    2588 state_mem.go:107] "Deleted CPUSet assignment" podUID="1bf0fbc5-cbf0-42fb-87c6-901e0d9be3d6" containerName="util"
Jul 15 15:42:32.375836 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:42:32.375803    2588 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="660f3793-9fbe-4bb7-8447-cc68f416e9ce" containerName="extract"
Jul 15 15:42:32.375836 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:42:32.375808    2588 state_mem.go:107] "Deleted CPUSet assignment" podUID="660f3793-9fbe-4bb7-8447-cc68f416e9ce" containerName="extract"
Jul 15 15:42:32.375836 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:42:32.375821    2588 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="77f49f85-48dc-40d2-b3c7-8b3e03624144" containerName="extract"
Jul 15 15:42:32.375836 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:42:32.375828    2588 state_mem.go:107] "Deleted CPUSet assignment" podUID="77f49f85-48dc-40d2-b3c7-8b3e03624144" containerName="extract"
Jul 15 15:42:32.376566 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:42:32.375885    2588 memory_manager.go:368] "RemoveStaleState removing state" podUID="1bf0fbc5-cbf0-42fb-87c6-901e0d9be3d6" containerName="extract"
Jul 15 15:42:32.376566 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:42:32.375896    2588 memory_manager.go:368] "RemoveStaleState removing state" podUID="4c394478-25d7-47d9-ad1f-49a257c2a5b3" containerName="extract"
Jul 15 15:42:32.376566 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:42:32.375908    2588 memory_manager.go:368] "RemoveStaleState removing state" podUID="77f49f85-48dc-40d2-b3c7-8b3e03624144" containerName="extract"
Jul 15 15:42:32.376566 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:42:32.375915    2588 memory_manager.go:368] "RemoveStaleState removing state" podUID="660f3793-9fbe-4bb7-8447-cc68f416e9ce" containerName="extract"
Jul 15 15:42:32.380336 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:42:32.380319    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-vhw97"
Jul 15 15:42:32.383205 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:42:32.383172    2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Jul 15 15:42:32.383331 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:42:32.383231    2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 15 15:42:32.383331 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:42:32.383312    2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 15 15:42:32.383444 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:42:32.383331    2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Jul 15 15:42:32.384622 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:42:32.384606    2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-nflhn\""
Jul 15 15:42:32.389292 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:42:32.389268    2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-vhw97"]
Jul 15 15:42:32.416583 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:42:32.416557    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vkwjg\" (UniqueName: \"kubernetes.io/projected/953e31e8-22ee-41b3-8a48-5bedfe063183-kube-api-access-vkwjg\") pod \"kuadrant-console-plugin-66b5774985-vhw97\" (UID: \"953e31e8-22ee-41b3-8a48-5bedfe063183\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-vhw97"
Jul 15 15:42:32.416684 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:42:32.416634    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/953e31e8-22ee-41b3-8a48-5bedfe063183-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-vhw97\" (UID: \"953e31e8-22ee-41b3-8a48-5bedfe063183\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-vhw97"
Jul 15 15:42:32.416684 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:42:32.416659    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/953e31e8-22ee-41b3-8a48-5bedfe063183-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-vhw97\" (UID: \"953e31e8-22ee-41b3-8a48-5bedfe063183\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-vhw97"
Jul 15 15:42:32.518047 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:42:32.518018    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vkwjg\" (UniqueName: \"kubernetes.io/projected/953e31e8-22ee-41b3-8a48-5bedfe063183-kube-api-access-vkwjg\") pod \"kuadrant-console-plugin-66b5774985-vhw97\" (UID: \"953e31e8-22ee-41b3-8a48-5bedfe063183\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-vhw97"
Jul 15 15:42:32.518159 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:42:32.518093    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/953e31e8-22ee-41b3-8a48-5bedfe063183-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-vhw97\" (UID: \"953e31e8-22ee-41b3-8a48-5bedfe063183\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-vhw97"
Jul 15 15:42:32.518159 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:42:32.518114    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/953e31e8-22ee-41b3-8a48-5bedfe063183-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-vhw97\" (UID: \"953e31e8-22ee-41b3-8a48-5bedfe063183\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-vhw97"
Jul 15 15:42:32.518238 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:42:32.518219    2588 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found
Jul 15 15:42:32.518306 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:42:32.518295    2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/953e31e8-22ee-41b3-8a48-5bedfe063183-plugin-serving-cert podName:953e31e8-22ee-41b3-8a48-5bedfe063183 nodeName:}" failed. No retries permitted until 2026-07-15 15:42:33.018274006 +0000 UTC m=+438.670339754 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/953e31e8-22ee-41b3-8a48-5bedfe063183-plugin-serving-cert") pod "kuadrant-console-plugin-66b5774985-vhw97" (UID: "953e31e8-22ee-41b3-8a48-5bedfe063183") : secret "plugin-serving-cert" not found
Jul 15 15:42:32.518709 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:42:32.518694    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/953e31e8-22ee-41b3-8a48-5bedfe063183-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-vhw97\" (UID: \"953e31e8-22ee-41b3-8a48-5bedfe063183\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-vhw97"
Jul 15 15:42:32.527352 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:42:32.527327    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vkwjg\" (UniqueName: \"kubernetes.io/projected/953e31e8-22ee-41b3-8a48-5bedfe063183-kube-api-access-vkwjg\") pod \"kuadrant-console-plugin-66b5774985-vhw97\" (UID: \"953e31e8-22ee-41b3-8a48-5bedfe063183\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-vhw97"
Jul 15 15:42:33.023791 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:42:33.023749    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/953e31e8-22ee-41b3-8a48-5bedfe063183-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-vhw97\" (UID: \"953e31e8-22ee-41b3-8a48-5bedfe063183\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-vhw97"
Jul 15 15:42:33.026044 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:42:33.026016    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/953e31e8-22ee-41b3-8a48-5bedfe063183-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-vhw97\" (UID: \"953e31e8-22ee-41b3-8a48-5bedfe063183\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-vhw97"
Jul 15 15:42:33.290317 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:42:33.290245    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-vhw97"
Jul 15 15:42:33.422432 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:42:33.422170    2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-vhw97"]
Jul 15 15:42:34.004211 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:42:34.004173    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-vhw97" event={"ID":"953e31e8-22ee-41b3-8a48-5bedfe063183","Type":"ContainerStarted","Data":"24ea0b6690222999fefe06450cb44e8f97f1c210413706296a7c2ee4e2806394"}
Jul 15 15:42:53.298733 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:42:53.298662    2588 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6d5df6c6f9-q9bkh" podUID="7e699a92-6f6d-4c02-ad16-1c48c4204fc6" containerName="console" containerID="cri-o://224d0c64c70f022bfd69f461d1489fd8653637a6a0b5124973988606c5e51f8b" gracePeriod=15
Jul 15 15:42:56.478631 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:42:56.478599    2588 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d5df6c6f9-q9bkh"
Jul 15 15:42:56.645919 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:42:56.645884    2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7e699a92-6f6d-4c02-ad16-1c48c4204fc6-console-serving-cert\") pod \"7e699a92-6f6d-4c02-ad16-1c48c4204fc6\" (UID: \"7e699a92-6f6d-4c02-ad16-1c48c4204fc6\") "
Jul 15 15:42:56.646100 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:42:56.645974    2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7e699a92-6f6d-4c02-ad16-1c48c4204fc6-service-ca\") pod \"7e699a92-6f6d-4c02-ad16-1c48c4204fc6\" (UID: \"7e699a92-6f6d-4c02-ad16-1c48c4204fc6\") "
Jul 15 15:42:56.646100 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:42:56.646001    2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7e699a92-6f6d-4c02-ad16-1c48c4204fc6-console-config\") pod \"7e699a92-6f6d-4c02-ad16-1c48c4204fc6\" (UID: \"7e699a92-6f6d-4c02-ad16-1c48c4204fc6\") "
Jul 15 15:42:56.646100 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:42:56.646024    2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7e699a92-6f6d-4c02-ad16-1c48c4204fc6-console-oauth-config\") pod \"7e699a92-6f6d-4c02-ad16-1c48c4204fc6\" (UID: \"7e699a92-6f6d-4c02-ad16-1c48c4204fc6\") "
Jul 15 15:42:56.646100 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:42:56.646048    2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7e699a92-6f6d-4c02-ad16-1c48c4204fc6-trusted-ca-bundle\") pod \"7e699a92-6f6d-4c02-ad16-1c48c4204fc6\" (UID: \"7e699a92-6f6d-4c02-ad16-1c48c4204fc6\") "
Jul 15 15:42:56.646100 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:42:56.646084    2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7e699a92-6f6d-4c02-ad16-1c48c4204fc6-oauth-serving-cert\") pod \"7e699a92-6f6d-4c02-ad16-1c48c4204fc6\" (UID: \"7e699a92-6f6d-4c02-ad16-1c48c4204fc6\") "
Jul 15 15:42:56.646354 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:42:56.646140    2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5848b\" (UniqueName: \"kubernetes.io/projected/7e699a92-6f6d-4c02-ad16-1c48c4204fc6-kube-api-access-5848b\") pod \"7e699a92-6f6d-4c02-ad16-1c48c4204fc6\" (UID: \"7e699a92-6f6d-4c02-ad16-1c48c4204fc6\") "
Jul 15 15:42:56.646470 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:42:56.646440    2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7e699a92-6f6d-4c02-ad16-1c48c4204fc6-service-ca" (OuterVolumeSpecName: "service-ca") pod "7e699a92-6f6d-4c02-ad16-1c48c4204fc6" (UID: "7e699a92-6f6d-4c02-ad16-1c48c4204fc6"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 15:42:56.646605 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:42:56.646578    2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7e699a92-6f6d-4c02-ad16-1c48c4204fc6-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "7e699a92-6f6d-4c02-ad16-1c48c4204fc6" (UID: "7e699a92-6f6d-4c02-ad16-1c48c4204fc6"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 15:42:56.646683 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:42:56.646609    2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7e699a92-6f6d-4c02-ad16-1c48c4204fc6-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "7e699a92-6f6d-4c02-ad16-1c48c4204fc6" (UID: "7e699a92-6f6d-4c02-ad16-1c48c4204fc6"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 15:42:56.646757 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:42:56.646736    2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7e699a92-6f6d-4c02-ad16-1c48c4204fc6-console-config" (OuterVolumeSpecName: "console-config") pod "7e699a92-6f6d-4c02-ad16-1c48c4204fc6" (UID: "7e699a92-6f6d-4c02-ad16-1c48c4204fc6"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 15:42:56.648222 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:42:56.648196    2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7e699a92-6f6d-4c02-ad16-1c48c4204fc6-kube-api-access-5848b" (OuterVolumeSpecName: "kube-api-access-5848b") pod "7e699a92-6f6d-4c02-ad16-1c48c4204fc6" (UID: "7e699a92-6f6d-4c02-ad16-1c48c4204fc6"). InnerVolumeSpecName "kube-api-access-5848b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 15:42:56.648311 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:42:56.648216    2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7e699a92-6f6d-4c02-ad16-1c48c4204fc6-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "7e699a92-6f6d-4c02-ad16-1c48c4204fc6" (UID: "7e699a92-6f6d-4c02-ad16-1c48c4204fc6"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 15:42:56.648427 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:42:56.648370    2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7e699a92-6f6d-4c02-ad16-1c48c4204fc6-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "7e699a92-6f6d-4c02-ad16-1c48c4204fc6" (UID: "7e699a92-6f6d-4c02-ad16-1c48c4204fc6"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 15:42:56.747299 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:42:56.747270    2588 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7e699a92-6f6d-4c02-ad16-1c48c4204fc6-console-serving-cert\") on node \"ip-10-0-140-212.ec2.internal\" DevicePath \"\""
Jul 15 15:42:56.747299 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:42:56.747294    2588 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7e699a92-6f6d-4c02-ad16-1c48c4204fc6-service-ca\") on node \"ip-10-0-140-212.ec2.internal\" DevicePath \"\""
Jul 15 15:42:56.747299 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:42:56.747304    2588 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7e699a92-6f6d-4c02-ad16-1c48c4204fc6-console-config\") on node \"ip-10-0-140-212.ec2.internal\" DevicePath \"\""
Jul 15 15:42:56.747484 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:42:56.747311    2588 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7e699a92-6f6d-4c02-ad16-1c48c4204fc6-console-oauth-config\") on node \"ip-10-0-140-212.ec2.internal\" DevicePath \"\""
Jul 15 15:42:56.747484 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:42:56.747319    2588 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7e699a92-6f6d-4c02-ad16-1c48c4204fc6-trusted-ca-bundle\") on node \"ip-10-0-140-212.ec2.internal\" DevicePath \"\""
Jul 15 15:42:56.747484 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:42:56.747328    2588 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7e699a92-6f6d-4c02-ad16-1c48c4204fc6-oauth-serving-cert\") on node \"ip-10-0-140-212.ec2.internal\" DevicePath \"\""
Jul 15 15:42:56.747484 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:42:56.747336    2588 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5848b\" (UniqueName: \"kubernetes.io/projected/7e699a92-6f6d-4c02-ad16-1c48c4204fc6-kube-api-access-5848b\") on node \"ip-10-0-140-212.ec2.internal\" DevicePath \"\""
Jul 15 15:42:57.137136 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:42:57.137092    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-vhw97" event={"ID":"953e31e8-22ee-41b3-8a48-5bedfe063183","Type":"ContainerStarted","Data":"f3d397317db2b02ec4f98f22cc6b2973767aa563b20a1f96be157361daa7f6d8"}
Jul 15 15:42:57.138392 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:42:57.138366    2588 generic.go:356] "Generic (PLEG): container finished" podID="7e699a92-6f6d-4c02-ad16-1c48c4204fc6" containerID="224d0c64c70f022bfd69f461d1489fd8653637a6a0b5124973988606c5e51f8b" exitCode=0
Jul 15 15:42:57.138533 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:42:57.138393    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d5df6c6f9-q9bkh" event={"ID":"7e699a92-6f6d-4c02-ad16-1c48c4204fc6","Type":"ContainerDied","Data":"224d0c64c70f022bfd69f461d1489fd8653637a6a0b5124973988606c5e51f8b"}
Jul 15 15:42:57.138533 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:42:57.138410    2588 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d5df6c6f9-q9bkh"
Jul 15 15:42:57.138533 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:42:57.138439    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d5df6c6f9-q9bkh" event={"ID":"7e699a92-6f6d-4c02-ad16-1c48c4204fc6","Type":"ContainerDied","Data":"43e7d65f8620c2be5cbe9ccab1e6eec99dd288c29189f1fcca47f98b28521bdc"}
Jul 15 15:42:57.138533 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:42:57.138455    2588 scope.go:117] "RemoveContainer" containerID="224d0c64c70f022bfd69f461d1489fd8653637a6a0b5124973988606c5e51f8b"
Jul 15 15:42:57.147036 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:42:57.147022    2588 scope.go:117] "RemoveContainer" containerID="224d0c64c70f022bfd69f461d1489fd8653637a6a0b5124973988606c5e51f8b"
Jul 15 15:42:57.147280 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:42:57.147264    2588 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"224d0c64c70f022bfd69f461d1489fd8653637a6a0b5124973988606c5e51f8b\": container with ID starting with 224d0c64c70f022bfd69f461d1489fd8653637a6a0b5124973988606c5e51f8b not found: ID does not exist" containerID="224d0c64c70f022bfd69f461d1489fd8653637a6a0b5124973988606c5e51f8b"
Jul 15 15:42:57.147362 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:42:57.147287    2588 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"224d0c64c70f022bfd69f461d1489fd8653637a6a0b5124973988606c5e51f8b"} err="failed to get container status \"224d0c64c70f022bfd69f461d1489fd8653637a6a0b5124973988606c5e51f8b\": rpc error: code = NotFound desc = could not find container \"224d0c64c70f022bfd69f461d1489fd8653637a6a0b5124973988606c5e51f8b\": container with ID starting with 224d0c64c70f022bfd69f461d1489fd8653637a6a0b5124973988606c5e51f8b not found: ID does not exist"
Jul 15 15:42:57.154328 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:42:57.154288    2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-vhw97" podStartSLOduration=1.847138584 podStartE2EDuration="25.154274943s" totalImagesPullingTime="23.307136359s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 15:42:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:42:57.153645396 +0000 UTC m=+462.805711165" watchObservedRunningTime="2026-07-15 15:42:57.154274943 +0000 UTC m=+462.806340701"
Jul 15 15:42:57.170789 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:42:57.170712    2588 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6d5df6c6f9-q9bkh"]
Jul 15 15:42:57.176527 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:42:57.176498    2588 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6d5df6c6f9-q9bkh"]
Jul 15 15:42:58.910279 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:42:58.910241    2588 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7e699a92-6f6d-4c02-ad16-1c48c4204fc6" path="/var/lib/kubelet/pods/7e699a92-6f6d-4c02-ad16-1c48c4204fc6/volumes"
Jul 15 15:43:30.394751 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:43:30.394713    2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-c8c86"]
Jul 15 15:43:30.395234 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:43:30.395072    2588 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7e699a92-6f6d-4c02-ad16-1c48c4204fc6" containerName="console"
Jul 15 15:43:30.395234 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:43:30.395084    2588 state_mem.go:107] "Deleted CPUSet assignment" podUID="7e699a92-6f6d-4c02-ad16-1c48c4204fc6" containerName="console"
Jul 15 15:43:30.395234 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:43:30.395148    2588 memory_manager.go:368] "RemoveStaleState removing state" podUID="7e699a92-6f6d-4c02-ad16-1c48c4204fc6" containerName="console"
Jul 15 15:43:30.453989 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:43:30.453952    2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-c8c86"]
Jul 15 15:43:30.454162 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:43:30.454048    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-c8c86"
Jul 15 15:43:30.456996 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:43:30.456971    2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-rrlsp\""
Jul 15 15:43:30.531418 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:43:30.531374    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mb5vr\" (UniqueName: \"kubernetes.io/projected/4829847a-8bb4-453c-ab31-3c6e4c2522a6-kube-api-access-mb5vr\") pod \"authorino-58cd955675-c8c86\" (UID: \"4829847a-8bb4-453c-ab31-3c6e4c2522a6\") " pod="kuadrant-system/authorino-58cd955675-c8c86"
Jul 15 15:43:30.600873 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:43:30.600835    2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-kmtvv"]
Jul 15 15:43:30.604226 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:43:30.604209    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-kmtvv"
Jul 15 15:43:30.612454 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:43:30.612430    2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-kmtvv"]
Jul 15 15:43:30.632189 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:43:30.632139    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mb5vr\" (UniqueName: \"kubernetes.io/projected/4829847a-8bb4-453c-ab31-3c6e4c2522a6-kube-api-access-mb5vr\") pod \"authorino-58cd955675-c8c86\" (UID: \"4829847a-8bb4-453c-ab31-3c6e4c2522a6\") " pod="kuadrant-system/authorino-58cd955675-c8c86"
Jul 15 15:43:30.632407 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:43:30.632210    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fnkd7\" (UniqueName: \"kubernetes.io/projected/720bbd3d-332c-48ca-8ca6-ae0580fcef56-kube-api-access-fnkd7\") pod \"authorino-75d556bd77-kmtvv\" (UID: \"720bbd3d-332c-48ca-8ca6-ae0580fcef56\") " pod="kuadrant-system/authorino-75d556bd77-kmtvv"
Jul 15 15:43:30.640859 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:43:30.640830    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mb5vr\" (UniqueName: \"kubernetes.io/projected/4829847a-8bb4-453c-ab31-3c6e4c2522a6-kube-api-access-mb5vr\") pod \"authorino-58cd955675-c8c86\" (UID: \"4829847a-8bb4-453c-ab31-3c6e4c2522a6\") " pod="kuadrant-system/authorino-58cd955675-c8c86"
Jul 15 15:43:30.733744 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:43:30.733637    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fnkd7\" (UniqueName: \"kubernetes.io/projected/720bbd3d-332c-48ca-8ca6-ae0580fcef56-kube-api-access-fnkd7\") pod \"authorino-75d556bd77-kmtvv\" (UID: \"720bbd3d-332c-48ca-8ca6-ae0580fcef56\") " pod="kuadrant-system/authorino-75d556bd77-kmtvv"
Jul 15 15:43:30.743909 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:43:30.743877    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fnkd7\" (UniqueName: \"kubernetes.io/projected/720bbd3d-332c-48ca-8ca6-ae0580fcef56-kube-api-access-fnkd7\") pod \"authorino-75d556bd77-kmtvv\" (UID: \"720bbd3d-332c-48ca-8ca6-ae0580fcef56\") " pod="kuadrant-system/authorino-75d556bd77-kmtvv"
Jul 15 15:43:30.763700 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:43:30.763665    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-c8c86"
Jul 15 15:43:30.893268 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:43:30.893240    2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-c8c86"]
Jul 15 15:43:30.896260 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:43:30.896236    2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4829847a_8bb4_453c_ab31_3c6e4c2522a6.slice/crio-e3445c05966ff7b0bd661b3b8f162d30b92d3d921927bc339fd2b8f507387f94 WatchSource:0}: Error finding container e3445c05966ff7b0bd661b3b8f162d30b92d3d921927bc339fd2b8f507387f94: Status 404 returned error can't find the container with id e3445c05966ff7b0bd661b3b8f162d30b92d3d921927bc339fd2b8f507387f94
Jul 15 15:43:30.913993 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:43:30.913970    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-kmtvv"
Jul 15 15:43:31.043538 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:43:31.043506    2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-kmtvv"]
Jul 15 15:43:31.044837 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:43:31.044813    2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod720bbd3d_332c_48ca_8ca6_ae0580fcef56.slice/crio-c9592bf7a31e435ee0b13029cc8417e5673e75a1e4f79050b8d987dbbdc8d7ef WatchSource:0}: Error finding container c9592bf7a31e435ee0b13029cc8417e5673e75a1e4f79050b8d987dbbdc8d7ef: Status 404 returned error can't find the container with id c9592bf7a31e435ee0b13029cc8417e5673e75a1e4f79050b8d987dbbdc8d7ef
Jul 15 15:43:31.315070 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:43:31.314970    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-kmtvv" event={"ID":"720bbd3d-332c-48ca-8ca6-ae0580fcef56","Type":"ContainerStarted","Data":"c9592bf7a31e435ee0b13029cc8417e5673e75a1e4f79050b8d987dbbdc8d7ef"}
Jul 15 15:43:31.316077 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:43:31.316055    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-c8c86" event={"ID":"4829847a-8bb4-453c-ab31-3c6e4c2522a6","Type":"ContainerStarted","Data":"e3445c05966ff7b0bd661b3b8f162d30b92d3d921927bc339fd2b8f507387f94"}
Jul 15 15:43:35.347087 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:43:35.347040    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-kmtvv" event={"ID":"720bbd3d-332c-48ca-8ca6-ae0580fcef56","Type":"ContainerStarted","Data":"f1f7fb67a8b20a5fdbdb656243c663be04526ea7420608cdb786463f2218d6f0"}
Jul 15 15:43:35.348521 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:43:35.348493    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-c8c86" event={"ID":"4829847a-8bb4-453c-ab31-3c6e4c2522a6","Type":"ContainerStarted","Data":"0b102e07f6646cef9c71c1eda2b4ddf40e5fd239d0e0970f414bcf381d299826"}
Jul 15 15:43:35.367968 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:43:35.367905    2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-kmtvv" podStartSLOduration=1.970303945 podStartE2EDuration="5.367889322s" totalImagesPullingTime="3.397585377s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 15:43:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:43:35.365413778 +0000 UTC m=+501.017479536" watchObservedRunningTime="2026-07-15 15:43:35.367889322 +0000 UTC m=+501.019955060"
Jul 15 15:43:35.382544 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:43:35.382477    2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-c8c86" podStartSLOduration=1.825486255 podStartE2EDuration="5.38245533s" totalImagesPullingTime="3.556969075s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 15:43:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:43:35.38116249 +0000 UTC m=+501.033228251" watchObservedRunningTime="2026-07-15 15:43:35.38245533 +0000 UTC m=+501.034521091"
Jul 15 15:43:35.414089 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:43:35.414056    2588 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-c8c86"]
Jul 15 15:43:37.358206 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:43:37.358162    2588 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-c8c86" podUID="4829847a-8bb4-453c-ab31-3c6e4c2522a6" containerName="authorino" containerID="cri-o://0b102e07f6646cef9c71c1eda2b4ddf40e5fd239d0e0970f414bcf381d299826" gracePeriod=30
Jul 15 15:43:37.609649 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:43:37.609590    2588 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-c8c86"
Jul 15 15:43:37.704498 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:43:37.704449    2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mb5vr\" (UniqueName: \"kubernetes.io/projected/4829847a-8bb4-453c-ab31-3c6e4c2522a6-kube-api-access-mb5vr\") pod \"4829847a-8bb4-453c-ab31-3c6e4c2522a6\" (UID: \"4829847a-8bb4-453c-ab31-3c6e4c2522a6\") "
Jul 15 15:43:37.706456 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:43:37.706434    2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4829847a-8bb4-453c-ab31-3c6e4c2522a6-kube-api-access-mb5vr" (OuterVolumeSpecName: "kube-api-access-mb5vr") pod "4829847a-8bb4-453c-ab31-3c6e4c2522a6" (UID: "4829847a-8bb4-453c-ab31-3c6e4c2522a6"). InnerVolumeSpecName "kube-api-access-mb5vr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 15:43:37.805100 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:43:37.805062    2588 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mb5vr\" (UniqueName: \"kubernetes.io/projected/4829847a-8bb4-453c-ab31-3c6e4c2522a6-kube-api-access-mb5vr\") on node \"ip-10-0-140-212.ec2.internal\" DevicePath \"\""
Jul 15 15:43:38.364305 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:43:38.364264    2588 generic.go:356] "Generic (PLEG): container finished" podID="4829847a-8bb4-453c-ab31-3c6e4c2522a6" containerID="0b102e07f6646cef9c71c1eda2b4ddf40e5fd239d0e0970f414bcf381d299826" exitCode=0
Jul 15 15:43:38.364708 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:43:38.364313    2588 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-c8c86"
Jul 15 15:43:38.364708 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:43:38.364363    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-c8c86" event={"ID":"4829847a-8bb4-453c-ab31-3c6e4c2522a6","Type":"ContainerDied","Data":"0b102e07f6646cef9c71c1eda2b4ddf40e5fd239d0e0970f414bcf381d299826"}
Jul 15 15:43:38.364708 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:43:38.364406    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-c8c86" event={"ID":"4829847a-8bb4-453c-ab31-3c6e4c2522a6","Type":"ContainerDied","Data":"e3445c05966ff7b0bd661b3b8f162d30b92d3d921927bc339fd2b8f507387f94"}
Jul 15 15:43:38.364708 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:43:38.364430    2588 scope.go:117] "RemoveContainer" containerID="0b102e07f6646cef9c71c1eda2b4ddf40e5fd239d0e0970f414bcf381d299826"
Jul 15 15:43:38.373397 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:43:38.373374    2588 scope.go:117] "RemoveContainer" containerID="0b102e07f6646cef9c71c1eda2b4ddf40e5fd239d0e0970f414bcf381d299826"
Jul 15 15:43:38.373688 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:43:38.373655    2588 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0b102e07f6646cef9c71c1eda2b4ddf40e5fd239d0e0970f414bcf381d299826\": container with ID starting with 0b102e07f6646cef9c71c1eda2b4ddf40e5fd239d0e0970f414bcf381d299826 not found: ID does not exist" containerID="0b102e07f6646cef9c71c1eda2b4ddf40e5fd239d0e0970f414bcf381d299826"
Jul 15 15:43:38.373776 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:43:38.373698    2588 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0b102e07f6646cef9c71c1eda2b4ddf40e5fd239d0e0970f414bcf381d299826"} err="failed to get container status \"0b102e07f6646cef9c71c1eda2b4ddf40e5fd239d0e0970f414bcf381d299826\": rpc error: code = NotFound desc = could not find container \"0b102e07f6646cef9c71c1eda2b4ddf40e5fd239d0e0970f414bcf381d299826\": container with ID starting with 0b102e07f6646cef9c71c1eda2b4ddf40e5fd239d0e0970f414bcf381d299826 not found: ID does not exist"
Jul 15 15:43:38.386189 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:43:38.386162    2588 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-c8c86"]
Jul 15 15:43:38.392786 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:43:38.392764    2588 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-c8c86"]
Jul 15 15:43:38.915841 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:43:38.915809    2588 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4829847a-8bb4-453c-ab31-3c6e4c2522a6" path="/var/lib/kubelet/pods/4829847a-8bb4-453c-ab31-3c6e4c2522a6/volumes"
Jul 15 15:44:02.171965 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:44:02.171925    2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-6jmf2"]
Jul 15 15:44:02.172458 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:44:02.172282    2588 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4829847a-8bb4-453c-ab31-3c6e4c2522a6" containerName="authorino"
Jul 15 15:44:02.172458 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:44:02.172296    2588 state_mem.go:107] "Deleted CPUSet assignment" podUID="4829847a-8bb4-453c-ab31-3c6e4c2522a6" containerName="authorino"
Jul 15 15:44:02.172458 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:44:02.172368    2588 memory_manager.go:368] "RemoveStaleState removing state" podUID="4829847a-8bb4-453c-ab31-3c6e4c2522a6" containerName="authorino"
Jul 15 15:44:02.176680 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:44:02.176663    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-6jmf2"
Jul 15 15:44:02.186014 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:44:02.185986    2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-6jmf2"]
Jul 15 15:44:02.322223 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:44:02.322187    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7fhtg\" (UniqueName: \"kubernetes.io/projected/a0034c0e-7e85-4099-b7fc-c9135ba87417-kube-api-access-7fhtg\") pod \"authorino-5d4b67c446-6jmf2\" (UID: \"a0034c0e-7e85-4099-b7fc-c9135ba87417\") " pod="kuadrant-system/authorino-5d4b67c446-6jmf2"
Jul 15 15:44:02.419902 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:44:02.419863    2588 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-6jmf2"]
Jul 15 15:44:02.420150 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:44:02.420131    2588 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-7fhtg], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-5d4b67c446-6jmf2" podUID="a0034c0e-7e85-4099-b7fc-c9135ba87417"
Jul 15 15:44:02.423038 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:44:02.422989    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7fhtg\" (UniqueName: \"kubernetes.io/projected/a0034c0e-7e85-4099-b7fc-c9135ba87417-kube-api-access-7fhtg\") pod \"authorino-5d4b67c446-6jmf2\" (UID: \"a0034c0e-7e85-4099-b7fc-c9135ba87417\") " pod="kuadrant-system/authorino-5d4b67c446-6jmf2"
Jul 15 15:44:02.433046 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:44:02.433017    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7fhtg\" (UniqueName: \"kubernetes.io/projected/a0034c0e-7e85-4099-b7fc-c9135ba87417-kube-api-access-7fhtg\") pod \"authorino-5d4b67c446-6jmf2\" (UID: \"a0034c0e-7e85-4099-b7fc-c9135ba87417\") " pod="kuadrant-system/authorino-5d4b67c446-6jmf2"
Jul 15 15:44:02.449564 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:44:02.449539    2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-86c64666c4-llf8q"]
Jul 15 15:44:02.455709 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:44:02.455692    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-86c64666c4-llf8q"
Jul 15 15:44:02.461152 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:44:02.461131    2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-86c64666c4-llf8q"]
Jul 15 15:44:02.485364 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:44:02.485322    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-6jmf2"
Jul 15 15:44:02.492310 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:44:02.492291    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-6jmf2"
Jul 15 15:44:02.624814 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:44:02.624779    2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7fhtg\" (UniqueName: \"kubernetes.io/projected/a0034c0e-7e85-4099-b7fc-c9135ba87417-kube-api-access-7fhtg\") pod \"a0034c0e-7e85-4099-b7fc-c9135ba87417\" (UID: \"a0034c0e-7e85-4099-b7fc-c9135ba87417\") "
Jul 15 15:44:02.625012 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:44:02.624994    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4l2dc\" (UniqueName: \"kubernetes.io/projected/dbe39249-9836-4f23-bb77-ec1d746a3ec1-kube-api-access-4l2dc\") pod \"authorino-86c64666c4-llf8q\" (UID: \"dbe39249-9836-4f23-bb77-ec1d746a3ec1\") " pod="kuadrant-system/authorino-86c64666c4-llf8q"
Jul 15 15:44:02.626916 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:44:02.626890    2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a0034c0e-7e85-4099-b7fc-c9135ba87417-kube-api-access-7fhtg" (OuterVolumeSpecName: "kube-api-access-7fhtg") pod "a0034c0e-7e85-4099-b7fc-c9135ba87417" (UID: "a0034c0e-7e85-4099-b7fc-c9135ba87417"). InnerVolumeSpecName "kube-api-access-7fhtg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 15:44:02.726236 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:44:02.726140    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4l2dc\" (UniqueName: \"kubernetes.io/projected/dbe39249-9836-4f23-bb77-ec1d746a3ec1-kube-api-access-4l2dc\") pod \"authorino-86c64666c4-llf8q\" (UID: \"dbe39249-9836-4f23-bb77-ec1d746a3ec1\") " pod="kuadrant-system/authorino-86c64666c4-llf8q"
Jul 15 15:44:02.726236 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:44:02.726224    2588 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7fhtg\" (UniqueName: \"kubernetes.io/projected/a0034c0e-7e85-4099-b7fc-c9135ba87417-kube-api-access-7fhtg\") on node \"ip-10-0-140-212.ec2.internal\" DevicePath \"\""
Jul 15 15:44:02.735119 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:44:02.735090    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4l2dc\" (UniqueName: \"kubernetes.io/projected/dbe39249-9836-4f23-bb77-ec1d746a3ec1-kube-api-access-4l2dc\") pod \"authorino-86c64666c4-llf8q\" (UID: \"dbe39249-9836-4f23-bb77-ec1d746a3ec1\") " pod="kuadrant-system/authorino-86c64666c4-llf8q"
Jul 15 15:44:02.764884 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:44:02.764852    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-86c64666c4-llf8q"
Jul 15 15:44:02.907537 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:44:02.907505    2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddbe39249_9836_4f23_bb77_ec1d746a3ec1.slice/crio-34058a1ed59a59419ed05fde78f4b47366faa36a5b42d90207c81b9ebc085e5a WatchSource:0}: Error finding container 34058a1ed59a59419ed05fde78f4b47366faa36a5b42d90207c81b9ebc085e5a: Status 404 returned error can't find the container with id 34058a1ed59a59419ed05fde78f4b47366faa36a5b42d90207c81b9ebc085e5a
Jul 15 15:44:02.911199 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:44:02.911176    2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-86c64666c4-llf8q"]
Jul 15 15:44:03.042941 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:44:03.042855    2588 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-86c64666c4-llf8q"]
Jul 15 15:44:03.075645 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:44:03.074001    2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7f9b4754bb-4tbfd"]
Jul 15 15:44:03.080588 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:44:03.080569    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7f9b4754bb-4tbfd"
Jul 15 15:44:03.083645 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:44:03.083609    2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 15 15:44:03.085724 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:44:03.085698    2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7f9b4754bb-4tbfd"]
Jul 15 15:44:03.130240 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:44:03.130210    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nkf66\" (UniqueName: \"kubernetes.io/projected/5287e564-ce64-4084-ba87-a2ff924ff277-kube-api-access-nkf66\") pod \"authorino-7f9b4754bb-4tbfd\" (UID: \"5287e564-ce64-4084-ba87-a2ff924ff277\") " pod="kuadrant-system/authorino-7f9b4754bb-4tbfd"
Jul 15 15:44:03.130450 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:44:03.130267    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/5287e564-ce64-4084-ba87-a2ff924ff277-tls-cert\") pod \"authorino-7f9b4754bb-4tbfd\" (UID: \"5287e564-ce64-4084-ba87-a2ff924ff277\") " pod="kuadrant-system/authorino-7f9b4754bb-4tbfd"
Jul 15 15:44:03.231465 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:44:03.231430    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nkf66\" (UniqueName: \"kubernetes.io/projected/5287e564-ce64-4084-ba87-a2ff924ff277-kube-api-access-nkf66\") pod \"authorino-7f9b4754bb-4tbfd\" (UID: \"5287e564-ce64-4084-ba87-a2ff924ff277\") " pod="kuadrant-system/authorino-7f9b4754bb-4tbfd"
Jul 15 15:44:03.231852 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:44:03.231494    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/5287e564-ce64-4084-ba87-a2ff924ff277-tls-cert\") pod \"authorino-7f9b4754bb-4tbfd\" (UID: \"5287e564-ce64-4084-ba87-a2ff924ff277\") " pod="kuadrant-system/authorino-7f9b4754bb-4tbfd"
Jul 15 15:44:03.233937 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:44:03.233914    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/5287e564-ce64-4084-ba87-a2ff924ff277-tls-cert\") pod \"authorino-7f9b4754bb-4tbfd\" (UID: \"5287e564-ce64-4084-ba87-a2ff924ff277\") " pod="kuadrant-system/authorino-7f9b4754bb-4tbfd"
Jul 15 15:44:03.239779 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:44:03.239761    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nkf66\" (UniqueName: \"kubernetes.io/projected/5287e564-ce64-4084-ba87-a2ff924ff277-kube-api-access-nkf66\") pod \"authorino-7f9b4754bb-4tbfd\" (UID: \"5287e564-ce64-4084-ba87-a2ff924ff277\") " pod="kuadrant-system/authorino-7f9b4754bb-4tbfd"
Jul 15 15:44:03.390758 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:44:03.390733    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7f9b4754bb-4tbfd"
Jul 15 15:44:03.493422 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:44:03.493384    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-86c64666c4-llf8q" event={"ID":"dbe39249-9836-4f23-bb77-ec1d746a3ec1","Type":"ContainerStarted","Data":"7691012435f81cf5631dd5f1e6383ea50465ceed7e2cc16bf938e80c457af49e"}
Jul 15 15:44:03.493422 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:44:03.493422    2588 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-86c64666c4-llf8q" podUID="dbe39249-9836-4f23-bb77-ec1d746a3ec1" containerName="authorino" containerID="cri-o://7691012435f81cf5631dd5f1e6383ea50465ceed7e2cc16bf938e80c457af49e" gracePeriod=30
Jul 15 15:44:03.493652 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:44:03.493438    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-86c64666c4-llf8q" event={"ID":"dbe39249-9836-4f23-bb77-ec1d746a3ec1","Type":"ContainerStarted","Data":"34058a1ed59a59419ed05fde78f4b47366faa36a5b42d90207c81b9ebc085e5a"}
Jul 15 15:44:03.493652 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:44:03.493439    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-6jmf2"
Jul 15 15:44:03.512036 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:44:03.511980    2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-86c64666c4-llf8q" podStartSLOduration=1.044507014 podStartE2EDuration="1.511963145s" totalImagesPullingTime="467.456131ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 15:44:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:44:03.509555933 +0000 UTC m=+529.161621694" watchObservedRunningTime="2026-07-15 15:44:03.511963145 +0000 UTC m=+529.164028929"
Jul 15 15:44:03.532600 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:44:03.532568    2588 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-6jmf2"]
Jul 15 15:44:03.535948 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:44:03.535653    2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7f9b4754bb-4tbfd"]
Jul 15 15:44:03.538122 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:44:03.538102    2588 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-6jmf2"]
Jul 15 15:44:03.575516 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:44:03.575482    2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5287e564_ce64_4084_ba87_a2ff924ff277.slice/crio-22adba4fa3e9caed94415c13b3b15c9b51bc7856d8232f9150f256b127f5111c WatchSource:0}: Error finding container 22adba4fa3e9caed94415c13b3b15c9b51bc7856d8232f9150f256b127f5111c: Status 404 returned error can't find the container with id 22adba4fa3e9caed94415c13b3b15c9b51bc7856d8232f9150f256b127f5111c
Jul 15 15:44:03.742572 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:44:03.742549    2588 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-86c64666c4-llf8q"
Jul 15 15:44:03.836948 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:44:03.836913    2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4l2dc\" (UniqueName: \"kubernetes.io/projected/dbe39249-9836-4f23-bb77-ec1d746a3ec1-kube-api-access-4l2dc\") pod \"dbe39249-9836-4f23-bb77-ec1d746a3ec1\" (UID: \"dbe39249-9836-4f23-bb77-ec1d746a3ec1\") "
Jul 15 15:44:03.838988 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:44:03.838964    2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dbe39249-9836-4f23-bb77-ec1d746a3ec1-kube-api-access-4l2dc" (OuterVolumeSpecName: "kube-api-access-4l2dc") pod "dbe39249-9836-4f23-bb77-ec1d746a3ec1" (UID: "dbe39249-9836-4f23-bb77-ec1d746a3ec1"). InnerVolumeSpecName "kube-api-access-4l2dc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 15:44:03.937788 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:44:03.937696    2588 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4l2dc\" (UniqueName: \"kubernetes.io/projected/dbe39249-9836-4f23-bb77-ec1d746a3ec1-kube-api-access-4l2dc\") on node \"ip-10-0-140-212.ec2.internal\" DevicePath \"\""
Jul 15 15:44:04.500577 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:44:04.500543    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7f9b4754bb-4tbfd" event={"ID":"5287e564-ce64-4084-ba87-a2ff924ff277","Type":"ContainerStarted","Data":"74a312327202d921e7232dce614d5e9f027a00d7e4a368e6245e64609f67bf83"}
Jul 15 15:44:04.500577 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:44:04.500586    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7f9b4754bb-4tbfd" event={"ID":"5287e564-ce64-4084-ba87-a2ff924ff277","Type":"ContainerStarted","Data":"22adba4fa3e9caed94415c13b3b15c9b51bc7856d8232f9150f256b127f5111c"}
Jul 15 15:44:04.501712 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:44:04.501688    2588 generic.go:356] "Generic (PLEG): container finished" podID="dbe39249-9836-4f23-bb77-ec1d746a3ec1" containerID="7691012435f81cf5631dd5f1e6383ea50465ceed7e2cc16bf938e80c457af49e" exitCode=0
Jul 15 15:44:04.501814 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:44:04.501723    2588 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-86c64666c4-llf8q"
Jul 15 15:44:04.501814 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:44:04.501769    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-86c64666c4-llf8q" event={"ID":"dbe39249-9836-4f23-bb77-ec1d746a3ec1","Type":"ContainerDied","Data":"7691012435f81cf5631dd5f1e6383ea50465ceed7e2cc16bf938e80c457af49e"}
Jul 15 15:44:04.501814 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:44:04.501805    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-86c64666c4-llf8q" event={"ID":"dbe39249-9836-4f23-bb77-ec1d746a3ec1","Type":"ContainerDied","Data":"34058a1ed59a59419ed05fde78f4b47366faa36a5b42d90207c81b9ebc085e5a"}
Jul 15 15:44:04.501915 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:44:04.501826    2588 scope.go:117] "RemoveContainer" containerID="7691012435f81cf5631dd5f1e6383ea50465ceed7e2cc16bf938e80c457af49e"
Jul 15 15:44:04.510677 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:44:04.510660    2588 scope.go:117] "RemoveContainer" containerID="7691012435f81cf5631dd5f1e6383ea50465ceed7e2cc16bf938e80c457af49e"
Jul 15 15:44:04.510900 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:44:04.510884    2588 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7691012435f81cf5631dd5f1e6383ea50465ceed7e2cc16bf938e80c457af49e\": container with ID starting with 7691012435f81cf5631dd5f1e6383ea50465ceed7e2cc16bf938e80c457af49e not found: ID does not exist" containerID="7691012435f81cf5631dd5f1e6383ea50465ceed7e2cc16bf938e80c457af49e"
Jul 15 15:44:04.510944 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:44:04.510908    2588 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7691012435f81cf5631dd5f1e6383ea50465ceed7e2cc16bf938e80c457af49e"} err="failed to get container status \"7691012435f81cf5631dd5f1e6383ea50465ceed7e2cc16bf938e80c457af49e\": rpc error: code = NotFound desc = could not find container \"7691012435f81cf5631dd5f1e6383ea50465ceed7e2cc16bf938e80c457af49e\": container with ID starting with 7691012435f81cf5631dd5f1e6383ea50465ceed7e2cc16bf938e80c457af49e not found: ID does not exist"
Jul 15 15:44:04.525319 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:44:04.525267    2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-7f9b4754bb-4tbfd" podStartSLOduration=1.001111577 podStartE2EDuration="1.525249058s" totalImagesPullingTime="524.137481ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 15:44:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:44:04.525248449 +0000 UTC m=+530.177314213" watchObservedRunningTime="2026-07-15 15:44:04.525249058 +0000 UTC m=+530.177314823"
Jul 15 15:44:04.540540 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:44:04.540511    2588 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-86c64666c4-llf8q"]
Jul 15 15:44:04.546803 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:44:04.546776    2588 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-86c64666c4-llf8q"]
Jul 15 15:44:04.554531 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:44:04.554493    2588 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-kmtvv"]
Jul 15 15:44:04.554724 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:44:04.554696    2588 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-kmtvv" podUID="720bbd3d-332c-48ca-8ca6-ae0580fcef56" containerName="authorino" containerID="cri-o://f1f7fb67a8b20a5fdbdb656243c663be04526ea7420608cdb786463f2218d6f0" gracePeriod=30
Jul 15 15:44:04.804335 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:44:04.804308    2588 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-kmtvv"
Jul 15 15:44:04.844101 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:44:04.844072    2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fnkd7\" (UniqueName: \"kubernetes.io/projected/720bbd3d-332c-48ca-8ca6-ae0580fcef56-kube-api-access-fnkd7\") pod \"720bbd3d-332c-48ca-8ca6-ae0580fcef56\" (UID: \"720bbd3d-332c-48ca-8ca6-ae0580fcef56\") "
Jul 15 15:44:04.846081 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:44:04.846055    2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/720bbd3d-332c-48ca-8ca6-ae0580fcef56-kube-api-access-fnkd7" (OuterVolumeSpecName: "kube-api-access-fnkd7") pod "720bbd3d-332c-48ca-8ca6-ae0580fcef56" (UID: "720bbd3d-332c-48ca-8ca6-ae0580fcef56"). InnerVolumeSpecName "kube-api-access-fnkd7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 15:44:04.910489 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:44:04.910455    2588 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a0034c0e-7e85-4099-b7fc-c9135ba87417" path="/var/lib/kubelet/pods/a0034c0e-7e85-4099-b7fc-c9135ba87417/volumes"
Jul 15 15:44:04.910696 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:44:04.910683    2588 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dbe39249-9836-4f23-bb77-ec1d746a3ec1" path="/var/lib/kubelet/pods/dbe39249-9836-4f23-bb77-ec1d746a3ec1/volumes"
Jul 15 15:44:04.945661 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:44:04.945635    2588 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fnkd7\" (UniqueName: \"kubernetes.io/projected/720bbd3d-332c-48ca-8ca6-ae0580fcef56-kube-api-access-fnkd7\") on node \"ip-10-0-140-212.ec2.internal\" DevicePath \"\""
Jul 15 15:44:05.508920 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:44:05.508886    2588 generic.go:356] "Generic (PLEG): container finished" podID="720bbd3d-332c-48ca-8ca6-ae0580fcef56" containerID="f1f7fb67a8b20a5fdbdb656243c663be04526ea7420608cdb786463f2218d6f0" exitCode=0
Jul 15 15:44:05.509365 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:44:05.508933    2588 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-kmtvv"
Jul 15 15:44:05.509365 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:44:05.508976    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-kmtvv" event={"ID":"720bbd3d-332c-48ca-8ca6-ae0580fcef56","Type":"ContainerDied","Data":"f1f7fb67a8b20a5fdbdb656243c663be04526ea7420608cdb786463f2218d6f0"}
Jul 15 15:44:05.509365 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:44:05.509018    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-kmtvv" event={"ID":"720bbd3d-332c-48ca-8ca6-ae0580fcef56","Type":"ContainerDied","Data":"c9592bf7a31e435ee0b13029cc8417e5673e75a1e4f79050b8d987dbbdc8d7ef"}
Jul 15 15:44:05.509365 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:44:05.509039    2588 scope.go:117] "RemoveContainer" containerID="f1f7fb67a8b20a5fdbdb656243c663be04526ea7420608cdb786463f2218d6f0"
Jul 15 15:44:05.517525 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:44:05.517504    2588 scope.go:117] "RemoveContainer" containerID="f1f7fb67a8b20a5fdbdb656243c663be04526ea7420608cdb786463f2218d6f0"
Jul 15 15:44:05.517773 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:44:05.517755    2588 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f1f7fb67a8b20a5fdbdb656243c663be04526ea7420608cdb786463f2218d6f0\": container with ID starting with f1f7fb67a8b20a5fdbdb656243c663be04526ea7420608cdb786463f2218d6f0 not found: ID does not exist" containerID="f1f7fb67a8b20a5fdbdb656243c663be04526ea7420608cdb786463f2218d6f0"
Jul 15 15:44:05.517820 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:44:05.517781    2588 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f1f7fb67a8b20a5fdbdb656243c663be04526ea7420608cdb786463f2218d6f0"} err="failed to get container status \"f1f7fb67a8b20a5fdbdb656243c663be04526ea7420608cdb786463f2218d6f0\": rpc error: code = NotFound desc = could not find container \"f1f7fb67a8b20a5fdbdb656243c663be04526ea7420608cdb786463f2218d6f0\": container with ID starting with f1f7fb67a8b20a5fdbdb656243c663be04526ea7420608cdb786463f2218d6f0 not found: ID does not exist"
Jul 15 15:44:05.527930 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:44:05.527903    2588 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-kmtvv"]
Jul 15 15:44:05.531322 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:44:05.531301    2588 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-kmtvv"]
Jul 15 15:44:06.913681 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:44:06.911792    2588 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="720bbd3d-332c-48ca-8ca6-ae0580fcef56" path="/var/lib/kubelet/pods/720bbd3d-332c-48ca-8ca6-ae0580fcef56/volumes"
Jul 15 15:45:00.137248 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:45:00.137210    2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29735505-kzf8k"]
Jul 15 15:45:00.137704 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:45:00.137606    2588 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="720bbd3d-332c-48ca-8ca6-ae0580fcef56" containerName="authorino"
Jul 15 15:45:00.137704 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:45:00.137622    2588 state_mem.go:107] "Deleted CPUSet assignment" podUID="720bbd3d-332c-48ca-8ca6-ae0580fcef56" containerName="authorino"
Jul 15 15:45:00.137704 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:45:00.137646    2588 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dbe39249-9836-4f23-bb77-ec1d746a3ec1" containerName="authorino"
Jul 15 15:45:00.137704 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:45:00.137651    2588 state_mem.go:107] "Deleted CPUSet assignment" podUID="dbe39249-9836-4f23-bb77-ec1d746a3ec1" containerName="authorino"
Jul 15 15:45:00.137829 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:45:00.137719    2588 memory_manager.go:368] "RemoveStaleState removing state" podUID="dbe39249-9836-4f23-bb77-ec1d746a3ec1" containerName="authorino"
Jul 15 15:45:00.137829 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:45:00.137732    2588 memory_manager.go:368] "RemoveStaleState removing state" podUID="720bbd3d-332c-48ca-8ca6-ae0580fcef56" containerName="authorino"
Jul 15 15:45:00.140828 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:45:00.140812    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735505-kzf8k"
Jul 15 15:45:00.143607 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:45:00.143583    2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-f55c8\""
Jul 15 15:45:00.149388 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:45:00.149332    2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29735505-kzf8k"]
Jul 15 15:45:00.151154 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:45:00.151136    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735505-kzf8k"
Jul 15 15:45:00.290587 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:45:00.290557    2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29735505-kzf8k"]
Jul 15 15:45:00.292253 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:45:00.292227    2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92fc32a7_d1cf_4a35_8d4b_93904912817c.slice/crio-763ecc0e75eb0fe0395758646141245e1c1c4899db431a01271d8f77f053a4a3 WatchSource:0}: Error finding container 763ecc0e75eb0fe0395758646141245e1c1c4899db431a01271d8f77f053a4a3: Status 404 returned error can't find the container with id 763ecc0e75eb0fe0395758646141245e1c1c4899db431a01271d8f77f053a4a3
Jul 15 15:45:00.803939 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:45:00.803904    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735505-kzf8k" event={"ID":"92fc32a7-d1cf-4a35-8d4b-93904912817c","Type":"ContainerStarted","Data":"763ecc0e75eb0fe0395758646141245e1c1c4899db431a01271d8f77f053a4a3"}
Jul 15 15:45:03.820227 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:45:03.820187    2588 generic.go:356] "Generic (PLEG): container finished" podID="92fc32a7-d1cf-4a35-8d4b-93904912817c" containerID="7b85ca50fae3b2285584ff4e29e7390c406566b730c97b563c649efd36786168" exitCode=0
Jul 15 15:45:03.820637 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:45:03.820268    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735505-kzf8k" event={"ID":"92fc32a7-d1cf-4a35-8d4b-93904912817c","Type":"ContainerDied","Data":"7b85ca50fae3b2285584ff4e29e7390c406566b730c97b563c649efd36786168"}
Jul 15 15:45:04.959411 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:45:04.959382    2588 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735505-kzf8k"
Jul 15 15:45:05.831778 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:45:05.831749    2588 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735505-kzf8k"
Jul 15 15:45:05.831778 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:45:05.831764    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735505-kzf8k" event={"ID":"92fc32a7-d1cf-4a35-8d4b-93904912817c","Type":"ContainerDied","Data":"763ecc0e75eb0fe0395758646141245e1c1c4899db431a01271d8f77f053a4a3"}
Jul 15 15:45:05.832064 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:45:05.831805    2588 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="763ecc0e75eb0fe0395758646141245e1c1c4899db431a01271d8f77f053a4a3"
Jul 15 15:45:14.774223 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:45:14.774194    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-5f7f494dd4-lbdlp_c80ed5cd-4b7c-4981-95c6-a02cf058f709/cluster-monitoring-operator/0.log"
Jul 15 15:45:14.774763 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:45:14.774654    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-5f7f494dd4-lbdlp_c80ed5cd-4b7c-4981-95c6-a02cf058f709/cluster-monitoring-operator/0.log"
Jul 15 15:45:14.779977 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:45:14.779944    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-qcvqk_eb866034-d7d1-4bee-b8b7-616b355d371d/console-operator/1.log"
Jul 15 15:45:14.780549 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:45:14.780531    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-qcvqk_eb866034-d7d1-4bee-b8b7-616b355d371d/console-operator/1.log"
Jul 15 15:45:14.782139 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:45:14.782123    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dthn7_ec82e02f-7632-41be-8e7d-8c9d59c569b6/ovn-acl-logging/0.log"
Jul 15 15:45:14.782748 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:45:14.782729    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dthn7_ec82e02f-7632-41be-8e7d-8c9d59c569b6/ovn-acl-logging/0.log"
Jul 15 15:45:16.791536 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:45:16.791494    2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-8v26d"]
Jul 15 15:45:16.792081 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:45:16.792057    2588 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="92fc32a7-d1cf-4a35-8d4b-93904912817c" containerName="cleanup"
Jul 15 15:45:16.792081 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:45:16.792076    2588 state_mem.go:107] "Deleted CPUSet assignment" podUID="92fc32a7-d1cf-4a35-8d4b-93904912817c" containerName="cleanup"
Jul 15 15:45:16.792200 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:45:16.792186    2588 memory_manager.go:368] "RemoveStaleState removing state" podUID="92fc32a7-d1cf-4a35-8d4b-93904912817c" containerName="cleanup"
Jul 15 15:45:16.795231 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:45:16.795209    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-8v26d"
Jul 15 15:45:16.798177 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:45:16.798156    2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 15 15:45:16.798352 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:45:16.798319    2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Jul 15 15:45:16.799553 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:45:16.799538    2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-bxntm\""
Jul 15 15:45:16.799649 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:45:16.799578    2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 15 15:45:16.810085 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:45:16.810061    2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-8v26d"]
Jul 15 15:45:16.874558 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:45:16.874514    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/da35dc87-88f7-4c5f-991d-74545a3920c5-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-8v26d\" (UID: \"da35dc87-88f7-4c5f-991d-74545a3920c5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-8v26d"
Jul 15 15:45:16.874748 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:45:16.874582    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/da35dc87-88f7-4c5f-991d-74545a3920c5-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-8v26d\" (UID: \"da35dc87-88f7-4c5f-991d-74545a3920c5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-8v26d"
Jul 15 15:45:16.874748 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:45:16.874605    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2q54q\" (UniqueName: \"kubernetes.io/projected/da35dc87-88f7-4c5f-991d-74545a3920c5-kube-api-access-2q54q\") pod \"e2e-distinct-simulated-kserve-59975d69f9-8v26d\" (UID: \"da35dc87-88f7-4c5f-991d-74545a3920c5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-8v26d"
Jul 15 15:45:16.874748 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:45:16.874643    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/da35dc87-88f7-4c5f-991d-74545a3920c5-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-8v26d\" (UID: \"da35dc87-88f7-4c5f-991d-74545a3920c5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-8v26d"
Jul 15 15:45:16.874881 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:45:16.874759    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/da35dc87-88f7-4c5f-991d-74545a3920c5-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-8v26d\" (UID: \"da35dc87-88f7-4c5f-991d-74545a3920c5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-8v26d"
Jul 15 15:45:16.874881 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:45:16.874795    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/da35dc87-88f7-4c5f-991d-74545a3920c5-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-8v26d\" (UID: \"da35dc87-88f7-4c5f-991d-74545a3920c5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-8v26d"
Jul 15 15:45:16.975987 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:45:16.975945    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/da35dc87-88f7-4c5f-991d-74545a3920c5-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-8v26d\" (UID: \"da35dc87-88f7-4c5f-991d-74545a3920c5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-8v26d"
Jul 15 15:45:16.975987 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:45:16.975985    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/da35dc87-88f7-4c5f-991d-74545a3920c5-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-8v26d\" (UID: \"da35dc87-88f7-4c5f-991d-74545a3920c5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-8v26d"
Jul 15 15:45:16.976236 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:45:16.976004    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2q54q\" (UniqueName: \"kubernetes.io/projected/da35dc87-88f7-4c5f-991d-74545a3920c5-kube-api-access-2q54q\") pod \"e2e-distinct-simulated-kserve-59975d69f9-8v26d\" (UID: \"da35dc87-88f7-4c5f-991d-74545a3920c5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-8v26d"
Jul 15 15:45:16.976236 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:45:16.976039    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/da35dc87-88f7-4c5f-991d-74545a3920c5-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-8v26d\" (UID: \"da35dc87-88f7-4c5f-991d-74545a3920c5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-8v26d"
Jul 15 15:45:16.976236 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:45:16.976104    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/da35dc87-88f7-4c5f-991d-74545a3920c5-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-8v26d\" (UID: \"da35dc87-88f7-4c5f-991d-74545a3920c5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-8v26d"
Jul 15 15:45:16.976236 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:45:16.976120    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/da35dc87-88f7-4c5f-991d-74545a3920c5-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-8v26d\" (UID: \"da35dc87-88f7-4c5f-991d-74545a3920c5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-8v26d"
Jul 15 15:45:16.976588 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:45:16.976564    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/da35dc87-88f7-4c5f-991d-74545a3920c5-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-8v26d\" (UID: \"da35dc87-88f7-4c5f-991d-74545a3920c5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-8v26d"
Jul 15 15:45:16.976650 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:45:16.976577    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/da35dc87-88f7-4c5f-991d-74545a3920c5-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-8v26d\" (UID: \"da35dc87-88f7-4c5f-991d-74545a3920c5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-8v26d"
Jul 15 15:45:16.976650 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:45:16.976622    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/da35dc87-88f7-4c5f-991d-74545a3920c5-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-8v26d\" (UID: \"da35dc87-88f7-4c5f-991d-74545a3920c5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-8v26d"
Jul 15 15:45:16.978421 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:45:16.978403    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/da35dc87-88f7-4c5f-991d-74545a3920c5-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-8v26d\" (UID: \"da35dc87-88f7-4c5f-991d-74545a3920c5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-8v26d"
Jul 15 15:45:16.978674 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:45:16.978657    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/da35dc87-88f7-4c5f-991d-74545a3920c5-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-8v26d\" (UID: \"da35dc87-88f7-4c5f-991d-74545a3920c5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-8v26d"
Jul 15 15:45:16.984622 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:45:16.984596    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2q54q\" (UniqueName: \"kubernetes.io/projected/da35dc87-88f7-4c5f-991d-74545a3920c5-kube-api-access-2q54q\") pod \"e2e-distinct-simulated-kserve-59975d69f9-8v26d\" (UID: \"da35dc87-88f7-4c5f-991d-74545a3920c5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-8v26d"
Jul 15 15:45:17.104931 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:45:17.104896    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-8v26d"
Jul 15 15:45:17.251992 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:45:17.251871    2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-8v26d"]
Jul 15 15:45:17.254995 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:45:17.254970    2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda35dc87_88f7_4c5f_991d_74545a3920c5.slice/crio-b91438150d1ca9f3c88685cb8caf015ef6d37baa7195f2983283cd773a38a7f6 WatchSource:0}: Error finding container b91438150d1ca9f3c88685cb8caf015ef6d37baa7195f2983283cd773a38a7f6: Status 404 returned error can't find the container with id b91438150d1ca9f3c88685cb8caf015ef6d37baa7195f2983283cd773a38a7f6
Jul 15 15:45:17.893433 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:45:17.893277    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-8v26d" event={"ID":"da35dc87-88f7-4c5f-991d-74545a3920c5","Type":"ContainerStarted","Data":"b91438150d1ca9f3c88685cb8caf015ef6d37baa7195f2983283cd773a38a7f6"}
Jul 15 15:45:18.900196 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:45:18.900160    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-8v26d" event={"ID":"da35dc87-88f7-4c5f-991d-74545a3920c5","Type":"ContainerStarted","Data":"f3fed02171566fd28f7a4b17b25041f00efdacb2abb92a904ff86b844bb84637"}
Jul 15 15:45:18.920474 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:45:18.920410    2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-8v26d" podStartSLOduration=1.837044256 podStartE2EDuration="2.920393648s" totalImagesPullingTime="1.083349392s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 15:45:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:45:18.918676199 +0000 UTC m=+604.570741959" watchObservedRunningTime="2026-07-15 15:45:18.920393648 +0000 UTC m=+604.572459414"
Jul 15 15:45:27.105035 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:45:27.104989    2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-8v26d"
Jul 15 15:45:27.108789 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:45:27.105055    2588 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-8v26d"
Jul 15 15:45:27.119379 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:45:27.118992    2588 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-8v26d"
Jul 15 15:45:27.964576 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:45:27.964546    2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-8v26d"
Jul 15 15:46:07.187202 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:46:07.187169    2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-qjrtw"]
Jul 15 15:46:07.192078 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:46:07.192061    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-qjrtw"
Jul 15 15:46:07.195045 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:46:07.195027    2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Jul 15 15:46:07.204055 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:46:07.204028    2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-qjrtw"]
Jul 15 15:46:07.317420 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:46:07.317379    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f44bd9c1-1729-4e57-8e43-8ab47fb1e204-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-qjrtw\" (UID: \"f44bd9c1-1729-4e57-8e43-8ab47fb1e204\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-qjrtw"
Jul 15 15:46:07.317602 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:46:07.317433    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2przr\" (UniqueName: \"kubernetes.io/projected/f44bd9c1-1729-4e57-8e43-8ab47fb1e204-kube-api-access-2przr\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-qjrtw\" (UID: \"f44bd9c1-1729-4e57-8e43-8ab47fb1e204\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-qjrtw"
Jul 15 15:46:07.317602 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:46:07.317514    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f44bd9c1-1729-4e57-8e43-8ab47fb1e204-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-qjrtw\" (UID: \"f44bd9c1-1729-4e57-8e43-8ab47fb1e204\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-qjrtw"
Jul 15 15:46:07.317602 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:46:07.317576    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f44bd9c1-1729-4e57-8e43-8ab47fb1e204-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-qjrtw\" (UID: \"f44bd9c1-1729-4e57-8e43-8ab47fb1e204\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-qjrtw"
Jul 15 15:46:07.317727 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:46:07.317608    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f44bd9c1-1729-4e57-8e43-8ab47fb1e204-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-qjrtw\" (UID: \"f44bd9c1-1729-4e57-8e43-8ab47fb1e204\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-qjrtw"
Jul 15 15:46:07.317727 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:46:07.317646    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f44bd9c1-1729-4e57-8e43-8ab47fb1e204-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-qjrtw\" (UID: \"f44bd9c1-1729-4e57-8e43-8ab47fb1e204\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-qjrtw"
Jul 15 15:46:07.418223 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:46:07.418185    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f44bd9c1-1729-4e57-8e43-8ab47fb1e204-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-qjrtw\" (UID: \"f44bd9c1-1729-4e57-8e43-8ab47fb1e204\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-qjrtw"
Jul 15 15:46:07.418435 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:46:07.418232    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f44bd9c1-1729-4e57-8e43-8ab47fb1e204-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-qjrtw\" (UID: \"f44bd9c1-1729-4e57-8e43-8ab47fb1e204\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-qjrtw"
Jul 15 15:46:07.418435 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:46:07.418261    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f44bd9c1-1729-4e57-8e43-8ab47fb1e204-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-qjrtw\" (UID: \"f44bd9c1-1729-4e57-8e43-8ab47fb1e204\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-qjrtw"
Jul 15 15:46:07.418435 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:46:07.418308    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f44bd9c1-1729-4e57-8e43-8ab47fb1e204-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-qjrtw\" (UID: \"f44bd9c1-1729-4e57-8e43-8ab47fb1e204\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-qjrtw"
Jul 15 15:46:07.418435 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:46:07.418364    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2przr\" (UniqueName: \"kubernetes.io/projected/f44bd9c1-1729-4e57-8e43-8ab47fb1e204-kube-api-access-2przr\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-qjrtw\" (UID: \"f44bd9c1-1729-4e57-8e43-8ab47fb1e204\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-qjrtw"
Jul 15 15:46:07.418686 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:46:07.418477    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f44bd9c1-1729-4e57-8e43-8ab47fb1e204-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-qjrtw\" (UID: \"f44bd9c1-1729-4e57-8e43-8ab47fb1e204\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-qjrtw"
Jul 15 15:46:07.418686 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:46:07.418659    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f44bd9c1-1729-4e57-8e43-8ab47fb1e204-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-qjrtw\" (UID: \"f44bd9c1-1729-4e57-8e43-8ab47fb1e204\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-qjrtw"
Jul 15 15:46:07.418769 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:46:07.418708    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f44bd9c1-1729-4e57-8e43-8ab47fb1e204-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-qjrtw\" (UID: \"f44bd9c1-1729-4e57-8e43-8ab47fb1e204\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-qjrtw"
Jul 15 15:46:07.418769 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:46:07.418728    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f44bd9c1-1729-4e57-8e43-8ab47fb1e204-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-qjrtw\" (UID: \"f44bd9c1-1729-4e57-8e43-8ab47fb1e204\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-qjrtw"
Jul 15 15:46:07.420748 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:46:07.420718    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f44bd9c1-1729-4e57-8e43-8ab47fb1e204-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-qjrtw\" (UID: \"f44bd9c1-1729-4e57-8e43-8ab47fb1e204\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-qjrtw"
Jul 15 15:46:07.420873 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:46:07.420836    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f44bd9c1-1729-4e57-8e43-8ab47fb1e204-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-qjrtw\" (UID: \"f44bd9c1-1729-4e57-8e43-8ab47fb1e204\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-qjrtw"
Jul 15 15:46:07.429838 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:46:07.429806    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2przr\" (UniqueName: \"kubernetes.io/projected/f44bd9c1-1729-4e57-8e43-8ab47fb1e204-kube-api-access-2przr\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-qjrtw\" (UID: \"f44bd9c1-1729-4e57-8e43-8ab47fb1e204\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-qjrtw"
Jul 15 15:46:07.501630 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:46:07.501543    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-qjrtw"
Jul 15 15:46:07.639803 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:46:07.639773    2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-qjrtw"]
Jul 15 15:46:07.641282 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:46:07.641257    2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf44bd9c1_1729_4e57_8e43_8ab47fb1e204.slice/crio-d04d1b8389ea2cf7a5fb0779c51eb99ef8bd7bb3f69ca18f8d79da3d3f3083b5 WatchSource:0}: Error finding container d04d1b8389ea2cf7a5fb0779c51eb99ef8bd7bb3f69ca18f8d79da3d3f3083b5: Status 404 returned error can't find the container with id d04d1b8389ea2cf7a5fb0779c51eb99ef8bd7bb3f69ca18f8d79da3d3f3083b5
Jul 15 15:46:07.642581 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:46:07.642565    2588 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 15 15:46:08.157927 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:46:08.157831    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-qjrtw" event={"ID":"f44bd9c1-1729-4e57-8e43-8ab47fb1e204","Type":"ContainerStarted","Data":"23404e6e80c528fba2d6598ca906fe8d88ed09a495f7b7f14e449313645889dc"}
Jul 15 15:46:08.157927 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:46:08.157873    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-qjrtw" event={"ID":"f44bd9c1-1729-4e57-8e43-8ab47fb1e204","Type":"ContainerStarted","Data":"d04d1b8389ea2cf7a5fb0779c51eb99ef8bd7bb3f69ca18f8d79da3d3f3083b5"}
Jul 15 15:46:17.502203 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:46:17.502158    2588 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-qjrtw"
Jul 15 15:46:17.502704 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:46:17.502220    2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-qjrtw"
Jul 15 15:46:17.514077 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:46:17.514052    2588 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-qjrtw"
Jul 15 15:46:17.543300 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:46:17.543247    2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-qjrtw" podStartSLOduration=10.296270047 podStartE2EDuration="10.543233984s" totalImagesPullingTime="246.963937ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 15:46:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:46:08.178754122 +0000 UTC m=+653.830819884" watchObservedRunningTime="2026-07-15 15:46:17.543233984 +0000 UTC m=+663.195299742"
Jul 15 15:46:18.222628 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:46:18.222595    2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-qjrtw"
Jul 15 15:47:19.362510 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:47:19.362475    2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-849c7c6647-7fbbk"]
Jul 15 15:47:19.365819 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:47:19.365802    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-849c7c6647-7fbbk"
Jul 15 15:47:19.376280 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:47:19.376252    2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-849c7c6647-7fbbk"]
Jul 15 15:47:19.454081 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:47:19.454043    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sqjq6\" (UniqueName: \"kubernetes.io/projected/7d927c2a-4643-4c54-89de-4fe6bcd29836-kube-api-access-sqjq6\") pod \"authorino-849c7c6647-7fbbk\" (UID: \"7d927c2a-4643-4c54-89de-4fe6bcd29836\") " pod="kuadrant-system/authorino-849c7c6647-7fbbk"
Jul 15 15:47:19.454269 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:47:19.454103    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/7d927c2a-4643-4c54-89de-4fe6bcd29836-tls-cert\") pod \"authorino-849c7c6647-7fbbk\" (UID: \"7d927c2a-4643-4c54-89de-4fe6bcd29836\") " pod="kuadrant-system/authorino-849c7c6647-7fbbk"
Jul 15 15:47:19.554580 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:47:19.554550    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sqjq6\" (UniqueName: \"kubernetes.io/projected/7d927c2a-4643-4c54-89de-4fe6bcd29836-kube-api-access-sqjq6\") pod \"authorino-849c7c6647-7fbbk\" (UID: \"7d927c2a-4643-4c54-89de-4fe6bcd29836\") " pod="kuadrant-system/authorino-849c7c6647-7fbbk"
Jul 15 15:47:19.554737 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:47:19.554594    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/7d927c2a-4643-4c54-89de-4fe6bcd29836-tls-cert\") pod \"authorino-849c7c6647-7fbbk\" (UID: \"7d927c2a-4643-4c54-89de-4fe6bcd29836\") " pod="kuadrant-system/authorino-849c7c6647-7fbbk"
Jul 15 15:47:19.556974 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:47:19.556943    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/7d927c2a-4643-4c54-89de-4fe6bcd29836-tls-cert\") pod \"authorino-849c7c6647-7fbbk\" (UID: \"7d927c2a-4643-4c54-89de-4fe6bcd29836\") " pod="kuadrant-system/authorino-849c7c6647-7fbbk"
Jul 15 15:47:19.562599 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:47:19.562576    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sqjq6\" (UniqueName: \"kubernetes.io/projected/7d927c2a-4643-4c54-89de-4fe6bcd29836-kube-api-access-sqjq6\") pod \"authorino-849c7c6647-7fbbk\" (UID: \"7d927c2a-4643-4c54-89de-4fe6bcd29836\") " pod="kuadrant-system/authorino-849c7c6647-7fbbk"
Jul 15 15:47:19.675384 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:47:19.675285    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-849c7c6647-7fbbk"
Jul 15 15:47:19.813330 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:47:19.813299    2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-849c7c6647-7fbbk"]
Jul 15 15:47:19.814448 ip-10-0-140-212 kubenswrapper[2588]: W0715 15:47:19.814418    2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7d927c2a_4643_4c54_89de_4fe6bcd29836.slice/crio-a9cf94711a74369bbbf8b7f16f4fc095a0c1de44f11993d5c8aeb7203087c32d WatchSource:0}: Error finding container a9cf94711a74369bbbf8b7f16f4fc095a0c1de44f11993d5c8aeb7203087c32d: Status 404 returned error can't find the container with id a9cf94711a74369bbbf8b7f16f4fc095a0c1de44f11993d5c8aeb7203087c32d
Jul 15 15:47:20.532951 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:47:20.532912    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-849c7c6647-7fbbk" event={"ID":"7d927c2a-4643-4c54-89de-4fe6bcd29836","Type":"ContainerStarted","Data":"a9cf94711a74369bbbf8b7f16f4fc095a0c1de44f11993d5c8aeb7203087c32d"}
Jul 15 15:47:21.542920 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:47:21.542874    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-849c7c6647-7fbbk" event={"ID":"7d927c2a-4643-4c54-89de-4fe6bcd29836","Type":"ContainerStarted","Data":"af892c1ebce2fe5ad0499a8c69cbe1bc738548ccf005a47167d8f7f4aff21a91"}
Jul 15 15:47:21.565487 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:47:21.565432    2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-849c7c6647-7fbbk" podStartSLOduration=1.731025303 podStartE2EDuration="2.565416503s" totalImagesPullingTime="834.3912ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 15:47:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:47:21.562938079 +0000 UTC m=+727.215003839" watchObservedRunningTime="2026-07-15 15:47:21.565416503 +0000 UTC m=+727.217482261"
Jul 15 15:47:21.599994 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:47:21.599960    2588 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7f9b4754bb-4tbfd"]
Jul 15 15:47:21.600183 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:47:21.600160    2588 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-7f9b4754bb-4tbfd" podUID="5287e564-ce64-4084-ba87-a2ff924ff277" containerName="authorino" containerID="cri-o://74a312327202d921e7232dce614d5e9f027a00d7e4a368e6245e64609f67bf83" gracePeriod=30
Jul 15 15:47:21.860553 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:47:21.860529    2588 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7f9b4754bb-4tbfd"
Jul 15 15:47:21.869486 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:47:21.869461    2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/5287e564-ce64-4084-ba87-a2ff924ff277-tls-cert\") pod \"5287e564-ce64-4084-ba87-a2ff924ff277\" (UID: \"5287e564-ce64-4084-ba87-a2ff924ff277\") "
Jul 15 15:47:21.869592 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:47:21.869574    2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nkf66\" (UniqueName: \"kubernetes.io/projected/5287e564-ce64-4084-ba87-a2ff924ff277-kube-api-access-nkf66\") pod \"5287e564-ce64-4084-ba87-a2ff924ff277\" (UID: \"5287e564-ce64-4084-ba87-a2ff924ff277\") "
Jul 15 15:47:21.871564 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:47:21.871531    2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5287e564-ce64-4084-ba87-a2ff924ff277-kube-api-access-nkf66" (OuterVolumeSpecName: "kube-api-access-nkf66") pod "5287e564-ce64-4084-ba87-a2ff924ff277" (UID: "5287e564-ce64-4084-ba87-a2ff924ff277"). InnerVolumeSpecName "kube-api-access-nkf66". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 15:47:21.883643 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:47:21.883599    2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5287e564-ce64-4084-ba87-a2ff924ff277-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "5287e564-ce64-4084-ba87-a2ff924ff277" (UID: "5287e564-ce64-4084-ba87-a2ff924ff277"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 15:47:21.970956 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:47:21.970920    2588 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/5287e564-ce64-4084-ba87-a2ff924ff277-tls-cert\") on node \"ip-10-0-140-212.ec2.internal\" DevicePath \"\""
Jul 15 15:47:21.970956 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:47:21.970949    2588 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nkf66\" (UniqueName: \"kubernetes.io/projected/5287e564-ce64-4084-ba87-a2ff924ff277-kube-api-access-nkf66\") on node \"ip-10-0-140-212.ec2.internal\" DevicePath \"\""
Jul 15 15:47:22.548921 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:47:22.548882    2588 generic.go:356] "Generic (PLEG): container finished" podID="5287e564-ce64-4084-ba87-a2ff924ff277" containerID="74a312327202d921e7232dce614d5e9f027a00d7e4a368e6245e64609f67bf83" exitCode=0
Jul 15 15:47:22.548921 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:47:22.548927    2588 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7f9b4754bb-4tbfd"
Jul 15 15:47:22.549378 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:47:22.548960    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7f9b4754bb-4tbfd" event={"ID":"5287e564-ce64-4084-ba87-a2ff924ff277","Type":"ContainerDied","Data":"74a312327202d921e7232dce614d5e9f027a00d7e4a368e6245e64609f67bf83"}
Jul 15 15:47:22.549378 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:47:22.549011    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7f9b4754bb-4tbfd" event={"ID":"5287e564-ce64-4084-ba87-a2ff924ff277","Type":"ContainerDied","Data":"22adba4fa3e9caed94415c13b3b15c9b51bc7856d8232f9150f256b127f5111c"}
Jul 15 15:47:22.549378 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:47:22.549027    2588 scope.go:117] "RemoveContainer" containerID="74a312327202d921e7232dce614d5e9f027a00d7e4a368e6245e64609f67bf83"
Jul 15 15:47:22.558558 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:47:22.558543    2588 scope.go:117] "RemoveContainer" containerID="74a312327202d921e7232dce614d5e9f027a00d7e4a368e6245e64609f67bf83"
Jul 15 15:47:22.558811 ip-10-0-140-212 kubenswrapper[2588]: E0715 15:47:22.558793    2588 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"74a312327202d921e7232dce614d5e9f027a00d7e4a368e6245e64609f67bf83\": container with ID starting with 74a312327202d921e7232dce614d5e9f027a00d7e4a368e6245e64609f67bf83 not found: ID does not exist" containerID="74a312327202d921e7232dce614d5e9f027a00d7e4a368e6245e64609f67bf83"
Jul 15 15:47:22.558861 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:47:22.558820    2588 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"74a312327202d921e7232dce614d5e9f027a00d7e4a368e6245e64609f67bf83"} err="failed to get container status \"74a312327202d921e7232dce614d5e9f027a00d7e4a368e6245e64609f67bf83\": rpc error: code = NotFound desc = could not find container \"74a312327202d921e7232dce614d5e9f027a00d7e4a368e6245e64609f67bf83\": container with ID starting with 74a312327202d921e7232dce614d5e9f027a00d7e4a368e6245e64609f67bf83 not found: ID does not exist"
Jul 15 15:47:22.571832 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:47:22.571808    2588 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7f9b4754bb-4tbfd"]
Jul 15 15:47:22.577928 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:47:22.577907    2588 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7f9b4754bb-4tbfd"]
Jul 15 15:47:22.910780 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:47:22.910746    2588 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5287e564-ce64-4084-ba87-a2ff924ff277" path="/var/lib/kubelet/pods/5287e564-ce64-4084-ba87-a2ff924ff277/volumes"
Jul 15 15:50:14.811307 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:50:14.811281    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-5f7f494dd4-lbdlp_c80ed5cd-4b7c-4981-95c6-a02cf058f709/cluster-monitoring-operator/0.log"
Jul 15 15:50:14.812245 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:50:14.812223    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-5f7f494dd4-lbdlp_c80ed5cd-4b7c-4981-95c6-a02cf058f709/cluster-monitoring-operator/0.log"
Jul 15 15:50:14.817711 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:50:14.817691    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-qcvqk_eb866034-d7d1-4bee-b8b7-616b355d371d/console-operator/1.log"
Jul 15 15:50:14.818725 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:50:14.818706    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-qcvqk_eb866034-d7d1-4bee-b8b7-616b355d371d/console-operator/1.log"
Jul 15 15:50:14.820328 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:50:14.820311    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dthn7_ec82e02f-7632-41be-8e7d-8c9d59c569b6/ovn-acl-logging/0.log"
Jul 15 15:50:14.821433 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:50:14.821415    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dthn7_ec82e02f-7632-41be-8e7d-8c9d59c569b6/ovn-acl-logging/0.log"
Jul 15 15:55:14.848537 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:55:14.848510    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-5f7f494dd4-lbdlp_c80ed5cd-4b7c-4981-95c6-a02cf058f709/cluster-monitoring-operator/0.log"
Jul 15 15:55:14.850795 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:55:14.850773    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-5f7f494dd4-lbdlp_c80ed5cd-4b7c-4981-95c6-a02cf058f709/cluster-monitoring-operator/0.log"
Jul 15 15:55:14.854826 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:55:14.854803    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-qcvqk_eb866034-d7d1-4bee-b8b7-616b355d371d/console-operator/1.log"
Jul 15 15:55:14.857041 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:55:14.857011    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-qcvqk_eb866034-d7d1-4bee-b8b7-616b355d371d/console-operator/1.log"
Jul 15 15:55:14.857611 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:55:14.857588    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dthn7_ec82e02f-7632-41be-8e7d-8c9d59c569b6/ovn-acl-logging/0.log"
Jul 15 15:55:14.859543 ip-10-0-140-212 kubenswrapper[2588]: I0715 15:55:14.859524    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dthn7_ec82e02f-7632-41be-8e7d-8c9d59c569b6/ovn-acl-logging/0.log"
Jul 15 16:00:00.144974 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:00:00.144934    2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29735520-ttp49"]
Jul 15 16:00:00.147257 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:00:00.145263    2588 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5287e564-ce64-4084-ba87-a2ff924ff277" containerName="authorino"
Jul 15 16:00:00.147257 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:00:00.145273    2588 state_mem.go:107] "Deleted CPUSet assignment" podUID="5287e564-ce64-4084-ba87-a2ff924ff277" containerName="authorino"
Jul 15 16:00:00.147257 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:00:00.145357    2588 memory_manager.go:368] "RemoveStaleState removing state" podUID="5287e564-ce64-4084-ba87-a2ff924ff277" containerName="authorino"
Jul 15 16:00:00.148265 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:00:00.148249    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735520-ttp49"
Jul 15 16:00:00.151289 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:00:00.151267    2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-f55c8\""
Jul 15 16:00:00.157524 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:00:00.157508    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735520-ttp49"
Jul 15 16:00:00.170151 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:00:00.170128    2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29735520-ttp49"]
Jul 15 16:00:00.289562 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:00:00.289534    2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29735520-ttp49"]
Jul 15 16:00:00.291155 ip-10-0-140-212 kubenswrapper[2588]: W0715 16:00:00.291129    2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd1a33f7_24b4_4ad7_b50b_f7a4ac2677eb.slice/crio-bf9b12e35945735299fe64d2c2d3cd3e7e252e11db468aaa9c1f8b5a867becc9 WatchSource:0}: Error finding container bf9b12e35945735299fe64d2c2d3cd3e7e252e11db468aaa9c1f8b5a867becc9: Status 404 returned error can't find the container with id bf9b12e35945735299fe64d2c2d3cd3e7e252e11db468aaa9c1f8b5a867becc9
Jul 15 16:00:00.461879 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:00:00.461802    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735520-ttp49" event={"ID":"dd1a33f7-24b4-4ad7-b50b-f7a4ac2677eb","Type":"ContainerStarted","Data":"bf9b12e35945735299fe64d2c2d3cd3e7e252e11db468aaa9c1f8b5a867becc9"}
Jul 15 16:00:01.469082 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:00:01.468995    2588 generic.go:356] "Generic (PLEG): container finished" podID="dd1a33f7-24b4-4ad7-b50b-f7a4ac2677eb" containerID="a957d35df0bb74c37e5c615e43d84d66394532cfb75e7c5bf37336b44e8b1d6c" exitCode=0
Jul 15 16:00:01.469560 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:00:01.469078    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735520-ttp49" event={"ID":"dd1a33f7-24b4-4ad7-b50b-f7a4ac2677eb","Type":"ContainerDied","Data":"a957d35df0bb74c37e5c615e43d84d66394532cfb75e7c5bf37336b44e8b1d6c"}
Jul 15 16:00:02.605264 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:00:02.605238    2588 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735520-ttp49"
Jul 15 16:00:03.481462 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:00:03.481433    2588 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735520-ttp49"
Jul 15 16:00:03.481633 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:00:03.481466    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735520-ttp49" event={"ID":"dd1a33f7-24b4-4ad7-b50b-f7a4ac2677eb","Type":"ContainerDied","Data":"bf9b12e35945735299fe64d2c2d3cd3e7e252e11db468aaa9c1f8b5a867becc9"}
Jul 15 16:00:03.481633 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:00:03.481512    2588 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bf9b12e35945735299fe64d2c2d3cd3e7e252e11db468aaa9c1f8b5a867becc9"
Jul 15 16:00:14.885207 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:00:14.885166    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-5f7f494dd4-lbdlp_c80ed5cd-4b7c-4981-95c6-a02cf058f709/cluster-monitoring-operator/0.log"
Jul 15 16:00:14.887151 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:00:14.887130    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-5f7f494dd4-lbdlp_c80ed5cd-4b7c-4981-95c6-a02cf058f709/cluster-monitoring-operator/0.log"
Jul 15 16:00:14.891061 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:00:14.891041    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-qcvqk_eb866034-d7d1-4bee-b8b7-616b355d371d/console-operator/1.log"
Jul 15 16:00:14.893103 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:00:14.893086    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-qcvqk_eb866034-d7d1-4bee-b8b7-616b355d371d/console-operator/1.log"
Jul 15 16:00:14.893544 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:00:14.893525    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dthn7_ec82e02f-7632-41be-8e7d-8c9d59c569b6/ovn-acl-logging/0.log"
Jul 15 16:00:14.895627 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:00:14.895610    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dthn7_ec82e02f-7632-41be-8e7d-8c9d59c569b6/ovn-acl-logging/0.log"
Jul 15 16:00:52.382927 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:00:52.382889    2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-08a5731c-8d7pm"]
Jul 15 16:00:52.383387 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:00:52.383263    2588 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dd1a33f7-24b4-4ad7-b50b-f7a4ac2677eb" containerName="cleanup"
Jul 15 16:00:52.383387 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:00:52.383274    2588 state_mem.go:107] "Deleted CPUSet assignment" podUID="dd1a33f7-24b4-4ad7-b50b-f7a4ac2677eb" containerName="cleanup"
Jul 15 16:00:52.383387 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:00:52.383336    2588 memory_manager.go:368] "RemoveStaleState removing state" podUID="dd1a33f7-24b4-4ad7-b50b-f7a4ac2677eb" containerName="cleanup"
Jul 15 16:00:52.386209 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:00:52.386193    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-08a5731c-8d7pm"
Jul 15 16:00:52.389387 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:00:52.389369    2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-f55c8\""
Jul 15 16:00:52.389488 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:00:52.389395    2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 15 16:00:52.395404 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:00:52.395376    2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-08a5731c-8d7pm"]
Jul 15 16:00:52.458880 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:00:52.458852    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bd2d10b0-102b-42c0-ae91-37f5ee6d001b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-08a5731c-8d7pm\" (UID: \"bd2d10b0-102b-42c0-ae91-37f5ee6d001b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-08a5731c-8d7pm"
Jul 15 16:00:52.560109 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:00:52.560078    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bd2d10b0-102b-42c0-ae91-37f5ee6d001b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-08a5731c-8d7pm\" (UID: \"bd2d10b0-102b-42c0-ae91-37f5ee6d001b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-08a5731c-8d7pm"
Jul 15 16:00:52.560709 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:00:52.560690    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bd2d10b0-102b-42c0-ae91-37f5ee6d001b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-08a5731c-8d7pm\" (UID: \"bd2d10b0-102b-42c0-ae91-37f5ee6d001b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-08a5731c-8d7pm"
Jul 15 16:00:52.697376 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:00:52.697279    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-08a5731c-8d7pm"
Jul 15 16:00:52.827211 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:00:52.827187    2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-08a5731c-8d7pm"]
Jul 15 16:00:52.829097 ip-10-0-140-212 kubenswrapper[2588]: W0715 16:00:52.829068    2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd2d10b0_102b_42c0_ae91_37f5ee6d001b.slice/crio-f5404499ec30f419be967ee67001f041dd91fb3f2acae88747a97acd4234003a WatchSource:0}: Error finding container f5404499ec30f419be967ee67001f041dd91fb3f2acae88747a97acd4234003a: Status 404 returned error can't find the container with id f5404499ec30f419be967ee67001f041dd91fb3f2acae88747a97acd4234003a
Jul 15 16:00:53.744792 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:00:53.744709    2588 generic.go:356] "Generic (PLEG): container finished" podID="bd2d10b0-102b-42c0-ae91-37f5ee6d001b" containerID="b6dc27558237a120588dad3c66ec06e6a21fa977598ee5c118f8ca4c388ca0dd" exitCode=7
Jul 15 16:00:53.745131 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:00:53.744797    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-08a5731c-8d7pm" event={"ID":"bd2d10b0-102b-42c0-ae91-37f5ee6d001b","Type":"ContainerDied","Data":"b6dc27558237a120588dad3c66ec06e6a21fa977598ee5c118f8ca4c388ca0dd"}
Jul 15 16:00:53.745131 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:00:53.744846    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-08a5731c-8d7pm" event={"ID":"bd2d10b0-102b-42c0-ae91-37f5ee6d001b","Type":"ContainerStarted","Data":"f5404499ec30f419be967ee67001f041dd91fb3f2acae88747a97acd4234003a"}
Jul 15 16:00:53.745131 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:00:53.744978    2588 scope.go:117] "RemoveContainer" containerID="b6dc27558237a120588dad3c66ec06e6a21fa977598ee5c118f8ca4c388ca0dd"
Jul 15 16:00:54.751516 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:00:54.751428    2588 generic.go:356] "Generic (PLEG): container finished" podID="bd2d10b0-102b-42c0-ae91-37f5ee6d001b" containerID="43bcc34dda259c150c0985554fa257143095ccf7c1eb066128f47c177727cef8" exitCode=7
Jul 15 16:00:54.751516 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:00:54.751485    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-08a5731c-8d7pm" event={"ID":"bd2d10b0-102b-42c0-ae91-37f5ee6d001b","Type":"ContainerDied","Data":"43bcc34dda259c150c0985554fa257143095ccf7c1eb066128f47c177727cef8"}
Jul 15 16:00:54.751978 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:00:54.751532    2588 scope.go:117] "RemoveContainer" containerID="b6dc27558237a120588dad3c66ec06e6a21fa977598ee5c118f8ca4c388ca0dd"
Jul 15 16:00:54.751978 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:00:54.751668    2588 scope.go:117] "RemoveContainer" containerID="43bcc34dda259c150c0985554fa257143095ccf7c1eb066128f47c177727cef8"
Jul 15 16:00:54.751978 ip-10-0-140-212 kubenswrapper[2588]: E0715 16:00:54.751907    2588 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-08a5731c-8d7pm_odh-ai-gateway-infra(bd2d10b0-102b-42c0-ae91-37f5ee6d001b)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-08a5731c-8d7pm" podUID="bd2d10b0-102b-42c0-ae91-37f5ee6d001b"
Jul 15 16:00:55.763830 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:00:55.763802    2588 scope.go:117] "RemoveContainer" containerID="43bcc34dda259c150c0985554fa257143095ccf7c1eb066128f47c177727cef8"
Jul 15 16:00:55.764206 ip-10-0-140-212 kubenswrapper[2588]: E0715 16:00:55.764005    2588 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-08a5731c-8d7pm_odh-ai-gateway-infra(bd2d10b0-102b-42c0-ae91-37f5ee6d001b)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-08a5731c-8d7pm" podUID="bd2d10b0-102b-42c0-ae91-37f5ee6d001b"
Jul 15 16:01:09.904900 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:01:09.904870    2588 scope.go:117] "RemoveContainer" containerID="43bcc34dda259c150c0985554fa257143095ccf7c1eb066128f47c177727cef8"
Jul 15 16:01:10.840889 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:01:10.840853    2588 generic.go:356] "Generic (PLEG): container finished" podID="bd2d10b0-102b-42c0-ae91-37f5ee6d001b" containerID="9b9ba50bc9d3ab192d7f9fd872455d836160b41a5efe9118e5d0e36b9b89d076" exitCode=0
Jul 15 16:01:10.841064 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:01:10.840923    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-08a5731c-8d7pm" event={"ID":"bd2d10b0-102b-42c0-ae91-37f5ee6d001b","Type":"ContainerDied","Data":"9b9ba50bc9d3ab192d7f9fd872455d836160b41a5efe9118e5d0e36b9b89d076"}
Jul 15 16:01:10.841064 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:01:10.841010    2588 scope.go:117] "RemoveContainer" containerID="43bcc34dda259c150c0985554fa257143095ccf7c1eb066128f47c177727cef8"
Jul 15 16:01:11.877154 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:01:11.877119    2588 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-08a5731c-8d7pm"]
Jul 15 16:01:11.993749 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:01:11.993723    2588 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-08a5731c-8d7pm"
Jul 15 16:01:12.005285 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:01:12.005264    2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bd2d10b0-102b-42c0-ae91-37f5ee6d001b-maas-api-service-ca\") pod \"bd2d10b0-102b-42c0-ae91-37f5ee6d001b\" (UID: \"bd2d10b0-102b-42c0-ae91-37f5ee6d001b\") "
Jul 15 16:01:12.005527 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:01:12.005509    2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bd2d10b0-102b-42c0-ae91-37f5ee6d001b-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "bd2d10b0-102b-42c0-ae91-37f5ee6d001b" (UID: "bd2d10b0-102b-42c0-ae91-37f5ee6d001b"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 16:01:12.106510 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:01:12.106442    2588 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bd2d10b0-102b-42c0-ae91-37f5ee6d001b-maas-api-service-ca\") on node \"ip-10-0-140-212.ec2.internal\" DevicePath \"\""
Jul 15 16:01:12.854310 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:01:12.854279    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-08a5731c-8d7pm" event={"ID":"bd2d10b0-102b-42c0-ae91-37f5ee6d001b","Type":"ContainerDied","Data":"f5404499ec30f419be967ee67001f041dd91fb3f2acae88747a97acd4234003a"}
Jul 15 16:01:12.854310 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:01:12.854301    2588 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-08a5731c-8d7pm"
Jul 15 16:01:12.854541 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:01:12.854328    2588 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f5404499ec30f419be967ee67001f041dd91fb3f2acae88747a97acd4234003a"
Jul 15 16:01:12.885184 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:01:12.885157    2588 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-08a5731c-8d7pm"]
Jul 15 16:01:12.890205 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:01:12.890182    2588 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-08a5731c-8d7pm"]
Jul 15 16:01:12.909971 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:01:12.909943    2588 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bd2d10b0-102b-42c0-ae91-37f5ee6d001b" path="/var/lib/kubelet/pods/bd2d10b0-102b-42c0-ae91-37f5ee6d001b/volumes"
Jul 15 16:01:52.442144 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:01:52.442110    2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-08a5731c-vrwm4"]
Jul 15 16:01:52.442619 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:01:52.442452    2588 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bd2d10b0-102b-42c0-ae91-37f5ee6d001b" containerName="revoke-keys"
Jul 15 16:01:52.442619 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:01:52.442463    2588 state_mem.go:107] "Deleted CPUSet assignment" podUID="bd2d10b0-102b-42c0-ae91-37f5ee6d001b" containerName="revoke-keys"
Jul 15 16:01:52.442619 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:01:52.442477    2588 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bd2d10b0-102b-42c0-ae91-37f5ee6d001b" containerName="revoke-keys"
Jul 15 16:01:52.442619 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:01:52.442482    2588 state_mem.go:107] "Deleted CPUSet assignment" podUID="bd2d10b0-102b-42c0-ae91-37f5ee6d001b" containerName="revoke-keys"
Jul 15 16:01:52.442619 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:01:52.442546    2588 memory_manager.go:368] "RemoveStaleState removing state" podUID="bd2d10b0-102b-42c0-ae91-37f5ee6d001b" containerName="revoke-keys"
Jul 15 16:01:52.442619 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:01:52.442553    2588 memory_manager.go:368] "RemoveStaleState removing state" podUID="bd2d10b0-102b-42c0-ae91-37f5ee6d001b" containerName="revoke-keys"
Jul 15 16:01:52.442619 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:01:52.442560    2588 memory_manager.go:368] "RemoveStaleState removing state" podUID="bd2d10b0-102b-42c0-ae91-37f5ee6d001b" containerName="revoke-keys"
Jul 15 16:01:52.445473 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:01:52.445455    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-08a5731c-vrwm4"
Jul 15 16:01:52.448313 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:01:52.448296    2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 15 16:01:52.448406 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:01:52.448336    2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-f55c8\""
Jul 15 16:01:52.454573 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:01:52.454546    2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-08a5731c-vrwm4"]
Jul 15 16:01:52.540164 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:01:52.540121    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/63d2c54f-60c2-4d0f-9edc-8917e20b7c58-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-08a5731c-vrwm4\" (UID: \"63d2c54f-60c2-4d0f-9edc-8917e20b7c58\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-08a5731c-vrwm4"
Jul 15 16:01:52.641353 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:01:52.641322    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/63d2c54f-60c2-4d0f-9edc-8917e20b7c58-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-08a5731c-vrwm4\" (UID: \"63d2c54f-60c2-4d0f-9edc-8917e20b7c58\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-08a5731c-vrwm4"
Jul 15 16:01:52.641903 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:01:52.641884    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/63d2c54f-60c2-4d0f-9edc-8917e20b7c58-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-08a5731c-vrwm4\" (UID: \"63d2c54f-60c2-4d0f-9edc-8917e20b7c58\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-08a5731c-vrwm4"
Jul 15 16:01:52.756549 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:01:52.756476    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-08a5731c-vrwm4"
Jul 15 16:01:52.883567 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:01:52.883541    2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-08a5731c-vrwm4"]
Jul 15 16:01:52.885099 ip-10-0-140-212 kubenswrapper[2588]: W0715 16:01:52.885076    2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63d2c54f_60c2_4d0f_9edc_8917e20b7c58.slice/crio-78884e5281721e4afeff8dd1e563fb54e616914775eed0e2fe3a90acbb19b00b WatchSource:0}: Error finding container 78884e5281721e4afeff8dd1e563fb54e616914775eed0e2fe3a90acbb19b00b: Status 404 returned error can't find the container with id 78884e5281721e4afeff8dd1e563fb54e616914775eed0e2fe3a90acbb19b00b
Jul 15 16:01:53.067208 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:01:53.067130    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-08a5731c-vrwm4" event={"ID":"63d2c54f-60c2-4d0f-9edc-8917e20b7c58","Type":"ContainerStarted","Data":"78884e5281721e4afeff8dd1e563fb54e616914775eed0e2fe3a90acbb19b00b"}
Jul 15 16:01:54.074277 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:01:54.074243    2588 generic.go:356] "Generic (PLEG): container finished" podID="63d2c54f-60c2-4d0f-9edc-8917e20b7c58" containerID="a47ef42e181c1f10f5b5ecb8978d80ae0f8bd026f11da7855feddaf79d64dd61" exitCode=0
Jul 15 16:01:54.074675 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:01:54.074334    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-08a5731c-vrwm4" event={"ID":"63d2c54f-60c2-4d0f-9edc-8917e20b7c58","Type":"ContainerDied","Data":"a47ef42e181c1f10f5b5ecb8978d80ae0f8bd026f11da7855feddaf79d64dd61"}
Jul 15 16:01:55.204012 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:01:55.203989    2588 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-08a5731c-vrwm4"
Jul 15 16:01:55.367277 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:01:55.367200    2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/63d2c54f-60c2-4d0f-9edc-8917e20b7c58-maas-api-service-ca\") pod \"63d2c54f-60c2-4d0f-9edc-8917e20b7c58\" (UID: \"63d2c54f-60c2-4d0f-9edc-8917e20b7c58\") "
Jul 15 16:01:55.367551 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:01:55.367531    2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/63d2c54f-60c2-4d0f-9edc-8917e20b7c58-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "63d2c54f-60c2-4d0f-9edc-8917e20b7c58" (UID: "63d2c54f-60c2-4d0f-9edc-8917e20b7c58"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 16:01:55.468631 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:01:55.468598    2588 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/63d2c54f-60c2-4d0f-9edc-8917e20b7c58-maas-api-service-ca\") on node \"ip-10-0-140-212.ec2.internal\" DevicePath \"\""
Jul 15 16:01:56.089140 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:01:56.089112    2588 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-08a5731c-vrwm4"
Jul 15 16:01:56.089314 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:01:56.089155    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-08a5731c-vrwm4" event={"ID":"63d2c54f-60c2-4d0f-9edc-8917e20b7c58","Type":"ContainerDied","Data":"78884e5281721e4afeff8dd1e563fb54e616914775eed0e2fe3a90acbb19b00b"}
Jul 15 16:01:56.089314 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:01:56.089199    2588 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="78884e5281721e4afeff8dd1e563fb54e616914775eed0e2fe3a90acbb19b00b"
Jul 15 16:02:24.091513 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:02:24.091474    2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-f9b8f1b9-bph6b"]
Jul 15 16:02:24.092012 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:02:24.091964    2588 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="63d2c54f-60c2-4d0f-9edc-8917e20b7c58" containerName="revoke-keys"
Jul 15 16:02:24.092012 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:02:24.091983    2588 state_mem.go:107] "Deleted CPUSet assignment" podUID="63d2c54f-60c2-4d0f-9edc-8917e20b7c58" containerName="revoke-keys"
Jul 15 16:02:24.092012 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:02:24.092003    2588 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bd2d10b0-102b-42c0-ae91-37f5ee6d001b" containerName="revoke-keys"
Jul 15 16:02:24.092012 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:02:24.092011    2588 state_mem.go:107] "Deleted CPUSet assignment" podUID="bd2d10b0-102b-42c0-ae91-37f5ee6d001b" containerName="revoke-keys"
Jul 15 16:02:24.092216 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:02:24.092103    2588 memory_manager.go:368] "RemoveStaleState removing state" podUID="63d2c54f-60c2-4d0f-9edc-8917e20b7c58" containerName="revoke-keys"
Jul 15 16:02:24.095242 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:02:24.095221    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-f9b8f1b9-bph6b"
Jul 15 16:02:24.098189 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:02:24.098163    2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 15 16:02:24.098299 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:02:24.098166    2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-f55c8\""
Jul 15 16:02:24.103251 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:02:24.103217    2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-f9b8f1b9-bph6b"]
Jul 15 16:02:24.205607 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:02:24.205566    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fb960748-a94d-4df5-b0c8-090eddda7a11-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-f9b8f1b9-bph6b\" (UID: \"fb960748-a94d-4df5-b0c8-090eddda7a11\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-f9b8f1b9-bph6b"
Jul 15 16:02:24.306331 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:02:24.306295    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fb960748-a94d-4df5-b0c8-090eddda7a11-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-f9b8f1b9-bph6b\" (UID: \"fb960748-a94d-4df5-b0c8-090eddda7a11\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-f9b8f1b9-bph6b"
Jul 15 16:02:24.306923 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:02:24.306902    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fb960748-a94d-4df5-b0c8-090eddda7a11-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-f9b8f1b9-bph6b\" (UID: \"fb960748-a94d-4df5-b0c8-090eddda7a11\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-f9b8f1b9-bph6b"
Jul 15 16:02:24.405851 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:02:24.405768    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-f9b8f1b9-bph6b"
Jul 15 16:02:24.540433 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:02:24.540397    2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-f9b8f1b9-bph6b"]
Jul 15 16:02:24.541699 ip-10-0-140-212 kubenswrapper[2588]: W0715 16:02:24.541675    2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb960748_a94d_4df5_b0c8_090eddda7a11.slice/crio-466c16627ec41cafcca0d2ba78be61061441b223b2d15693ba7bb60943cc5cfc WatchSource:0}: Error finding container 466c16627ec41cafcca0d2ba78be61061441b223b2d15693ba7bb60943cc5cfc: Status 404 returned error can't find the container with id 466c16627ec41cafcca0d2ba78be61061441b223b2d15693ba7bb60943cc5cfc
Jul 15 16:02:25.236082 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:02:25.236048    2588 generic.go:356] "Generic (PLEG): container finished" podID="fb960748-a94d-4df5-b0c8-090eddda7a11" containerID="41efbafab228744381484a9d911b03dbd9f3b270360242f1ff03483245e7e517" exitCode=7
Jul 15 16:02:25.236441 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:02:25.236114    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-f9b8f1b9-bph6b" event={"ID":"fb960748-a94d-4df5-b0c8-090eddda7a11","Type":"ContainerDied","Data":"41efbafab228744381484a9d911b03dbd9f3b270360242f1ff03483245e7e517"}
Jul 15 16:02:25.236441 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:02:25.236176    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-f9b8f1b9-bph6b" event={"ID":"fb960748-a94d-4df5-b0c8-090eddda7a11","Type":"ContainerStarted","Data":"466c16627ec41cafcca0d2ba78be61061441b223b2d15693ba7bb60943cc5cfc"}
Jul 15 16:02:25.236441 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:02:25.236418    2588 scope.go:117] "RemoveContainer" containerID="41efbafab228744381484a9d911b03dbd9f3b270360242f1ff03483245e7e517"
Jul 15 16:02:26.243241 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:02:26.243208    2588 generic.go:356] "Generic (PLEG): container finished" podID="fb960748-a94d-4df5-b0c8-090eddda7a11" containerID="d52a21546b713a56972c2f314f7d2e7a74767247a051c7865c7072b37a55255a" exitCode=7
Jul 15 16:02:26.243627 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:02:26.243288    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-f9b8f1b9-bph6b" event={"ID":"fb960748-a94d-4df5-b0c8-090eddda7a11","Type":"ContainerDied","Data":"d52a21546b713a56972c2f314f7d2e7a74767247a051c7865c7072b37a55255a"}
Jul 15 16:02:26.243627 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:02:26.243363    2588 scope.go:117] "RemoveContainer" containerID="41efbafab228744381484a9d911b03dbd9f3b270360242f1ff03483245e7e517"
Jul 15 16:02:26.243627 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:02:26.243500    2588 scope.go:117] "RemoveContainer" containerID="d52a21546b713a56972c2f314f7d2e7a74767247a051c7865c7072b37a55255a"
Jul 15 16:02:26.243751 ip-10-0-140-212 kubenswrapper[2588]: E0715 16:02:26.243714    2588 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-f9b8f1b9-bph6b_odh-ai-gateway-infra(fb960748-a94d-4df5-b0c8-090eddda7a11)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-f9b8f1b9-bph6b" podUID="fb960748-a94d-4df5-b0c8-090eddda7a11"
Jul 15 16:02:27.255861 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:02:27.255831    2588 scope.go:117] "RemoveContainer" containerID="d52a21546b713a56972c2f314f7d2e7a74767247a051c7865c7072b37a55255a"
Jul 15 16:02:27.256476 ip-10-0-140-212 kubenswrapper[2588]: E0715 16:02:27.256038    2588 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-f9b8f1b9-bph6b_odh-ai-gateway-infra(fb960748-a94d-4df5-b0c8-090eddda7a11)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-f9b8f1b9-bph6b" podUID="fb960748-a94d-4df5-b0c8-090eddda7a11"
Jul 15 16:02:37.905254 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:02:37.905224    2588 scope.go:117] "RemoveContainer" containerID="d52a21546b713a56972c2f314f7d2e7a74767247a051c7865c7072b37a55255a"
Jul 15 16:02:38.319330 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:02:38.319240    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-f9b8f1b9-bph6b" event={"ID":"fb960748-a94d-4df5-b0c8-090eddda7a11","Type":"ContainerStarted","Data":"afd5d7014a72cb20d3c9a0d76798af2381c6b21a48302bdd4ae8a8b196eae435"}
Jul 15 16:02:38.340209 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:02:38.340160    2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-f9b8f1b9-bph6b" podStartSLOduration=14.340145516 podStartE2EDuration="14.340145516s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 16:02:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:02:38.338060265 +0000 UTC m=+1643.990126023" watchObservedRunningTime="2026-07-15 16:02:38.340145516 +0000 UTC m=+1643.992211283"
Jul 15 16:02:39.325942 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:02:39.325902    2588 generic.go:356] "Generic (PLEG): container finished" podID="fb960748-a94d-4df5-b0c8-090eddda7a11" containerID="afd5d7014a72cb20d3c9a0d76798af2381c6b21a48302bdd4ae8a8b196eae435" exitCode=0
Jul 15 16:02:39.326333 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:02:39.325972    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-f9b8f1b9-bph6b" event={"ID":"fb960748-a94d-4df5-b0c8-090eddda7a11","Type":"ContainerDied","Data":"afd5d7014a72cb20d3c9a0d76798af2381c6b21a48302bdd4ae8a8b196eae435"}
Jul 15 16:02:39.326333 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:02:39.326061    2588 scope.go:117] "RemoveContainer" containerID="d52a21546b713a56972c2f314f7d2e7a74767247a051c7865c7072b37a55255a"
Jul 15 16:02:39.352361 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:02:39.352325    2588 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-f9b8f1b9-bph6b"]
Jul 15 16:02:40.459640 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:02:40.459618    2588 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-f9b8f1b9-bph6b"
Jul 15 16:02:40.541389 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:02:40.541358    2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fb960748-a94d-4df5-b0c8-090eddda7a11-maas-api-service-ca\") pod \"fb960748-a94d-4df5-b0c8-090eddda7a11\" (UID: \"fb960748-a94d-4df5-b0c8-090eddda7a11\") "
Jul 15 16:02:40.541693 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:02:40.541671    2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fb960748-a94d-4df5-b0c8-090eddda7a11-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "fb960748-a94d-4df5-b0c8-090eddda7a11" (UID: "fb960748-a94d-4df5-b0c8-090eddda7a11"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 16:02:40.642208 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:02:40.642137    2588 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fb960748-a94d-4df5-b0c8-090eddda7a11-maas-api-service-ca\") on node \"ip-10-0-140-212.ec2.internal\" DevicePath \"\""
Jul 15 16:02:41.338470 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:02:41.338434    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-f9b8f1b9-bph6b" event={"ID":"fb960748-a94d-4df5-b0c8-090eddda7a11","Type":"ContainerDied","Data":"466c16627ec41cafcca0d2ba78be61061441b223b2d15693ba7bb60943cc5cfc"}
Jul 15 16:02:41.338470 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:02:41.338470    2588 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-f9b8f1b9-bph6b"
Jul 15 16:02:41.338669 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:02:41.338496    2588 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="466c16627ec41cafcca0d2ba78be61061441b223b2d15693ba7bb60943cc5cfc"
Jul 15 16:02:41.372889 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:02:41.372860    2588 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-f9b8f1b9-bph6b"]
Jul 15 16:02:41.380150 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:02:41.380128    2588 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-f9b8f1b9-bph6b"]
Jul 15 16:02:42.910469 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:02:42.910437    2588 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fb960748-a94d-4df5-b0c8-090eddda7a11" path="/var/lib/kubelet/pods/fb960748-a94d-4df5-b0c8-090eddda7a11/volumes"
Jul 15 16:03:14.160864 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:03:14.160822    2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-f9b8f1b9-czc9t"]
Jul 15 16:03:14.161300 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:03:14.161191    2588 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fb960748-a94d-4df5-b0c8-090eddda7a11" containerName="revoke-keys"
Jul 15 16:03:14.161300 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:03:14.161203    2588 state_mem.go:107] "Deleted CPUSet assignment" podUID="fb960748-a94d-4df5-b0c8-090eddda7a11" containerName="revoke-keys"
Jul 15 16:03:14.161300 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:03:14.161212    2588 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fb960748-a94d-4df5-b0c8-090eddda7a11" containerName="revoke-keys"
Jul 15 16:03:14.161300 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:03:14.161221    2588 state_mem.go:107] "Deleted CPUSet assignment" podUID="fb960748-a94d-4df5-b0c8-090eddda7a11" containerName="revoke-keys"
Jul 15 16:03:14.161300 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:03:14.161231    2588 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fb960748-a94d-4df5-b0c8-090eddda7a11" containerName="revoke-keys"
Jul 15 16:03:14.161300 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:03:14.161237    2588 state_mem.go:107] "Deleted CPUSet assignment" podUID="fb960748-a94d-4df5-b0c8-090eddda7a11" containerName="revoke-keys"
Jul 15 16:03:14.161522 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:03:14.161309    2588 memory_manager.go:368] "RemoveStaleState removing state" podUID="fb960748-a94d-4df5-b0c8-090eddda7a11" containerName="revoke-keys"
Jul 15 16:03:14.161522 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:03:14.161318    2588 memory_manager.go:368] "RemoveStaleState removing state" podUID="fb960748-a94d-4df5-b0c8-090eddda7a11" containerName="revoke-keys"
Jul 15 16:03:14.164158 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:03:14.164139    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-f9b8f1b9-czc9t"
Jul 15 16:03:14.170736 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:03:14.168629    2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-f55c8\""
Jul 15 16:03:14.170736 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:03:14.169037    2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 15 16:03:14.186633 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:03:14.186604    2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-f9b8f1b9-czc9t"]
Jul 15 16:03:14.225689 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:03:14.225652    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4b677788-f6b8-44a4-9a2d-c37378f2df6e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-f9b8f1b9-czc9t\" (UID: \"4b677788-f6b8-44a4-9a2d-c37378f2df6e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-f9b8f1b9-czc9t"
Jul 15 16:03:14.326482 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:03:14.326447    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4b677788-f6b8-44a4-9a2d-c37378f2df6e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-f9b8f1b9-czc9t\" (UID: \"4b677788-f6b8-44a4-9a2d-c37378f2df6e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-f9b8f1b9-czc9t"
Jul 15 16:03:14.327101 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:03:14.327082    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4b677788-f6b8-44a4-9a2d-c37378f2df6e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-f9b8f1b9-czc9t\" (UID: \"4b677788-f6b8-44a4-9a2d-c37378f2df6e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-f9b8f1b9-czc9t"
Jul 15 16:03:14.476787 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:03:14.476693    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-f9b8f1b9-czc9t"
Jul 15 16:03:14.613282 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:03:14.613249    2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-f9b8f1b9-czc9t"]
Jul 15 16:03:14.614809 ip-10-0-140-212 kubenswrapper[2588]: W0715 16:03:14.614779    2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b677788_f6b8_44a4_9a2d_c37378f2df6e.slice/crio-3e82d2d8b5d1dc331e9a591eb166605c20210c5360c354c835188a6001375dcf WatchSource:0}: Error finding container 3e82d2d8b5d1dc331e9a591eb166605c20210c5360c354c835188a6001375dcf: Status 404 returned error can't find the container with id 3e82d2d8b5d1dc331e9a591eb166605c20210c5360c354c835188a6001375dcf
Jul 15 16:03:15.518458 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:03:15.518419    2588 generic.go:356] "Generic (PLEG): container finished" podID="4b677788-f6b8-44a4-9a2d-c37378f2df6e" containerID="cd3846e11f0e3d6deffc508de492faee64048c32800afd5118bf60cdb1f4fda6" exitCode=0
Jul 15 16:03:15.518976 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:03:15.518505    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-f9b8f1b9-czc9t" event={"ID":"4b677788-f6b8-44a4-9a2d-c37378f2df6e","Type":"ContainerDied","Data":"cd3846e11f0e3d6deffc508de492faee64048c32800afd5118bf60cdb1f4fda6"}
Jul 15 16:03:15.518976 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:03:15.518562    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-f9b8f1b9-czc9t" event={"ID":"4b677788-f6b8-44a4-9a2d-c37378f2df6e","Type":"ContainerStarted","Data":"3e82d2d8b5d1dc331e9a591eb166605c20210c5360c354c835188a6001375dcf"}
Jul 15 16:03:16.652244 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:03:16.652219    2588 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-f9b8f1b9-czc9t"
Jul 15 16:03:16.747718 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:03:16.747682    2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4b677788-f6b8-44a4-9a2d-c37378f2df6e-maas-api-service-ca\") pod \"4b677788-f6b8-44a4-9a2d-c37378f2df6e\" (UID: \"4b677788-f6b8-44a4-9a2d-c37378f2df6e\") "
Jul 15 16:03:16.748056 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:03:16.748033    2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4b677788-f6b8-44a4-9a2d-c37378f2df6e-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "4b677788-f6b8-44a4-9a2d-c37378f2df6e" (UID: "4b677788-f6b8-44a4-9a2d-c37378f2df6e"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 16:03:16.848946 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:03:16.848910    2588 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4b677788-f6b8-44a4-9a2d-c37378f2df6e-maas-api-service-ca\") on node \"ip-10-0-140-212.ec2.internal\" DevicePath \"\""
Jul 15 16:03:17.531113 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:03:17.531072    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-f9b8f1b9-czc9t" event={"ID":"4b677788-f6b8-44a4-9a2d-c37378f2df6e","Type":"ContainerDied","Data":"3e82d2d8b5d1dc331e9a591eb166605c20210c5360c354c835188a6001375dcf"}
Jul 15 16:03:17.531283 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:03:17.531133    2588 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3e82d2d8b5d1dc331e9a591eb166605c20210c5360c354c835188a6001375dcf"
Jul 15 16:03:17.531283 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:03:17.531078    2588 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-f9b8f1b9-czc9t"
Jul 15 16:03:37.503252 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:03:37.503167    2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-18e9c399-2qgt4"]
Jul 15 16:03:37.503704 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:03:37.503686    2588 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4b677788-f6b8-44a4-9a2d-c37378f2df6e" containerName="revoke-keys"
Jul 15 16:03:37.503776 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:03:37.503709    2588 state_mem.go:107] "Deleted CPUSet assignment" podUID="4b677788-f6b8-44a4-9a2d-c37378f2df6e" containerName="revoke-keys"
Jul 15 16:03:37.503842 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:03:37.503827    2588 memory_manager.go:368] "RemoveStaleState removing state" podUID="fb960748-a94d-4df5-b0c8-090eddda7a11" containerName="revoke-keys"
Jul 15 16:03:37.503897 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:03:37.503845    2588 memory_manager.go:368] "RemoveStaleState removing state" podUID="4b677788-f6b8-44a4-9a2d-c37378f2df6e" containerName="revoke-keys"
Jul 15 16:03:37.506815 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:03:37.506795    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-18e9c399-2qgt4"
Jul 15 16:03:37.511748 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:03:37.511722    2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-f55c8\""
Jul 15 16:03:37.511848 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:03:37.511725    2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 15 16:03:37.520907 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:03:37.520883    2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-18e9c399-2qgt4"]
Jul 15 16:03:37.641789 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:03:37.641751    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/549d9cfb-f3ee-462c-a448-18c7842a6065-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-18e9c399-2qgt4\" (UID: \"549d9cfb-f3ee-462c-a448-18c7842a6065\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-18e9c399-2qgt4"
Jul 15 16:03:37.742329 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:03:37.742295    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/549d9cfb-f3ee-462c-a448-18c7842a6065-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-18e9c399-2qgt4\" (UID: \"549d9cfb-f3ee-462c-a448-18c7842a6065\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-18e9c399-2qgt4"
Jul 15 16:03:37.742949 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:03:37.742929    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/549d9cfb-f3ee-462c-a448-18c7842a6065-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-18e9c399-2qgt4\" (UID: \"549d9cfb-f3ee-462c-a448-18c7842a6065\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-18e9c399-2qgt4"
Jul 15 16:03:37.816691 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:03:37.816617    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-18e9c399-2qgt4"
Jul 15 16:03:37.962153 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:03:37.962128    2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-18e9c399-2qgt4"]
Jul 15 16:03:37.964164 ip-10-0-140-212 kubenswrapper[2588]: W0715 16:03:37.964133    2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod549d9cfb_f3ee_462c_a448_18c7842a6065.slice/crio-9f2387a464049f9277a6a99cb3a2803221bbe3e7c0d6b63f7f4a6787cd1ef50b WatchSource:0}: Error finding container 9f2387a464049f9277a6a99cb3a2803221bbe3e7c0d6b63f7f4a6787cd1ef50b: Status 404 returned error can't find the container with id 9f2387a464049f9277a6a99cb3a2803221bbe3e7c0d6b63f7f4a6787cd1ef50b
Jul 15 16:03:38.647414 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:03:38.647385    2588 generic.go:356] "Generic (PLEG): container finished" podID="549d9cfb-f3ee-462c-a448-18c7842a6065" containerID="af2b6eab25e784b26fc230d3956cdccb136043388308c30820291ed12485f460" exitCode=7
Jul 15 16:03:38.647733 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:03:38.647467    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-18e9c399-2qgt4" event={"ID":"549d9cfb-f3ee-462c-a448-18c7842a6065","Type":"ContainerDied","Data":"af2b6eab25e784b26fc230d3956cdccb136043388308c30820291ed12485f460"}
Jul 15 16:03:38.647733 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:03:38.647529    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-18e9c399-2qgt4" event={"ID":"549d9cfb-f3ee-462c-a448-18c7842a6065","Type":"ContainerStarted","Data":"9f2387a464049f9277a6a99cb3a2803221bbe3e7c0d6b63f7f4a6787cd1ef50b"}
Jul 15 16:03:38.647733 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:03:38.647640    2588 scope.go:117] "RemoveContainer" containerID="af2b6eab25e784b26fc230d3956cdccb136043388308c30820291ed12485f460"
Jul 15 16:03:39.654093 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:03:39.654021    2588 generic.go:356] "Generic (PLEG): container finished" podID="549d9cfb-f3ee-462c-a448-18c7842a6065" containerID="f1e2e1b76743e405dada4812a8d5b78250d491d4a9954fc467908924361a068a" exitCode=7
Jul 15 16:03:39.654488 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:03:39.654095    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-18e9c399-2qgt4" event={"ID":"549d9cfb-f3ee-462c-a448-18c7842a6065","Type":"ContainerDied","Data":"f1e2e1b76743e405dada4812a8d5b78250d491d4a9954fc467908924361a068a"}
Jul 15 16:03:39.654488 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:03:39.654148    2588 scope.go:117] "RemoveContainer" containerID="af2b6eab25e784b26fc230d3956cdccb136043388308c30820291ed12485f460"
Jul 15 16:03:39.654488 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:03:39.654269    2588 scope.go:117] "RemoveContainer" containerID="f1e2e1b76743e405dada4812a8d5b78250d491d4a9954fc467908924361a068a"
Jul 15 16:03:39.654488 ip-10-0-140-212 kubenswrapper[2588]: E0715 16:03:39.654460    2588 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-18e9c399-2qgt4_odh-ai-gateway-infra(549d9cfb-f3ee-462c-a448-18c7842a6065)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-18e9c399-2qgt4" podUID="549d9cfb-f3ee-462c-a448-18c7842a6065"
Jul 15 16:03:40.661607 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:03:40.661581    2588 scope.go:117] "RemoveContainer" containerID="f1e2e1b76743e405dada4812a8d5b78250d491d4a9954fc467908924361a068a"
Jul 15 16:03:40.661966 ip-10-0-140-212 kubenswrapper[2588]: E0715 16:03:40.661788    2588 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-18e9c399-2qgt4_odh-ai-gateway-infra(549d9cfb-f3ee-462c-a448-18c7842a6065)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-18e9c399-2qgt4" podUID="549d9cfb-f3ee-462c-a448-18c7842a6065"
Jul 15 16:03:52.904729 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:03:52.904696    2588 scope.go:117] "RemoveContainer" containerID="f1e2e1b76743e405dada4812a8d5b78250d491d4a9954fc467908924361a068a"
Jul 15 16:03:53.733387 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:03:53.733356    2588 generic.go:356] "Generic (PLEG): container finished" podID="549d9cfb-f3ee-462c-a448-18c7842a6065" containerID="bab4a86050e5275857e492cc91a874b5afa97d2739298114ff0b9b27daef6f5c" exitCode=0
Jul 15 16:03:53.733542 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:03:53.733412    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-18e9c399-2qgt4" event={"ID":"549d9cfb-f3ee-462c-a448-18c7842a6065","Type":"ContainerDied","Data":"bab4a86050e5275857e492cc91a874b5afa97d2739298114ff0b9b27daef6f5c"}
Jul 15 16:03:53.733542 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:03:53.733473    2588 scope.go:117] "RemoveContainer" containerID="f1e2e1b76743e405dada4812a8d5b78250d491d4a9954fc467908924361a068a"
Jul 15 16:03:54.762560 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:03:54.762521    2588 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-18e9c399-2qgt4"]
Jul 15 16:03:54.869437 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:03:54.869413    2588 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-18e9c399-2qgt4"
Jul 15 16:03:54.983276 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:03:54.983249    2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/549d9cfb-f3ee-462c-a448-18c7842a6065-maas-api-service-ca\") pod \"549d9cfb-f3ee-462c-a448-18c7842a6065\" (UID: \"549d9cfb-f3ee-462c-a448-18c7842a6065\") "
Jul 15 16:03:54.983642 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:03:54.983622    2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/549d9cfb-f3ee-462c-a448-18c7842a6065-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "549d9cfb-f3ee-462c-a448-18c7842a6065" (UID: "549d9cfb-f3ee-462c-a448-18c7842a6065"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 16:03:55.083784 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:03:55.083753    2588 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/549d9cfb-f3ee-462c-a448-18c7842a6065-maas-api-service-ca\") on node \"ip-10-0-140-212.ec2.internal\" DevicePath \"\""
Jul 15 16:03:55.746303 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:03:55.746273    2588 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-18e9c399-2qgt4"
Jul 15 16:03:55.746303 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:03:55.746283    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-18e9c399-2qgt4" event={"ID":"549d9cfb-f3ee-462c-a448-18c7842a6065","Type":"ContainerDied","Data":"9f2387a464049f9277a6a99cb3a2803221bbe3e7c0d6b63f7f4a6787cd1ef50b"}
Jul 15 16:03:55.746534 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:03:55.746330    2588 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9f2387a464049f9277a6a99cb3a2803221bbe3e7c0d6b63f7f4a6787cd1ef50b"
Jul 15 16:03:55.781709 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:03:55.781681    2588 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-18e9c399-2qgt4"]
Jul 15 16:03:55.788353 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:03:55.788323    2588 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-18e9c399-2qgt4"]
Jul 15 16:03:56.910825 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:03:56.910790    2588 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="549d9cfb-f3ee-462c-a448-18c7842a6065" path="/var/lib/kubelet/pods/549d9cfb-f3ee-462c-a448-18c7842a6065/volumes"
Jul 15 16:04:27.524124 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:04:27.524090    2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-18e9c399-2mqhh"]
Jul 15 16:04:27.524622 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:04:27.524484    2588 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="549d9cfb-f3ee-462c-a448-18c7842a6065" containerName="revoke-keys"
Jul 15 16:04:27.524622 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:04:27.524496    2588 state_mem.go:107] "Deleted CPUSet assignment" podUID="549d9cfb-f3ee-462c-a448-18c7842a6065" containerName="revoke-keys"
Jul 15 16:04:27.524622 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:04:27.524512    2588 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="549d9cfb-f3ee-462c-a448-18c7842a6065" containerName="revoke-keys"
Jul 15 16:04:27.524622 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:04:27.524517    2588 state_mem.go:107] "Deleted CPUSet assignment" podUID="549d9cfb-f3ee-462c-a448-18c7842a6065" containerName="revoke-keys"
Jul 15 16:04:27.524622 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:04:27.524581    2588 memory_manager.go:368] "RemoveStaleState removing state" podUID="549d9cfb-f3ee-462c-a448-18c7842a6065" containerName="revoke-keys"
Jul 15 16:04:27.524622 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:04:27.524590    2588 memory_manager.go:368] "RemoveStaleState removing state" podUID="549d9cfb-f3ee-462c-a448-18c7842a6065" containerName="revoke-keys"
Jul 15 16:04:27.524622 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:04:27.524597    2588 memory_manager.go:368] "RemoveStaleState removing state" podUID="549d9cfb-f3ee-462c-a448-18c7842a6065" containerName="revoke-keys"
Jul 15 16:04:27.527191 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:04:27.527175    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-18e9c399-2mqhh"
Jul 15 16:04:27.530261 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:04:27.530238    2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 15 16:04:27.530412 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:04:27.530304    2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-f55c8\""
Jul 15 16:04:27.538651 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:04:27.538626    2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-18e9c399-2mqhh"]
Jul 15 16:04:27.654435 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:04:27.654394    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a44a4e45-987d-403c-9375-65ea53007846-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-18e9c399-2mqhh\" (UID: \"a44a4e45-987d-403c-9375-65ea53007846\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-18e9c399-2mqhh"
Jul 15 16:04:27.755503 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:04:27.755464    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a44a4e45-987d-403c-9375-65ea53007846-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-18e9c399-2mqhh\" (UID: \"a44a4e45-987d-403c-9375-65ea53007846\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-18e9c399-2mqhh"
Jul 15 16:04:27.756035 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:04:27.756016    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a44a4e45-987d-403c-9375-65ea53007846-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-18e9c399-2mqhh\" (UID: \"a44a4e45-987d-403c-9375-65ea53007846\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-18e9c399-2mqhh"
Jul 15 16:04:27.837906 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:04:27.837882    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-18e9c399-2mqhh"
Jul 15 16:04:27.969804 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:04:27.969776    2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-18e9c399-2mqhh"]
Jul 15 16:04:27.971523 ip-10-0-140-212 kubenswrapper[2588]: W0715 16:04:27.971495    2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda44a4e45_987d_403c_9375_65ea53007846.slice/crio-ff9eac1b2c2b9a8cd64bef716ab575a8a3e6e31790a31d7450701514d90c56c8 WatchSource:0}: Error finding container ff9eac1b2c2b9a8cd64bef716ab575a8a3e6e31790a31d7450701514d90c56c8: Status 404 returned error can't find the container with id ff9eac1b2c2b9a8cd64bef716ab575a8a3e6e31790a31d7450701514d90c56c8
Jul 15 16:04:28.922046 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:04:28.921959    2588 generic.go:356] "Generic (PLEG): container finished" podID="a44a4e45-987d-403c-9375-65ea53007846" containerID="d9b604cab935ed144f44ff5d1267afb97a884e5811e91dd51fa85d3fde6f70f8" exitCode=0
Jul 15 16:04:28.922420 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:04:28.922045    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-18e9c399-2mqhh" event={"ID":"a44a4e45-987d-403c-9375-65ea53007846","Type":"ContainerDied","Data":"d9b604cab935ed144f44ff5d1267afb97a884e5811e91dd51fa85d3fde6f70f8"}
Jul 15 16:04:28.922420 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:04:28.922094    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-18e9c399-2mqhh" event={"ID":"a44a4e45-987d-403c-9375-65ea53007846","Type":"ContainerStarted","Data":"ff9eac1b2c2b9a8cd64bef716ab575a8a3e6e31790a31d7450701514d90c56c8"}
Jul 15 16:04:30.071921 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:04:30.071898    2588 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-18e9c399-2mqhh"
Jul 15 16:04:30.176239 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:04:30.176211    2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a44a4e45-987d-403c-9375-65ea53007846-maas-api-service-ca\") pod \"a44a4e45-987d-403c-9375-65ea53007846\" (UID: \"a44a4e45-987d-403c-9375-65ea53007846\") "
Jul 15 16:04:30.176563 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:04:30.176543    2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a44a4e45-987d-403c-9375-65ea53007846-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "a44a4e45-987d-403c-9375-65ea53007846" (UID: "a44a4e45-987d-403c-9375-65ea53007846"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 16:04:30.277438 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:04:30.277378    2588 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a44a4e45-987d-403c-9375-65ea53007846-maas-api-service-ca\") on node \"ip-10-0-140-212.ec2.internal\" DevicePath \"\""
Jul 15 16:04:30.933909 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:04:30.933882    2588 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-18e9c399-2mqhh"
Jul 15 16:04:30.933909 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:04:30.933901    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-18e9c399-2mqhh" event={"ID":"a44a4e45-987d-403c-9375-65ea53007846","Type":"ContainerDied","Data":"ff9eac1b2c2b9a8cd64bef716ab575a8a3e6e31790a31d7450701514d90c56c8"}
Jul 15 16:04:30.934101 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:04:30.933941    2588 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ff9eac1b2c2b9a8cd64bef716ab575a8a3e6e31790a31d7450701514d90c56c8"
Jul 15 16:04:59.545797 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:04:59.545765    2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5299c21f-zh25s"]
Jul 15 16:04:59.546196 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:04:59.546119    2588 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="549d9cfb-f3ee-462c-a448-18c7842a6065" containerName="revoke-keys"
Jul 15 16:04:59.546196 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:04:59.546130    2588 state_mem.go:107] "Deleted CPUSet assignment" podUID="549d9cfb-f3ee-462c-a448-18c7842a6065" containerName="revoke-keys"
Jul 15 16:04:59.546196 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:04:59.546151    2588 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a44a4e45-987d-403c-9375-65ea53007846" containerName="revoke-keys"
Jul 15 16:04:59.546196 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:04:59.546157    2588 state_mem.go:107] "Deleted CPUSet assignment" podUID="a44a4e45-987d-403c-9375-65ea53007846" containerName="revoke-keys"
Jul 15 16:04:59.546331 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:04:59.546206    2588 memory_manager.go:368] "RemoveStaleState removing state" podUID="a44a4e45-987d-403c-9375-65ea53007846" containerName="revoke-keys"
Jul 15 16:04:59.549245 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:04:59.549229    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5299c21f-zh25s"
Jul 15 16:04:59.552353 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:04:59.552322    2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 15 16:04:59.552463 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:04:59.552325    2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-f55c8\""
Jul 15 16:04:59.561104 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:04:59.561082    2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5299c21f-zh25s"]
Jul 15 16:04:59.618122 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:04:59.618089    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8510e52c-1260-4794-bc59-ac69f9bd78d7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-5299c21f-zh25s\" (UID: \"8510e52c-1260-4794-bc59-ac69f9bd78d7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5299c21f-zh25s"
Jul 15 16:04:59.719074 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:04:59.719032    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8510e52c-1260-4794-bc59-ac69f9bd78d7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-5299c21f-zh25s\" (UID: \"8510e52c-1260-4794-bc59-ac69f9bd78d7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5299c21f-zh25s"
Jul 15 16:04:59.719659 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:04:59.719639    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8510e52c-1260-4794-bc59-ac69f9bd78d7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-5299c21f-zh25s\" (UID: \"8510e52c-1260-4794-bc59-ac69f9bd78d7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5299c21f-zh25s"
Jul 15 16:04:59.858649 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:04:59.858624    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5299c21f-zh25s"
Jul 15 16:04:59.989185 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:04:59.989154    2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5299c21f-zh25s"]
Jul 15 16:04:59.991127 ip-10-0-140-212 kubenswrapper[2588]: W0715 16:04:59.991101    2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8510e52c_1260_4794_bc59_ac69f9bd78d7.slice/crio-9cce27921fd8eca826fc716cab07effef9bf71f1b6c19fd6fd47a88827b18631 WatchSource:0}: Error finding container 9cce27921fd8eca826fc716cab07effef9bf71f1b6c19fd6fd47a88827b18631: Status 404 returned error can't find the container with id 9cce27921fd8eca826fc716cab07effef9bf71f1b6c19fd6fd47a88827b18631
Jul 15 16:05:00.087779 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:05:00.087748    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5299c21f-zh25s" event={"ID":"8510e52c-1260-4794-bc59-ac69f9bd78d7","Type":"ContainerStarted","Data":"9cce27921fd8eca826fc716cab07effef9bf71f1b6c19fd6fd47a88827b18631"}
Jul 15 16:05:01.094444 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:05:01.094410    2588 generic.go:356] "Generic (PLEG): container finished" podID="8510e52c-1260-4794-bc59-ac69f9bd78d7" containerID="82c6518ec54548af4f2f08620c5dc5781baad21c12da5c6ca4d9428365f0d337" exitCode=7
Jul 15 16:05:01.094956 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:05:01.094503    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5299c21f-zh25s" event={"ID":"8510e52c-1260-4794-bc59-ac69f9bd78d7","Type":"ContainerDied","Data":"82c6518ec54548af4f2f08620c5dc5781baad21c12da5c6ca4d9428365f0d337"}
Jul 15 16:05:01.094956 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:05:01.094731    2588 scope.go:117] "RemoveContainer" containerID="82c6518ec54548af4f2f08620c5dc5781baad21c12da5c6ca4d9428365f0d337"
Jul 15 16:05:02.101358 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:05:02.101308    2588 generic.go:356] "Generic (PLEG): container finished" podID="8510e52c-1260-4794-bc59-ac69f9bd78d7" containerID="80ea3f8962f72c900bca9c9584c36cdf9a829cae6ed95beff4901ba93aff5099" exitCode=7
Jul 15 16:05:02.101728 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:05:02.101375    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5299c21f-zh25s" event={"ID":"8510e52c-1260-4794-bc59-ac69f9bd78d7","Type":"ContainerDied","Data":"80ea3f8962f72c900bca9c9584c36cdf9a829cae6ed95beff4901ba93aff5099"}
Jul 15 16:05:02.101728 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:05:02.101430    2588 scope.go:117] "RemoveContainer" containerID="82c6518ec54548af4f2f08620c5dc5781baad21c12da5c6ca4d9428365f0d337"
Jul 15 16:05:02.101728 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:05:02.101565    2588 scope.go:117] "RemoveContainer" containerID="80ea3f8962f72c900bca9c9584c36cdf9a829cae6ed95beff4901ba93aff5099"
Jul 15 16:05:02.101874 ip-10-0-140-212 kubenswrapper[2588]: E0715 16:05:02.101829    2588 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-5299c21f-zh25s_odh-ai-gateway-infra(8510e52c-1260-4794-bc59-ac69f9bd78d7)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5299c21f-zh25s" podUID="8510e52c-1260-4794-bc59-ac69f9bd78d7"
Jul 15 16:05:03.108531 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:05:03.108503    2588 scope.go:117] "RemoveContainer" containerID="80ea3f8962f72c900bca9c9584c36cdf9a829cae6ed95beff4901ba93aff5099"
Jul 15 16:05:03.108902 ip-10-0-140-212 kubenswrapper[2588]: E0715 16:05:03.108682    2588 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-5299c21f-zh25s_odh-ai-gateway-infra(8510e52c-1260-4794-bc59-ac69f9bd78d7)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5299c21f-zh25s" podUID="8510e52c-1260-4794-bc59-ac69f9bd78d7"
Jul 15 16:05:14.924668 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:05:14.924642    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-5f7f494dd4-lbdlp_c80ed5cd-4b7c-4981-95c6-a02cf058f709/cluster-monitoring-operator/0.log"
Jul 15 16:05:14.927501 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:05:14.927478    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-5f7f494dd4-lbdlp_c80ed5cd-4b7c-4981-95c6-a02cf058f709/cluster-monitoring-operator/0.log"
Jul 15 16:05:14.930155 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:05:14.930136    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-qcvqk_eb866034-d7d1-4bee-b8b7-616b355d371d/console-operator/1.log"
Jul 15 16:05:14.932725 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:05:14.932708    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dthn7_ec82e02f-7632-41be-8e7d-8c9d59c569b6/ovn-acl-logging/0.log"
Jul 15 16:05:14.933013 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:05:14.932998    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-qcvqk_eb866034-d7d1-4bee-b8b7-616b355d371d/console-operator/1.log"
Jul 15 16:05:14.935438 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:05:14.935420    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dthn7_ec82e02f-7632-41be-8e7d-8c9d59c569b6/ovn-acl-logging/0.log"
Jul 15 16:05:15.905452 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:05:15.905419    2588 scope.go:117] "RemoveContainer" containerID="80ea3f8962f72c900bca9c9584c36cdf9a829cae6ed95beff4901ba93aff5099"
Jul 15 16:05:16.178039 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:05:16.177948    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5299c21f-zh25s" event={"ID":"8510e52c-1260-4794-bc59-ac69f9bd78d7","Type":"ContainerStarted","Data":"0f9adb78169c90ffb14a353431272894a91b7261f46aba3c070474b4ff6067a3"}
Jul 15 16:05:16.204592 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:05:16.204513    2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5299c21f-zh25s" podStartSLOduration=17.204493726 podStartE2EDuration="17.204493726s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 16:04:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:05:16.199529749 +0000 UTC m=+1801.851595530" watchObservedRunningTime="2026-07-15 16:05:16.204493726 +0000 UTC m=+1801.856559485"
Jul 15 16:05:17.185513 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:05:17.185471    2588 generic.go:356] "Generic (PLEG): container finished" podID="8510e52c-1260-4794-bc59-ac69f9bd78d7" containerID="0f9adb78169c90ffb14a353431272894a91b7261f46aba3c070474b4ff6067a3" exitCode=0
Jul 15 16:05:17.185904 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:05:17.185543    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5299c21f-zh25s" event={"ID":"8510e52c-1260-4794-bc59-ac69f9bd78d7","Type":"ContainerDied","Data":"0f9adb78169c90ffb14a353431272894a91b7261f46aba3c070474b4ff6067a3"}
Jul 15 16:05:17.185904 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:05:17.185604    2588 scope.go:117] "RemoveContainer" containerID="80ea3f8962f72c900bca9c9584c36cdf9a829cae6ed95beff4901ba93aff5099"
Jul 15 16:05:17.212193 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:05:17.212167    2588 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5299c21f-zh25s"]
Jul 15 16:05:18.322473 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:05:18.322450    2588 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5299c21f-zh25s"
Jul 15 16:05:18.380165 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:05:18.380136    2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8510e52c-1260-4794-bc59-ac69f9bd78d7-maas-api-service-ca\") pod \"8510e52c-1260-4794-bc59-ac69f9bd78d7\" (UID: \"8510e52c-1260-4794-bc59-ac69f9bd78d7\") "
Jul 15 16:05:18.380507 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:05:18.380487    2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8510e52c-1260-4794-bc59-ac69f9bd78d7-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "8510e52c-1260-4794-bc59-ac69f9bd78d7" (UID: "8510e52c-1260-4794-bc59-ac69f9bd78d7"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 16:05:18.481016 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:05:18.480944    2588 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8510e52c-1260-4794-bc59-ac69f9bd78d7-maas-api-service-ca\") on node \"ip-10-0-140-212.ec2.internal\" DevicePath \"\""
Jul 15 16:05:19.200056 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:05:19.199982    2588 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5299c21f-zh25s"
Jul 15 16:05:19.200189 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:05:19.199976    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5299c21f-zh25s" event={"ID":"8510e52c-1260-4794-bc59-ac69f9bd78d7","Type":"ContainerDied","Data":"9cce27921fd8eca826fc716cab07effef9bf71f1b6c19fd6fd47a88827b18631"}
Jul 15 16:05:19.200189 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:05:19.200106    2588 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9cce27921fd8eca826fc716cab07effef9bf71f1b6c19fd6fd47a88827b18631"
Jul 15 16:05:19.236502 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:05:19.236473    2588 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5299c21f-zh25s"]
Jul 15 16:05:19.240399 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:05:19.240376    2588 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5299c21f-zh25s"]
Jul 15 16:05:20.909880 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:05:20.909848    2588 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8510e52c-1260-4794-bc59-ac69f9bd78d7" path="/var/lib/kubelet/pods/8510e52c-1260-4794-bc59-ac69f9bd78d7/volumes"
Jul 15 16:05:49.591040 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:05:49.591005    2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5299c21f-9dx6w"]
Jul 15 16:05:49.591507 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:05:49.591361    2588 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8510e52c-1260-4794-bc59-ac69f9bd78d7" containerName="revoke-keys"
Jul 15 16:05:49.591507 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:05:49.591378    2588 state_mem.go:107] "Deleted CPUSet assignment" podUID="8510e52c-1260-4794-bc59-ac69f9bd78d7" containerName="revoke-keys"
Jul 15 16:05:49.591507 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:05:49.591407    2588 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8510e52c-1260-4794-bc59-ac69f9bd78d7" containerName="revoke-keys"
Jul 15 16:05:49.591507 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:05:49.591412    2588 state_mem.go:107] "Deleted CPUSet assignment" podUID="8510e52c-1260-4794-bc59-ac69f9bd78d7" containerName="revoke-keys"
Jul 15 16:05:49.591507 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:05:49.591473    2588 memory_manager.go:368] "RemoveStaleState removing state" podUID="8510e52c-1260-4794-bc59-ac69f9bd78d7" containerName="revoke-keys"
Jul 15 16:05:49.591507 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:05:49.591487    2588 memory_manager.go:368] "RemoveStaleState removing state" podUID="8510e52c-1260-4794-bc59-ac69f9bd78d7" containerName="revoke-keys"
Jul 15 16:05:49.594587 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:05:49.594568    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5299c21f-9dx6w"
Jul 15 16:05:49.597904 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:05:49.597887    2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 15 16:05:49.598043 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:05:49.597982    2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-f55c8\""
Jul 15 16:05:49.604467 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:05:49.604441    2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5299c21f-9dx6w"]
Jul 15 16:05:49.745712 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:05:49.745681    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d551df01-6d25-4359-b882-dc083b8df76d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-5299c21f-9dx6w\" (UID: \"d551df01-6d25-4359-b882-dc083b8df76d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5299c21f-9dx6w"
Jul 15 16:05:49.847107 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:05:49.847036    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d551df01-6d25-4359-b882-dc083b8df76d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-5299c21f-9dx6w\" (UID: \"d551df01-6d25-4359-b882-dc083b8df76d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5299c21f-9dx6w"
Jul 15 16:05:49.847686 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:05:49.847666    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d551df01-6d25-4359-b882-dc083b8df76d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-5299c21f-9dx6w\" (UID: \"d551df01-6d25-4359-b882-dc083b8df76d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5299c21f-9dx6w"
Jul 15 16:05:49.906704 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:05:49.906682    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5299c21f-9dx6w"
Jul 15 16:05:50.044203 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:05:50.044171    2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5299c21f-9dx6w"]
Jul 15 16:05:50.045736 ip-10-0-140-212 kubenswrapper[2588]: W0715 16:05:50.045710    2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd551df01_6d25_4359_b882_dc083b8df76d.slice/crio-36473aba4ebcb3614debd97bf99c5947f0fd2c9f893643adcbe63855d98c47ee WatchSource:0}: Error finding container 36473aba4ebcb3614debd97bf99c5947f0fd2c9f893643adcbe63855d98c47ee: Status 404 returned error can't find the container with id 36473aba4ebcb3614debd97bf99c5947f0fd2c9f893643adcbe63855d98c47ee
Jul 15 16:05:50.375379 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:05:50.375316    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5299c21f-9dx6w" event={"ID":"d551df01-6d25-4359-b882-dc083b8df76d","Type":"ContainerStarted","Data":"f0e7007e647b52c50530a74d773341a808a5e653427947cd3cabe773778252a5"}
Jul 15 16:05:50.375536 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:05:50.375406    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5299c21f-9dx6w" event={"ID":"d551df01-6d25-4359-b882-dc083b8df76d","Type":"ContainerStarted","Data":"36473aba4ebcb3614debd97bf99c5947f0fd2c9f893643adcbe63855d98c47ee"}
Jul 15 16:05:50.393165 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:05:50.393109    2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5299c21f-9dx6w" podStartSLOduration=1.393093811 podStartE2EDuration="1.393093811s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 16:05:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:05:50.392092823 +0000 UTC m=+1836.044158612" watchObservedRunningTime="2026-07-15 16:05:50.393093811 +0000 UTC m=+1836.045159571"
Jul 15 16:05:51.382426 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:05:51.382392    2588 generic.go:356] "Generic (PLEG): container finished" podID="d551df01-6d25-4359-b882-dc083b8df76d" containerID="f0e7007e647b52c50530a74d773341a808a5e653427947cd3cabe773778252a5" exitCode=0
Jul 15 16:05:51.382803 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:05:51.382481    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5299c21f-9dx6w" event={"ID":"d551df01-6d25-4359-b882-dc083b8df76d","Type":"ContainerDied","Data":"f0e7007e647b52c50530a74d773341a808a5e653427947cd3cabe773778252a5"}
Jul 15 16:05:52.512825 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:05:52.512797    2588 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5299c21f-9dx6w"
Jul 15 16:05:52.569601 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:05:52.569566    2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d551df01-6d25-4359-b882-dc083b8df76d-maas-api-service-ca\") pod \"d551df01-6d25-4359-b882-dc083b8df76d\" (UID: \"d551df01-6d25-4359-b882-dc083b8df76d\") "
Jul 15 16:05:52.569907 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:05:52.569886    2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d551df01-6d25-4359-b882-dc083b8df76d-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "d551df01-6d25-4359-b882-dc083b8df76d" (UID: "d551df01-6d25-4359-b882-dc083b8df76d"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 16:05:52.670688 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:05:52.670621    2588 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d551df01-6d25-4359-b882-dc083b8df76d-maas-api-service-ca\") on node \"ip-10-0-140-212.ec2.internal\" DevicePath \"\""
Jul 15 16:05:53.394681 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:05:53.394649    2588 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5299c21f-9dx6w"
Jul 15 16:05:53.394858 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:05:53.394654    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5299c21f-9dx6w" event={"ID":"d551df01-6d25-4359-b882-dc083b8df76d","Type":"ContainerDied","Data":"36473aba4ebcb3614debd97bf99c5947f0fd2c9f893643adcbe63855d98c47ee"}
Jul 15 16:05:53.394858 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:05:53.394789    2588 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="36473aba4ebcb3614debd97bf99c5947f0fd2c9f893643adcbe63855d98c47ee"
Jul 15 16:07:15.004995 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:07:15.004965    2588 scope.go:117] "RemoveContainer" containerID="9b9ba50bc9d3ab192d7f9fd872455d836160b41a5efe9118e5d0e36b9b89d076"
Jul 15 16:08:09.630993 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:08:09.630908    2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b2c9c91f-xd7lx"]
Jul 15 16:08:09.631474 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:08:09.631248    2588 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8510e52c-1260-4794-bc59-ac69f9bd78d7" containerName="revoke-keys"
Jul 15 16:08:09.631474 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:08:09.631259    2588 state_mem.go:107] "Deleted CPUSet assignment" podUID="8510e52c-1260-4794-bc59-ac69f9bd78d7" containerName="revoke-keys"
Jul 15 16:08:09.631474 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:08:09.631267    2588 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d551df01-6d25-4359-b882-dc083b8df76d" containerName="revoke-keys"
Jul 15 16:08:09.631474 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:08:09.631273    2588 state_mem.go:107] "Deleted CPUSet assignment" podUID="d551df01-6d25-4359-b882-dc083b8df76d" containerName="revoke-keys"
Jul 15 16:08:09.631474 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:08:09.631366    2588 memory_manager.go:368] "RemoveStaleState removing state" podUID="d551df01-6d25-4359-b882-dc083b8df76d" containerName="revoke-keys"
Jul 15 16:08:09.631474 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:08:09.631378    2588 memory_manager.go:368] "RemoveStaleState removing state" podUID="8510e52c-1260-4794-bc59-ac69f9bd78d7" containerName="revoke-keys"
Jul 15 16:08:09.634450 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:08:09.634431    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b2c9c91f-xd7lx"
Jul 15 16:08:09.637838 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:08:09.637814    2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-f55c8\""
Jul 15 16:08:09.638394 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:08:09.638378    2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 15 16:08:09.644207 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:08:09.644180    2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b2c9c91f-xd7lx"]
Jul 15 16:08:09.731712 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:08:09.731662    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a68c2c3a-591c-4956-bb93-a1916865a072-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-b2c9c91f-xd7lx\" (UID: \"a68c2c3a-591c-4956-bb93-a1916865a072\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b2c9c91f-xd7lx"
Jul 15 16:08:09.832551 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:08:09.832504    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a68c2c3a-591c-4956-bb93-a1916865a072-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-b2c9c91f-xd7lx\" (UID: \"a68c2c3a-591c-4956-bb93-a1916865a072\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b2c9c91f-xd7lx"
Jul 15 16:08:09.833213 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:08:09.833189    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a68c2c3a-591c-4956-bb93-a1916865a072-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-b2c9c91f-xd7lx\" (UID: \"a68c2c3a-591c-4956-bb93-a1916865a072\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b2c9c91f-xd7lx"
Jul 15 16:08:09.946355 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:08:09.946257    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b2c9c91f-xd7lx"
Jul 15 16:08:10.097405 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:08:10.097379    2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b2c9c91f-xd7lx"]
Jul 15 16:08:10.099150 ip-10-0-140-212 kubenswrapper[2588]: W0715 16:08:10.099122    2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda68c2c3a_591c_4956_bb93_a1916865a072.slice/crio-14adb15fe015fd0cc24542fe6183519f0f19e0e23dbf55d5e08c8af4923c7df1 WatchSource:0}: Error finding container 14adb15fe015fd0cc24542fe6183519f0f19e0e23dbf55d5e08c8af4923c7df1: Status 404 returned error can't find the container with id 14adb15fe015fd0cc24542fe6183519f0f19e0e23dbf55d5e08c8af4923c7df1
Jul 15 16:08:10.160456 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:08:10.160422    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b2c9c91f-xd7lx" event={"ID":"a68c2c3a-591c-4956-bb93-a1916865a072","Type":"ContainerStarted","Data":"14adb15fe015fd0cc24542fe6183519f0f19e0e23dbf55d5e08c8af4923c7df1"}
Jul 15 16:08:11.167051 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:08:11.167015    2588 generic.go:356] "Generic (PLEG): container finished" podID="a68c2c3a-591c-4956-bb93-a1916865a072" containerID="4db8c28e43db946cf76eb2f2e42f82ce57cecab9c5d80918f9ebb26e574cc254" exitCode=0
Jul 15 16:08:11.167460 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:08:11.167098    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b2c9c91f-xd7lx" event={"ID":"a68c2c3a-591c-4956-bb93-a1916865a072","Type":"ContainerDied","Data":"4db8c28e43db946cf76eb2f2e42f82ce57cecab9c5d80918f9ebb26e574cc254"}
Jul 15 16:08:12.300458 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:08:12.300433    2588 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b2c9c91f-xd7lx"
Jul 15 16:08:12.355218 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:08:12.355186    2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a68c2c3a-591c-4956-bb93-a1916865a072-maas-api-service-ca\") pod \"a68c2c3a-591c-4956-bb93-a1916865a072\" (UID: \"a68c2c3a-591c-4956-bb93-a1916865a072\") "
Jul 15 16:08:12.355582 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:08:12.355558    2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a68c2c3a-591c-4956-bb93-a1916865a072-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "a68c2c3a-591c-4956-bb93-a1916865a072" (UID: "a68c2c3a-591c-4956-bb93-a1916865a072"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 16:08:12.456706 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:08:12.456611    2588 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a68c2c3a-591c-4956-bb93-a1916865a072-maas-api-service-ca\") on node \"ip-10-0-140-212.ec2.internal\" DevicePath \"\""
Jul 15 16:08:13.179513 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:08:13.179438    2588 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b2c9c91f-xd7lx"
Jul 15 16:08:13.179513 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:08:13.179487    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b2c9c91f-xd7lx" event={"ID":"a68c2c3a-591c-4956-bb93-a1916865a072","Type":"ContainerDied","Data":"14adb15fe015fd0cc24542fe6183519f0f19e0e23dbf55d5e08c8af4923c7df1"}
Jul 15 16:08:13.179690 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:08:13.179539    2588 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="14adb15fe015fd0cc24542fe6183519f0f19e0e23dbf55d5e08c8af4923c7df1"
Jul 15 16:09:15.034461 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:09:15.034428    2588 scope.go:117] "RemoveContainer" containerID="afd5d7014a72cb20d3c9a0d76798af2381c6b21a48302bdd4ae8a8b196eae435"
Jul 15 16:09:57.094594 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:09:57.094516    2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b9b40333-zmkr4"]
Jul 15 16:09:57.095066 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:09:57.094850    2588 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a68c2c3a-591c-4956-bb93-a1916865a072" containerName="revoke-keys"
Jul 15 16:09:57.095066 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:09:57.094861    2588 state_mem.go:107] "Deleted CPUSet assignment" podUID="a68c2c3a-591c-4956-bb93-a1916865a072" containerName="revoke-keys"
Jul 15 16:09:57.095066 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:09:57.094948    2588 memory_manager.go:368] "RemoveStaleState removing state" podUID="a68c2c3a-591c-4956-bb93-a1916865a072" containerName="revoke-keys"
Jul 15 16:09:57.098018 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:09:57.098002    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b9b40333-zmkr4"
Jul 15 16:09:57.100865 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:09:57.100843    2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-f55c8\""
Jul 15 16:09:57.101003 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:09:57.100966    2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 15 16:09:57.107260 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:09:57.107235    2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b9b40333-zmkr4"]
Jul 15 16:09:57.109054 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:09:57.109027    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cbbceedd-8624-441a-a228-e237f177865d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-b9b40333-zmkr4\" (UID: \"cbbceedd-8624-441a-a228-e237f177865d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b9b40333-zmkr4"
Jul 15 16:09:57.209484 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:09:57.209459    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cbbceedd-8624-441a-a228-e237f177865d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-b9b40333-zmkr4\" (UID: \"cbbceedd-8624-441a-a228-e237f177865d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b9b40333-zmkr4"
Jul 15 16:09:57.210003 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:09:57.209984    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cbbceedd-8624-441a-a228-e237f177865d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-b9b40333-zmkr4\" (UID: \"cbbceedd-8624-441a-a228-e237f177865d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b9b40333-zmkr4"
Jul 15 16:09:57.409867 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:09:57.409800    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b9b40333-zmkr4"
Jul 15 16:09:57.545277 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:09:57.545235    2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b9b40333-zmkr4"]
Jul 15 16:09:57.546627 ip-10-0-140-212 kubenswrapper[2588]: W0715 16:09:57.546600    2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcbbceedd_8624_441a_a228_e237f177865d.slice/crio-474d0f51b09657da2d7a2cbaae93f8eaeb550382db9bfdc4a928cbceffb220e9 WatchSource:0}: Error finding container 474d0f51b09657da2d7a2cbaae93f8eaeb550382db9bfdc4a928cbceffb220e9: Status 404 returned error can't find the container with id 474d0f51b09657da2d7a2cbaae93f8eaeb550382db9bfdc4a928cbceffb220e9
Jul 15 16:09:57.751296 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:09:57.751215    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b9b40333-zmkr4" event={"ID":"cbbceedd-8624-441a-a228-e237f177865d","Type":"ContainerStarted","Data":"474d0f51b09657da2d7a2cbaae93f8eaeb550382db9bfdc4a928cbceffb220e9"}
Jul 15 16:09:58.758318 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:09:58.758284    2588 generic.go:356] "Generic (PLEG): container finished" podID="cbbceedd-8624-441a-a228-e237f177865d" containerID="4a7ba1e50babd2c879290dc5e667a1203ed4cb8b47ac2ebd546b5ffa263301c0" exitCode=0
Jul 15 16:09:58.758760 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:09:58.758350    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b9b40333-zmkr4" event={"ID":"cbbceedd-8624-441a-a228-e237f177865d","Type":"ContainerDied","Data":"4a7ba1e50babd2c879290dc5e667a1203ed4cb8b47ac2ebd546b5ffa263301c0"}
Jul 15 16:09:59.896020 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:09:59.895998    2588 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b9b40333-zmkr4"
Jul 15 16:09:59.931235 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:09:59.931204    2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cbbceedd-8624-441a-a228-e237f177865d-maas-api-service-ca\") pod \"cbbceedd-8624-441a-a228-e237f177865d\" (UID: \"cbbceedd-8624-441a-a228-e237f177865d\") "
Jul 15 16:09:59.931530 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:09:59.931508    2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cbbceedd-8624-441a-a228-e237f177865d-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "cbbceedd-8624-441a-a228-e237f177865d" (UID: "cbbceedd-8624-441a-a228-e237f177865d"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 16:10:00.032215 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:10:00.032161    2588 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cbbceedd-8624-441a-a228-e237f177865d-maas-api-service-ca\") on node \"ip-10-0-140-212.ec2.internal\" DevicePath \"\""
Jul 15 16:10:00.770585 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:10:00.770556    2588 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b9b40333-zmkr4"
Jul 15 16:10:00.772776 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:10:00.770597    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b9b40333-zmkr4" event={"ID":"cbbceedd-8624-441a-a228-e237f177865d","Type":"ContainerDied","Data":"474d0f51b09657da2d7a2cbaae93f8eaeb550382db9bfdc4a928cbceffb220e9"}
Jul 15 16:10:00.772776 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:10:00.770643    2588 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="474d0f51b09657da2d7a2cbaae93f8eaeb550382db9bfdc4a928cbceffb220e9"
Jul 15 16:10:14.965600 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:10:14.965573    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-5f7f494dd4-lbdlp_c80ed5cd-4b7c-4981-95c6-a02cf058f709/cluster-monitoring-operator/0.log"
Jul 15 16:10:14.970385 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:10:14.970364    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-5f7f494dd4-lbdlp_c80ed5cd-4b7c-4981-95c6-a02cf058f709/cluster-monitoring-operator/0.log"
Jul 15 16:10:14.971044 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:10:14.971024    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-qcvqk_eb866034-d7d1-4bee-b8b7-616b355d371d/console-operator/1.log"
Jul 15 16:10:14.973062 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:10:14.973043    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dthn7_ec82e02f-7632-41be-8e7d-8c9d59c569b6/ovn-acl-logging/0.log"
Jul 15 16:10:14.975744 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:10:14.975728    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-qcvqk_eb866034-d7d1-4bee-b8b7-616b355d371d/console-operator/1.log"
Jul 15 16:10:14.978316 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:10:14.978300    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dthn7_ec82e02f-7632-41be-8e7d-8c9d59c569b6/ovn-acl-logging/0.log"
Jul 15 16:10:15.055362 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:10:15.055320    2588 scope.go:117] "RemoveContainer" containerID="bab4a86050e5275857e492cc91a874b5afa97d2739298114ff0b9b27daef6f5c"
Jul 15 16:12:15.084516 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:12:15.084472    2588 scope.go:117] "RemoveContainer" containerID="0f9adb78169c90ffb14a353431272894a91b7261f46aba3c070474b4ff6067a3"
Jul 15 16:12:50.000077 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:12:49.999868    2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-a84db0/test-model-a84db0-kserve-6fd5fd76dc-gv2mg"]
Jul 15 16:12:50.000814 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:12:50.000702    2588 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cbbceedd-8624-441a-a228-e237f177865d" containerName="revoke-keys"
Jul 15 16:12:50.000814 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:12:50.000722    2588 state_mem.go:107] "Deleted CPUSet assignment" podUID="cbbceedd-8624-441a-a228-e237f177865d" containerName="revoke-keys"
Jul 15 16:12:50.000935 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:12:50.000899    2588 memory_manager.go:368] "RemoveStaleState removing state" podUID="cbbceedd-8624-441a-a228-e237f177865d" containerName="revoke-keys"
Jul 15 16:12:50.004958 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:12:50.004924    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-a84db0/test-model-a84db0-kserve-6fd5fd76dc-gv2mg"
Jul 15 16:12:50.008424 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:12:50.008365    2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-a84db0\"/\"openshift-service-ca.crt\""
Jul 15 16:12:50.009755 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:12:50.009735    2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-a84db0\"/\"kube-root-ca.crt\""
Jul 15 16:12:50.010029 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:12:50.009783    2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-a84db0\"/\"test-model-a84db0-kserve-self-signed-certs\""
Jul 15 16:12:50.010321 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:12:50.009783    2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-a84db0\"/\"default-dockercfg-424gz\""
Jul 15 16:12:50.013610 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:12:50.013591    2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-a84db0/test-model-a84db0-kserve-6fd5fd76dc-gv2mg"]
Jul 15 16:12:50.069797 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:12:50.069766    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/343e8043-67c2-4563-888f-2734a0bc3844-tmp-dir\") pod \"test-model-a84db0-kserve-6fd5fd76dc-gv2mg\" (UID: \"343e8043-67c2-4563-888f-2734a0bc3844\") " pod="ai-tenant-e2e-inf-b-a84db0/test-model-a84db0-kserve-6fd5fd76dc-gv2mg"
Jul 15 16:12:50.069933 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:12:50.069805    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/343e8043-67c2-4563-888f-2734a0bc3844-tls-certs\") pod \"test-model-a84db0-kserve-6fd5fd76dc-gv2mg\" (UID: \"343e8043-67c2-4563-888f-2734a0bc3844\") " pod="ai-tenant-e2e-inf-b-a84db0/test-model-a84db0-kserve-6fd5fd76dc-gv2mg"
Jul 15 16:12:50.069933 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:12:50.069841    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/343e8043-67c2-4563-888f-2734a0bc3844-home\") pod \"test-model-a84db0-kserve-6fd5fd76dc-gv2mg\" (UID: \"343e8043-67c2-4563-888f-2734a0bc3844\") " pod="ai-tenant-e2e-inf-b-a84db0/test-model-a84db0-kserve-6fd5fd76dc-gv2mg"
Jul 15 16:12:50.069933 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:12:50.069861    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/343e8043-67c2-4563-888f-2734a0bc3844-dshm\") pod \"test-model-a84db0-kserve-6fd5fd76dc-gv2mg\" (UID: \"343e8043-67c2-4563-888f-2734a0bc3844\") " pod="ai-tenant-e2e-inf-b-a84db0/test-model-a84db0-kserve-6fd5fd76dc-gv2mg"
Jul 15 16:12:50.069933 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:12:50.069882    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g2clm\" (UniqueName: \"kubernetes.io/projected/343e8043-67c2-4563-888f-2734a0bc3844-kube-api-access-g2clm\") pod \"test-model-a84db0-kserve-6fd5fd76dc-gv2mg\" (UID: \"343e8043-67c2-4563-888f-2734a0bc3844\") " pod="ai-tenant-e2e-inf-b-a84db0/test-model-a84db0-kserve-6fd5fd76dc-gv2mg"
Jul 15 16:12:50.069933 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:12:50.069907    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/343e8043-67c2-4563-888f-2734a0bc3844-model-cache\") pod \"test-model-a84db0-kserve-6fd5fd76dc-gv2mg\" (UID: \"343e8043-67c2-4563-888f-2734a0bc3844\") " pod="ai-tenant-e2e-inf-b-a84db0/test-model-a84db0-kserve-6fd5fd76dc-gv2mg"
Jul 15 16:12:50.171266 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:12:50.171229    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/343e8043-67c2-4563-888f-2734a0bc3844-tmp-dir\") pod \"test-model-a84db0-kserve-6fd5fd76dc-gv2mg\" (UID: \"343e8043-67c2-4563-888f-2734a0bc3844\") " pod="ai-tenant-e2e-inf-b-a84db0/test-model-a84db0-kserve-6fd5fd76dc-gv2mg"
Jul 15 16:12:50.171266 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:12:50.171269    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/343e8043-67c2-4563-888f-2734a0bc3844-tls-certs\") pod \"test-model-a84db0-kserve-6fd5fd76dc-gv2mg\" (UID: \"343e8043-67c2-4563-888f-2734a0bc3844\") " pod="ai-tenant-e2e-inf-b-a84db0/test-model-a84db0-kserve-6fd5fd76dc-gv2mg"
Jul 15 16:12:50.171523 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:12:50.171294    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/343e8043-67c2-4563-888f-2734a0bc3844-home\") pod \"test-model-a84db0-kserve-6fd5fd76dc-gv2mg\" (UID: \"343e8043-67c2-4563-888f-2734a0bc3844\") " pod="ai-tenant-e2e-inf-b-a84db0/test-model-a84db0-kserve-6fd5fd76dc-gv2mg"
Jul 15 16:12:50.171523 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:12:50.171320    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/343e8043-67c2-4563-888f-2734a0bc3844-dshm\") pod \"test-model-a84db0-kserve-6fd5fd76dc-gv2mg\" (UID: \"343e8043-67c2-4563-888f-2734a0bc3844\") " pod="ai-tenant-e2e-inf-b-a84db0/test-model-a84db0-kserve-6fd5fd76dc-gv2mg"
Jul 15 16:12:50.171523 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:12:50.171360    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g2clm\" (UniqueName: \"kubernetes.io/projected/343e8043-67c2-4563-888f-2734a0bc3844-kube-api-access-g2clm\") pod \"test-model-a84db0-kserve-6fd5fd76dc-gv2mg\" (UID: \"343e8043-67c2-4563-888f-2734a0bc3844\") " pod="ai-tenant-e2e-inf-b-a84db0/test-model-a84db0-kserve-6fd5fd76dc-gv2mg"
Jul 15 16:12:50.171523 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:12:50.171391    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/343e8043-67c2-4563-888f-2734a0bc3844-model-cache\") pod \"test-model-a84db0-kserve-6fd5fd76dc-gv2mg\" (UID: \"343e8043-67c2-4563-888f-2734a0bc3844\") " pod="ai-tenant-e2e-inf-b-a84db0/test-model-a84db0-kserve-6fd5fd76dc-gv2mg"
Jul 15 16:12:50.171746 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:12:50.171634    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/343e8043-67c2-4563-888f-2734a0bc3844-home\") pod \"test-model-a84db0-kserve-6fd5fd76dc-gv2mg\" (UID: \"343e8043-67c2-4563-888f-2734a0bc3844\") " pod="ai-tenant-e2e-inf-b-a84db0/test-model-a84db0-kserve-6fd5fd76dc-gv2mg"
Jul 15 16:12:50.171746 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:12:50.171714    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/343e8043-67c2-4563-888f-2734a0bc3844-tmp-dir\") pod \"test-model-a84db0-kserve-6fd5fd76dc-gv2mg\" (UID: \"343e8043-67c2-4563-888f-2734a0bc3844\") " pod="ai-tenant-e2e-inf-b-a84db0/test-model-a84db0-kserve-6fd5fd76dc-gv2mg"
Jul 15 16:12:50.171833 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:12:50.171791    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/343e8043-67c2-4563-888f-2734a0bc3844-model-cache\") pod \"test-model-a84db0-kserve-6fd5fd76dc-gv2mg\" (UID: \"343e8043-67c2-4563-888f-2734a0bc3844\") " pod="ai-tenant-e2e-inf-b-a84db0/test-model-a84db0-kserve-6fd5fd76dc-gv2mg"
Jul 15 16:12:50.173571 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:12:50.173549    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/343e8043-67c2-4563-888f-2734a0bc3844-dshm\") pod \"test-model-a84db0-kserve-6fd5fd76dc-gv2mg\" (UID: \"343e8043-67c2-4563-888f-2734a0bc3844\") " pod="ai-tenant-e2e-inf-b-a84db0/test-model-a84db0-kserve-6fd5fd76dc-gv2mg"
Jul 15 16:12:50.173816 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:12:50.173797    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/343e8043-67c2-4563-888f-2734a0bc3844-tls-certs\") pod \"test-model-a84db0-kserve-6fd5fd76dc-gv2mg\" (UID: \"343e8043-67c2-4563-888f-2734a0bc3844\") " pod="ai-tenant-e2e-inf-b-a84db0/test-model-a84db0-kserve-6fd5fd76dc-gv2mg"
Jul 15 16:12:50.180794 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:12:50.180773    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g2clm\" (UniqueName: \"kubernetes.io/projected/343e8043-67c2-4563-888f-2734a0bc3844-kube-api-access-g2clm\") pod \"test-model-a84db0-kserve-6fd5fd76dc-gv2mg\" (UID: \"343e8043-67c2-4563-888f-2734a0bc3844\") " pod="ai-tenant-e2e-inf-b-a84db0/test-model-a84db0-kserve-6fd5fd76dc-gv2mg"
Jul 15 16:12:50.315395 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:12:50.315313    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-a84db0/test-model-a84db0-kserve-6fd5fd76dc-gv2mg"
Jul 15 16:12:50.450445 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:12:50.450418    2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-a84db0/test-model-a84db0-kserve-6fd5fd76dc-gv2mg"]
Jul 15 16:12:50.452297 ip-10-0-140-212 kubenswrapper[2588]: W0715 16:12:50.452273    2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod343e8043_67c2_4563_888f_2734a0bc3844.slice/crio-0d2662cfebdf1fb7daa1c9d9820c108cce6c046604e484dfcdcd05acf9df6160 WatchSource:0}: Error finding container 0d2662cfebdf1fb7daa1c9d9820c108cce6c046604e484dfcdcd05acf9df6160: Status 404 returned error can't find the container with id 0d2662cfebdf1fb7daa1c9d9820c108cce6c046604e484dfcdcd05acf9df6160
Jul 15 16:12:50.697957 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:12:50.697919    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-a84db0/test-model-a84db0-kserve-6fd5fd76dc-gv2mg" event={"ID":"343e8043-67c2-4563-888f-2734a0bc3844","Type":"ContainerStarted","Data":"50801d4a361c5ec696d5a7f7595cc951c8a6a0b8dbb6fc58872471415ce40466"}
Jul 15 16:12:50.697957 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:12:50.697961    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-a84db0/test-model-a84db0-kserve-6fd5fd76dc-gv2mg" event={"ID":"343e8043-67c2-4563-888f-2734a0bc3844","Type":"ContainerStarted","Data":"0d2662cfebdf1fb7daa1c9d9820c108cce6c046604e484dfcdcd05acf9df6160"}
Jul 15 16:12:50.718159 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:12:50.718098    2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-a84db0/test-model-a84db0-kserve-6fd5fd76dc-gv2mg" podStartSLOduration=1.718078862 podStartE2EDuration="1.718078862s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 16:12:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:12:50.717499085 +0000 UTC m=+2256.369564863" watchObservedRunningTime="2026-07-15 16:12:50.718078862 +0000 UTC m=+2256.370144628"
Jul 15 16:13:00.316519 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:13:00.316465    2588 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-a84db0/test-model-a84db0-kserve-6fd5fd76dc-gv2mg"
Jul 15 16:13:00.317032 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:13:00.316538    2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-a84db0/test-model-a84db0-kserve-6fd5fd76dc-gv2mg"
Jul 15 16:13:00.328927 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:13:00.328906    2588 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-a84db0/test-model-a84db0-kserve-6fd5fd76dc-gv2mg"
Jul 15 16:13:00.769270 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:13:00.769238    2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-a84db0/test-model-a84db0-kserve-6fd5fd76dc-gv2mg"
Jul 15 16:13:20.743473 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:13:20.743434    2588 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-a84db0/test-model-a84db0-kserve-6fd5fd76dc-gv2mg"]
Jul 15 16:13:20.881423 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:13:20.881390    2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-24e47f-jx8mf"]
Jul 15 16:13:20.884840 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:13:20.884822    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-24e47f-jx8mf"
Jul 15 16:13:20.887793 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:13:20.887769    2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 15 16:13:20.887793 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:13:20.887782    2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-f55c8\""
Jul 15 16:13:20.896246 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:13:20.896222    2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-24e47f-jx8mf"]
Jul 15 16:13:21.024399 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:13:21.024317    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8338efe2-ebe8-43ce-a878-64beea02ea7f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-24e47f-jx8mf\" (UID: \"8338efe2-ebe8-43ce-a878-64beea02ea7f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-24e47f-jx8mf"
Jul 15 16:13:21.125296 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:13:21.125261    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8338efe2-ebe8-43ce-a878-64beea02ea7f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-24e47f-jx8mf\" (UID: \"8338efe2-ebe8-43ce-a878-64beea02ea7f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-24e47f-jx8mf"
Jul 15 16:13:21.125861 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:13:21.125841    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8338efe2-ebe8-43ce-a878-64beea02ea7f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-24e47f-jx8mf\" (UID: \"8338efe2-ebe8-43ce-a878-64beea02ea7f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-24e47f-jx8mf"
Jul 15 16:13:21.197465 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:13:21.197435    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-24e47f-jx8mf"
Jul 15 16:13:21.328613 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:13:21.328582    2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-24e47f-jx8mf"]
Jul 15 16:13:21.329833 ip-10-0-140-212 kubenswrapper[2588]: W0715 16:13:21.329808    2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8338efe2_ebe8_43ce_a878_64beea02ea7f.slice/crio-48d25adb9a0feea33d3324b6d261210c815ba5cb80b9844138e36f0a793fb1f2 WatchSource:0}: Error finding container 48d25adb9a0feea33d3324b6d261210c815ba5cb80b9844138e36f0a793fb1f2: Status 404 returned error can't find the container with id 48d25adb9a0feea33d3324b6d261210c815ba5cb80b9844138e36f0a793fb1f2
Jul 15 16:13:21.885803 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:13:21.885714    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-24e47f-jx8mf" event={"ID":"8338efe2-ebe8-43ce-a878-64beea02ea7f","Type":"ContainerStarted","Data":"8c3ad9051e4abcd4b4c1f797c680c5d2d13086f6d7732c9e03686ae21abf9988"}
Jul 15 16:13:21.885803 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:13:21.885783    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-24e47f-jx8mf" event={"ID":"8338efe2-ebe8-43ce-a878-64beea02ea7f","Type":"ContainerStarted","Data":"48d25adb9a0feea33d3324b6d261210c815ba5cb80b9844138e36f0a793fb1f2"}
Jul 15 16:13:21.906797 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:13:21.906753    2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-24e47f-jx8mf" podStartSLOduration=1.906739348 podStartE2EDuration="1.906739348s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 16:13:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:13:21.904021469 +0000 UTC m=+2287.556087241" watchObservedRunningTime="2026-07-15 16:13:21.906739348 +0000 UTC m=+2287.558805156"
Jul 15 16:13:22.893070 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:13:22.893034    2588 generic.go:356] "Generic (PLEG): container finished" podID="8338efe2-ebe8-43ce-a878-64beea02ea7f" containerID="8c3ad9051e4abcd4b4c1f797c680c5d2d13086f6d7732c9e03686ae21abf9988" exitCode=0
Jul 15 16:13:22.893465 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:13:22.893123    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-24e47f-jx8mf" event={"ID":"8338efe2-ebe8-43ce-a878-64beea02ea7f","Type":"ContainerDied","Data":"8c3ad9051e4abcd4b4c1f797c680c5d2d13086f6d7732c9e03686ae21abf9988"}
Jul 15 16:13:24.039598 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:13:24.039570    2588 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-24e47f-jx8mf"
Jul 15 16:13:24.149326 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:13:24.149243    2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8338efe2-ebe8-43ce-a878-64beea02ea7f-maas-api-service-ca\") pod \"8338efe2-ebe8-43ce-a878-64beea02ea7f\" (UID: \"8338efe2-ebe8-43ce-a878-64beea02ea7f\") "
Jul 15 16:13:24.149625 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:13:24.149601    2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8338efe2-ebe8-43ce-a878-64beea02ea7f-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "8338efe2-ebe8-43ce-a878-64beea02ea7f" (UID: "8338efe2-ebe8-43ce-a878-64beea02ea7f"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 16:13:24.250292 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:13:24.250258    2588 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8338efe2-ebe8-43ce-a878-64beea02ea7f-maas-api-service-ca\") on node \"ip-10-0-140-212.ec2.internal\" DevicePath \"\""
Jul 15 16:13:24.907625 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:13:24.907594    2588 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-24e47f-jx8mf"
Jul 15 16:13:24.910527 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:13:24.910495    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-24e47f-jx8mf" event={"ID":"8338efe2-ebe8-43ce-a878-64beea02ea7f","Type":"ContainerDied","Data":"48d25adb9a0feea33d3324b6d261210c815ba5cb80b9844138e36f0a793fb1f2"}
Jul 15 16:13:24.910684 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:13:24.910541    2588 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="48d25adb9a0feea33d3324b6d261210c815ba5cb80b9844138e36f0a793fb1f2"
Jul 15 16:13:35.763740 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:13:35.763690    2588 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-a84db0/test-model-a84db0-kserve-6fd5fd76dc-gv2mg" podUID="343e8043-67c2-4563-888f-2734a0bc3844" containerName="main" containerID="cri-o://50801d4a361c5ec696d5a7f7595cc951c8a6a0b8dbb6fc58872471415ce40466" gracePeriod=45
Jul 15 16:13:35.964519 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:13:35.964488    2588 generic.go:356] "Generic (PLEG): container finished" podID="343e8043-67c2-4563-888f-2734a0bc3844" containerID="50801d4a361c5ec696d5a7f7595cc951c8a6a0b8dbb6fc58872471415ce40466" exitCode=0
Jul 15 16:13:35.964666 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:13:35.964567    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-a84db0/test-model-a84db0-kserve-6fd5fd76dc-gv2mg" event={"ID":"343e8043-67c2-4563-888f-2734a0bc3844","Type":"ContainerDied","Data":"50801d4a361c5ec696d5a7f7595cc951c8a6a0b8dbb6fc58872471415ce40466"}
Jul 15 16:13:36.013327 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:13:36.013305    2588 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-a84db0/test-model-a84db0-kserve-6fd5fd76dc-gv2mg"
Jul 15 16:13:36.153193 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:13:36.153166    2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/343e8043-67c2-4563-888f-2734a0bc3844-tls-certs\") pod \"343e8043-67c2-4563-888f-2734a0bc3844\" (UID: \"343e8043-67c2-4563-888f-2734a0bc3844\") "
Jul 15 16:13:36.153418 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:13:36.153222    2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/343e8043-67c2-4563-888f-2734a0bc3844-home\") pod \"343e8043-67c2-4563-888f-2734a0bc3844\" (UID: \"343e8043-67c2-4563-888f-2734a0bc3844\") "
Jul 15 16:13:36.153418 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:13:36.153244    2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g2clm\" (UniqueName: \"kubernetes.io/projected/343e8043-67c2-4563-888f-2734a0bc3844-kube-api-access-g2clm\") pod \"343e8043-67c2-4563-888f-2734a0bc3844\" (UID: \"343e8043-67c2-4563-888f-2734a0bc3844\") "
Jul 15 16:13:36.153418 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:13:36.153266    2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/343e8043-67c2-4563-888f-2734a0bc3844-tmp-dir\") pod \"343e8043-67c2-4563-888f-2734a0bc3844\" (UID: \"343e8043-67c2-4563-888f-2734a0bc3844\") "
Jul 15 16:13:36.153418 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:13:36.153294    2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/343e8043-67c2-4563-888f-2734a0bc3844-dshm\") pod \"343e8043-67c2-4563-888f-2734a0bc3844\" (UID: \"343e8043-67c2-4563-888f-2734a0bc3844\") "
Jul 15 16:13:36.153418 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:13:36.153322    2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/343e8043-67c2-4563-888f-2734a0bc3844-model-cache\") pod \"343e8043-67c2-4563-888f-2734a0bc3844\" (UID: \"343e8043-67c2-4563-888f-2734a0bc3844\") "
Jul 15 16:13:36.153694 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:13:36.153612    2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/343e8043-67c2-4563-888f-2734a0bc3844-home" (OuterVolumeSpecName: "home") pod "343e8043-67c2-4563-888f-2734a0bc3844" (UID: "343e8043-67c2-4563-888f-2734a0bc3844"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 16:13:36.153694 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:13:36.153624    2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/343e8043-67c2-4563-888f-2734a0bc3844-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "343e8043-67c2-4563-888f-2734a0bc3844" (UID: "343e8043-67c2-4563-888f-2734a0bc3844"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 16:13:36.153694 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:13:36.153665    2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/343e8043-67c2-4563-888f-2734a0bc3844-model-cache" (OuterVolumeSpecName: "model-cache") pod "343e8043-67c2-4563-888f-2734a0bc3844" (UID: "343e8043-67c2-4563-888f-2734a0bc3844"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 16:13:36.155434 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:13:36.155415    2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/343e8043-67c2-4563-888f-2734a0bc3844-dshm" (OuterVolumeSpecName: "dshm") pod "343e8043-67c2-4563-888f-2734a0bc3844" (UID: "343e8043-67c2-4563-888f-2734a0bc3844"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 16:13:36.155511 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:13:36.155460    2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/343e8043-67c2-4563-888f-2734a0bc3844-kube-api-access-g2clm" (OuterVolumeSpecName: "kube-api-access-g2clm") pod "343e8043-67c2-4563-888f-2734a0bc3844" (UID: "343e8043-67c2-4563-888f-2734a0bc3844"). InnerVolumeSpecName "kube-api-access-g2clm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 16:13:36.155546 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:13:36.155511    2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/343e8043-67c2-4563-888f-2734a0bc3844-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "343e8043-67c2-4563-888f-2734a0bc3844" (UID: "343e8043-67c2-4563-888f-2734a0bc3844"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 16:13:36.254626 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:13:36.254601    2588 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/343e8043-67c2-4563-888f-2734a0bc3844-tls-certs\") on node \"ip-10-0-140-212.ec2.internal\" DevicePath \"\""
Jul 15 16:13:36.254626 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:13:36.254622    2588 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/343e8043-67c2-4563-888f-2734a0bc3844-home\") on node \"ip-10-0-140-212.ec2.internal\" DevicePath \"\""
Jul 15 16:13:36.254763 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:13:36.254632    2588 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g2clm\" (UniqueName: \"kubernetes.io/projected/343e8043-67c2-4563-888f-2734a0bc3844-kube-api-access-g2clm\") on node \"ip-10-0-140-212.ec2.internal\" DevicePath \"\""
Jul 15 16:13:36.254763 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:13:36.254641    2588 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/343e8043-67c2-4563-888f-2734a0bc3844-tmp-dir\") on node \"ip-10-0-140-212.ec2.internal\" DevicePath \"\""
Jul 15 16:13:36.254763 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:13:36.254650    2588 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/343e8043-67c2-4563-888f-2734a0bc3844-dshm\") on node \"ip-10-0-140-212.ec2.internal\" DevicePath \"\""
Jul 15 16:13:36.254763 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:13:36.254658    2588 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/343e8043-67c2-4563-888f-2734a0bc3844-model-cache\") on node \"ip-10-0-140-212.ec2.internal\" DevicePath \"\""
Jul 15 16:13:36.971476 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:13:36.971448    2588 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-a84db0/test-model-a84db0-kserve-6fd5fd76dc-gv2mg"
Jul 15 16:13:36.971892 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:13:36.971471    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-a84db0/test-model-a84db0-kserve-6fd5fd76dc-gv2mg" event={"ID":"343e8043-67c2-4563-888f-2734a0bc3844","Type":"ContainerDied","Data":"0d2662cfebdf1fb7daa1c9d9820c108cce6c046604e484dfcdcd05acf9df6160"}
Jul 15 16:13:36.971892 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:13:36.971514    2588 scope.go:117] "RemoveContainer" containerID="50801d4a361c5ec696d5a7f7595cc951c8a6a0b8dbb6fc58872471415ce40466"
Jul 15 16:13:36.992546 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:13:36.992522    2588 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-a84db0/test-model-a84db0-kserve-6fd5fd76dc-gv2mg"]
Jul 15 16:13:36.999879 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:13:36.999858    2588 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-a84db0/test-model-a84db0-kserve-6fd5fd76dc-gv2mg"]
Jul 15 16:13:38.911500 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:13:38.911457    2588 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="343e8043-67c2-4563-888f-2734a0bc3844" path="/var/lib/kubelet/pods/343e8043-67c2-4563-888f-2734a0bc3844/volumes"
Jul 15 16:13:47.103104 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:13:47.103060    2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-a84db0-ztp5t"]
Jul 15 16:13:47.103519 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:13:47.103415    2588 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="343e8043-67c2-4563-888f-2734a0bc3844" containerName="main"
Jul 15 16:13:47.103519 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:13:47.103426    2588 state_mem.go:107] "Deleted CPUSet assignment" podUID="343e8043-67c2-4563-888f-2734a0bc3844" containerName="main"
Jul 15 16:13:47.103519 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:13:47.103443    2588 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8338efe2-ebe8-43ce-a878-64beea02ea7f" containerName="revoke-keys"
Jul 15 16:13:47.103519 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:13:47.103448    2588 state_mem.go:107] "Deleted CPUSet assignment" podUID="8338efe2-ebe8-43ce-a878-64beea02ea7f" containerName="revoke-keys"
Jul 15 16:13:47.103519 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:13:47.103504    2588 memory_manager.go:368] "RemoveStaleState removing state" podUID="8338efe2-ebe8-43ce-a878-64beea02ea7f" containerName="revoke-keys"
Jul 15 16:13:47.103519 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:13:47.103513    2588 memory_manager.go:368] "RemoveStaleState removing state" podUID="343e8043-67c2-4563-888f-2734a0bc3844" containerName="main"
Jul 15 16:13:47.108010 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:13:47.107991    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-a84db0-ztp5t"
Jul 15 16:13:47.110802 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:13:47.110780    2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 15 16:13:47.111261 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:13:47.111238    2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-f55c8\""
Jul 15 16:13:47.117519 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:13:47.117498    2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-a84db0-ztp5t"]
Jul 15 16:13:47.242469 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:13:47.242437    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/453c58c5-c127-4760-82ce-c377c655bf85-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-a84db0-ztp5t\" (UID: \"453c58c5-c127-4760-82ce-c377c655bf85\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-a84db0-ztp5t"
Jul 15 16:13:47.343706 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:13:47.343672    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/453c58c5-c127-4760-82ce-c377c655bf85-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-a84db0-ztp5t\" (UID: \"453c58c5-c127-4760-82ce-c377c655bf85\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-a84db0-ztp5t"
Jul 15 16:13:47.344239 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:13:47.344216    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/453c58c5-c127-4760-82ce-c377c655bf85-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-a84db0-ztp5t\" (UID: \"453c58c5-c127-4760-82ce-c377c655bf85\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-a84db0-ztp5t"
Jul 15 16:13:47.420034 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:13:47.419970    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-a84db0-ztp5t"
Jul 15 16:13:47.552045 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:13:47.552019    2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-a84db0-ztp5t"]
Jul 15 16:13:47.553697 ip-10-0-140-212 kubenswrapper[2588]: W0715 16:13:47.553666    2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod453c58c5_c127_4760_82ce_c377c655bf85.slice/crio-c2b4099323044c0f209ee46bbf94179c1ac241258a8e5e6ddb608a87cb92795d WatchSource:0}: Error finding container c2b4099323044c0f209ee46bbf94179c1ac241258a8e5e6ddb608a87cb92795d: Status 404 returned error can't find the container with id c2b4099323044c0f209ee46bbf94179c1ac241258a8e5e6ddb608a87cb92795d
Jul 15 16:13:48.034193 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:13:48.034160    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-a84db0-ztp5t" event={"ID":"453c58c5-c127-4760-82ce-c377c655bf85","Type":"ContainerStarted","Data":"e7f3424d907fabf6d324bc3055c10941a0179f3b493e451402f60bc87d57bd37"}
Jul 15 16:13:48.034330 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:13:48.034241    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-a84db0-ztp5t" event={"ID":"453c58c5-c127-4760-82ce-c377c655bf85","Type":"ContainerStarted","Data":"c2b4099323044c0f209ee46bbf94179c1ac241258a8e5e6ddb608a87cb92795d"}
Jul 15 16:13:49.040082 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:13:49.040049    2588 generic.go:356] "Generic (PLEG): container finished" podID="453c58c5-c127-4760-82ce-c377c655bf85" containerID="e7f3424d907fabf6d324bc3055c10941a0179f3b493e451402f60bc87d57bd37" exitCode=0
Jul 15 16:13:49.040464 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:13:49.040097    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-a84db0-ztp5t" event={"ID":"453c58c5-c127-4760-82ce-c377c655bf85","Type":"ContainerDied","Data":"e7f3424d907fabf6d324bc3055c10941a0179f3b493e451402f60bc87d57bd37"}
Jul 15 16:13:50.175808 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:13:50.175786    2588 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-a84db0-ztp5t"
Jul 15 16:13:50.268611 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:13:50.268572    2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/453c58c5-c127-4760-82ce-c377c655bf85-maas-api-service-ca\") pod \"453c58c5-c127-4760-82ce-c377c655bf85\" (UID: \"453c58c5-c127-4760-82ce-c377c655bf85\") "
Jul 15 16:13:50.268952 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:13:50.268932    2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/453c58c5-c127-4760-82ce-c377c655bf85-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "453c58c5-c127-4760-82ce-c377c655bf85" (UID: "453c58c5-c127-4760-82ce-c377c655bf85"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 16:13:50.369526 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:13:50.369493    2588 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/453c58c5-c127-4760-82ce-c377c655bf85-maas-api-service-ca\") on node \"ip-10-0-140-212.ec2.internal\" DevicePath \"\""
Jul 15 16:13:51.051332 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:13:51.051304    2588 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-a84db0-ztp5t"
Jul 15 16:13:51.051510 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:13:51.051360    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-a84db0-ztp5t" event={"ID":"453c58c5-c127-4760-82ce-c377c655bf85","Type":"ContainerDied","Data":"c2b4099323044c0f209ee46bbf94179c1ac241258a8e5e6ddb608a87cb92795d"}
Jul 15 16:13:51.051510 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:13:51.051415    2588 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c2b4099323044c0f209ee46bbf94179c1ac241258a8e5e6ddb608a87cb92795d"
Jul 15 16:14:37.025073 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:14:37.025038    2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-b896e0-jvf7c"]
Jul 15 16:14:37.025670 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:14:37.025573    2588 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="453c58c5-c127-4760-82ce-c377c655bf85" containerName="revoke-keys"
Jul 15 16:14:37.025670 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:14:37.025593    2588 state_mem.go:107] "Deleted CPUSet assignment" podUID="453c58c5-c127-4760-82ce-c377c655bf85" containerName="revoke-keys"
Jul 15 16:14:37.025791 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:14:37.025717    2588 memory_manager.go:368] "RemoveStaleState removing state" podUID="453c58c5-c127-4760-82ce-c377c655bf85" containerName="revoke-keys"
Jul 15 16:14:37.028792 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:14:37.028771    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-b896e0-jvf7c"
Jul 15 16:14:37.031854 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:14:37.031837    2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-f55c8\""
Jul 15 16:14:37.031981 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:14:37.031871    2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 15 16:14:37.039890 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:14:37.039868    2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-b896e0-jvf7c"]
Jul 15 16:14:37.165004 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:14:37.164976    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b8a64d5d-8172-448d-a3ac-bf53f5a1ef21-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-b896e0-jvf7c\" (UID: \"b8a64d5d-8172-448d-a3ac-bf53f5a1ef21\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-b896e0-jvf7c"
Jul 15 16:14:37.266188 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:14:37.266157    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b8a64d5d-8172-448d-a3ac-bf53f5a1ef21-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-b896e0-jvf7c\" (UID: \"b8a64d5d-8172-448d-a3ac-bf53f5a1ef21\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-b896e0-jvf7c"
Jul 15 16:14:37.266769 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:14:37.266749    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b8a64d5d-8172-448d-a3ac-bf53f5a1ef21-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-b896e0-jvf7c\" (UID: \"b8a64d5d-8172-448d-a3ac-bf53f5a1ef21\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-b896e0-jvf7c"
Jul 15 16:14:37.339474 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:14:37.339437    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-b896e0-jvf7c"
Jul 15 16:14:37.467913 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:14:37.467885    2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-b896e0-jvf7c"]
Jul 15 16:14:37.469476 ip-10-0-140-212 kubenswrapper[2588]: W0715 16:14:37.469448    2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8a64d5d_8172_448d_a3ac_bf53f5a1ef21.slice/crio-deb39a5f2e76ee548679528c3ba5a6752a80da6814331889aac41da4dfcdd55e WatchSource:0}: Error finding container deb39a5f2e76ee548679528c3ba5a6752a80da6814331889aac41da4dfcdd55e: Status 404 returned error can't find the container with id deb39a5f2e76ee548679528c3ba5a6752a80da6814331889aac41da4dfcdd55e
Jul 15 16:14:38.318702 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:14:38.318662    2588 generic.go:356] "Generic (PLEG): container finished" podID="b8a64d5d-8172-448d-a3ac-bf53f5a1ef21" containerID="dff478c153440c1804aa2ddfb3ffc5ce4b3df943bea1c45f909872d3d0602424" exitCode=0
Jul 15 16:14:38.319076 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:14:38.318715    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-b896e0-jvf7c" event={"ID":"b8a64d5d-8172-448d-a3ac-bf53f5a1ef21","Type":"ContainerDied","Data":"dff478c153440c1804aa2ddfb3ffc5ce4b3df943bea1c45f909872d3d0602424"}
Jul 15 16:14:38.319076 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:14:38.318756    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-b896e0-jvf7c" event={"ID":"b8a64d5d-8172-448d-a3ac-bf53f5a1ef21","Type":"ContainerStarted","Data":"deb39a5f2e76ee548679528c3ba5a6752a80da6814331889aac41da4dfcdd55e"}
Jul 15 16:14:39.453168 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:14:39.453145    2588 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-b896e0-jvf7c"
Jul 15 16:14:39.587209 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:14:39.587181    2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b8a64d5d-8172-448d-a3ac-bf53f5a1ef21-maas-api-service-ca\") pod \"b8a64d5d-8172-448d-a3ac-bf53f5a1ef21\" (UID: \"b8a64d5d-8172-448d-a3ac-bf53f5a1ef21\") "
Jul 15 16:14:39.587563 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:14:39.587537    2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b8a64d5d-8172-448d-a3ac-bf53f5a1ef21-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "b8a64d5d-8172-448d-a3ac-bf53f5a1ef21" (UID: "b8a64d5d-8172-448d-a3ac-bf53f5a1ef21"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 16:14:39.688581 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:14:39.688545    2588 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b8a64d5d-8172-448d-a3ac-bf53f5a1ef21-maas-api-service-ca\") on node \"ip-10-0-140-212.ec2.internal\" DevicePath \"\""
Jul 15 16:14:40.330580 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:14:40.330552    2588 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-b896e0-jvf7c"
Jul 15 16:14:40.330580 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:14:40.330562    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-b896e0-jvf7c" event={"ID":"b8a64d5d-8172-448d-a3ac-bf53f5a1ef21","Type":"ContainerDied","Data":"deb39a5f2e76ee548679528c3ba5a6752a80da6814331889aac41da4dfcdd55e"}
Jul 15 16:14:40.330796 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:14:40.330605    2588 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="deb39a5f2e76ee548679528c3ba5a6752a80da6814331889aac41da4dfcdd55e"
Jul 15 16:15:00.150310 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:15:00.150268    2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29735535-j6km7"]
Jul 15 16:15:00.150761 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:15:00.150672    2588 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b8a64d5d-8172-448d-a3ac-bf53f5a1ef21" containerName="revoke-keys"
Jul 15 16:15:00.150761 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:15:00.150685    2588 state_mem.go:107] "Deleted CPUSet assignment" podUID="b8a64d5d-8172-448d-a3ac-bf53f5a1ef21" containerName="revoke-keys"
Jul 15 16:15:00.150761 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:15:00.150751    2588 memory_manager.go:368] "RemoveStaleState removing state" podUID="b8a64d5d-8172-448d-a3ac-bf53f5a1ef21" containerName="revoke-keys"
Jul 15 16:15:00.153636 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:15:00.153619    2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-652d3f-29735535-mtnjb"]
Jul 15 16:15:00.153757 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:15:00.153737    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735535-j6km7"
Jul 15 16:15:00.156844 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:15:00.156824    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-652d3f-29735535-mtnjb"
Jul 15 16:15:00.157306 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:15:00.157290    2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-f55c8\""
Jul 15 16:15:00.162980 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:15:00.162951    2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29735535-j6km7"]
Jul 15 16:15:00.166351 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:15:00.166313    2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-652d3f-29735535-mtnjb"]
Jul 15 16:15:00.167012 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:15:00.166991    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735535-j6km7"
Jul 15 16:15:00.175365 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:15:00.175326    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-652d3f-29735535-mtnjb"
Jul 15 16:15:00.316482 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:15:00.316446    2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29735535-j6km7"]
Jul 15 16:15:00.318908 ip-10-0-140-212 kubenswrapper[2588]: W0715 16:15:00.318874    2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ad0408c_e7ad_460e_bce5_11ae419393ec.slice/crio-702a79e315e6c82d646e99f748ee0f755d4efa085297f4584ea09c8b20f2d25d WatchSource:0}: Error finding container 702a79e315e6c82d646e99f748ee0f755d4efa085297f4584ea09c8b20f2d25d: Status 404 returned error can't find the container with id 702a79e315e6c82d646e99f748ee0f755d4efa085297f4584ea09c8b20f2d25d
Jul 15 16:15:00.349841 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:15:00.349818    2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-652d3f-29735535-mtnjb"]
Jul 15 16:15:00.354452 ip-10-0-140-212 kubenswrapper[2588]: W0715 16:15:00.354430    2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8014976_7a2e_443a_a331_12cd5d77688d.slice/crio-663813c524f27ed587c0f037a6677150a529c302a011370de196c17680ca9b54 WatchSource:0}: Error finding container 663813c524f27ed587c0f037a6677150a529c302a011370de196c17680ca9b54: Status 404 returned error can't find the container with id 663813c524f27ed587c0f037a6677150a529c302a011370de196c17680ca9b54
Jul 15 16:15:00.450707 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:15:00.450620    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-652d3f-29735535-mtnjb" event={"ID":"b8014976-7a2e-443a-a331-12cd5d77688d","Type":"ContainerStarted","Data":"663813c524f27ed587c0f037a6677150a529c302a011370de196c17680ca9b54"}
Jul 15 16:15:00.451778 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:15:00.451753    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735535-j6km7" event={"ID":"8ad0408c-e7ad-460e-bce5-11ae419393ec","Type":"ContainerStarted","Data":"702a79e315e6c82d646e99f748ee0f755d4efa085297f4584ea09c8b20f2d25d"}
Jul 15 16:15:01.459143 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:15:01.459046    2588 generic.go:356] "Generic (PLEG): container finished" podID="b8014976-7a2e-443a-a331-12cd5d77688d" containerID="f0754d9d8babe2e2ec279d3108fc95c8f741b1ea6521c7ef4bfdfe69f51e6ad1" exitCode=0
Jul 15 16:15:01.459609 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:15:01.459135    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-652d3f-29735535-mtnjb" event={"ID":"b8014976-7a2e-443a-a331-12cd5d77688d","Type":"ContainerDied","Data":"f0754d9d8babe2e2ec279d3108fc95c8f741b1ea6521c7ef4bfdfe69f51e6ad1"}
Jul 15 16:15:01.460700 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:15:01.460677    2588 generic.go:356] "Generic (PLEG): container finished" podID="8ad0408c-e7ad-460e-bce5-11ae419393ec" containerID="17d9c9b866767cfc3e10a26a4f1b312604f76def71e0ae13be4c1cf53a225a22" exitCode=0
Jul 15 16:15:01.460798 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:15:01.460746    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735535-j6km7" event={"ID":"8ad0408c-e7ad-460e-bce5-11ae419393ec","Type":"ContainerDied","Data":"17d9c9b866767cfc3e10a26a4f1b312604f76def71e0ae13be4c1cf53a225a22"}
Jul 15 16:15:02.606821 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:15:02.606797    2588 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-652d3f-29735535-mtnjb"
Jul 15 16:15:02.609570 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:15:02.609551    2588 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735535-j6km7"
Jul 15 16:15:03.182610 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:15:03.182533    2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-652d3f-l9rrt"]
Jul 15 16:15:03.182887 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:15:03.182875    2588 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8ad0408c-e7ad-460e-bce5-11ae419393ec" containerName="cleanup"
Jul 15 16:15:03.182928 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:15:03.182888    2588 state_mem.go:107] "Deleted CPUSet assignment" podUID="8ad0408c-e7ad-460e-bce5-11ae419393ec" containerName="cleanup"
Jul 15 16:15:03.182928 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:15:03.182905    2588 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b8014976-7a2e-443a-a331-12cd5d77688d" containerName="cleanup"
Jul 15 16:15:03.182928 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:15:03.182910    2588 state_mem.go:107] "Deleted CPUSet assignment" podUID="b8014976-7a2e-443a-a331-12cd5d77688d" containerName="cleanup"
Jul 15 16:15:03.183014 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:15:03.182971    2588 memory_manager.go:368] "RemoveStaleState removing state" podUID="8ad0408c-e7ad-460e-bce5-11ae419393ec" containerName="cleanup"
Jul 15 16:15:03.183014 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:15:03.182981    2588 memory_manager.go:368] "RemoveStaleState removing state" podUID="b8014976-7a2e-443a-a331-12cd5d77688d" containerName="cleanup"
Jul 15 16:15:03.186227 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:15:03.186211    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-652d3f-l9rrt"
Jul 15 16:15:03.189435 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:15:03.189416    2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 15 16:15:03.194906 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:15:03.194884    2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-652d3f-l9rrt"]
Jul 15 16:15:03.291472 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:15:03.291432    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b94f2ce6-6659-4c54-a8b8-4e824a1fca58-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-652d3f-l9rrt\" (UID: \"b94f2ce6-6659-4c54-a8b8-4e824a1fca58\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-652d3f-l9rrt"
Jul 15 16:15:03.392150 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:15:03.392111    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b94f2ce6-6659-4c54-a8b8-4e824a1fca58-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-652d3f-l9rrt\" (UID: \"b94f2ce6-6659-4c54-a8b8-4e824a1fca58\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-652d3f-l9rrt"
Jul 15 16:15:03.392892 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:15:03.392864    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b94f2ce6-6659-4c54-a8b8-4e824a1fca58-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-652d3f-l9rrt\" (UID: \"b94f2ce6-6659-4c54-a8b8-4e824a1fca58\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-652d3f-l9rrt"
Jul 15 16:15:03.472956 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:15:03.472866    2588 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-652d3f-29735535-mtnjb"
Jul 15 16:15:03.472956 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:15:03.472871    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-652d3f-29735535-mtnjb" event={"ID":"b8014976-7a2e-443a-a331-12cd5d77688d","Type":"ContainerDied","Data":"663813c524f27ed587c0f037a6677150a529c302a011370de196c17680ca9b54"}
Jul 15 16:15:03.473168 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:15:03.472984    2588 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="663813c524f27ed587c0f037a6677150a529c302a011370de196c17680ca9b54"
Jul 15 16:15:03.474239 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:15:03.474216    2588 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735535-j6km7"
Jul 15 16:15:03.474375 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:15:03.474248    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735535-j6km7" event={"ID":"8ad0408c-e7ad-460e-bce5-11ae419393ec","Type":"ContainerDied","Data":"702a79e315e6c82d646e99f748ee0f755d4efa085297f4584ea09c8b20f2d25d"}
Jul 15 16:15:03.474375 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:15:03.474288    2588 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="702a79e315e6c82d646e99f748ee0f755d4efa085297f4584ea09c8b20f2d25d"
Jul 15 16:15:03.497364 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:15:03.497310    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-652d3f-l9rrt"
Jul 15 16:15:03.631587 ip-10-0-140-212 kubenswrapper[2588]: W0715 16:15:03.631557    2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb94f2ce6_6659_4c54_a8b8_4e824a1fca58.slice/crio-e70eefc2541f09b1d24ae39232db170cd748d436d382e6779f8b0ba4af0eee98 WatchSource:0}: Error finding container e70eefc2541f09b1d24ae39232db170cd748d436d382e6779f8b0ba4af0eee98: Status 404 returned error can't find the container with id e70eefc2541f09b1d24ae39232db170cd748d436d382e6779f8b0ba4af0eee98
Jul 15 16:15:03.631895 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:15:03.631653    2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-652d3f-l9rrt"]
Jul 15 16:15:04.483854 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:15:04.483768    2588 generic.go:356] "Generic (PLEG): container finished" podID="b94f2ce6-6659-4c54-a8b8-4e824a1fca58" containerID="ead3c66e52087b7852a631b3f6de1dc0a1b3dd9fc1cfdd0683eadf8fbdf70a84" exitCode=0
Jul 15 16:15:04.483854 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:15:04.483823    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-652d3f-l9rrt" event={"ID":"b94f2ce6-6659-4c54-a8b8-4e824a1fca58","Type":"ContainerDied","Data":"ead3c66e52087b7852a631b3f6de1dc0a1b3dd9fc1cfdd0683eadf8fbdf70a84"}
Jul 15 16:15:04.484035 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:15:04.483862    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-652d3f-l9rrt" event={"ID":"b94f2ce6-6659-4c54-a8b8-4e824a1fca58","Type":"ContainerStarted","Data":"e70eefc2541f09b1d24ae39232db170cd748d436d382e6779f8b0ba4af0eee98"}
Jul 15 16:15:05.616161 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:15:05.616139    2588 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-652d3f-l9rrt"
Jul 15 16:15:05.710767 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:15:05.710738    2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b94f2ce6-6659-4c54-a8b8-4e824a1fca58-maas-api-service-ca\") pod \"b94f2ce6-6659-4c54-a8b8-4e824a1fca58\" (UID: \"b94f2ce6-6659-4c54-a8b8-4e824a1fca58\") "
Jul 15 16:15:05.711101 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:15:05.711076    2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b94f2ce6-6659-4c54-a8b8-4e824a1fca58-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "b94f2ce6-6659-4c54-a8b8-4e824a1fca58" (UID: "b94f2ce6-6659-4c54-a8b8-4e824a1fca58"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 16:15:05.811719 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:15:05.811639    2588 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b94f2ce6-6659-4c54-a8b8-4e824a1fca58-maas-api-service-ca\") on node \"ip-10-0-140-212.ec2.internal\" DevicePath \"\""
Jul 15 16:15:06.495861 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:15:06.495831    2588 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-652d3f-l9rrt"
Jul 15 16:15:06.496063 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:15:06.495873    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-652d3f-l9rrt" event={"ID":"b94f2ce6-6659-4c54-a8b8-4e824a1fca58","Type":"ContainerDied","Data":"e70eefc2541f09b1d24ae39232db170cd748d436d382e6779f8b0ba4af0eee98"}
Jul 15 16:15:06.496063 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:15:06.495921    2588 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e70eefc2541f09b1d24ae39232db170cd748d436d382e6779f8b0ba4af0eee98"
Jul 15 16:15:13.749650 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:15:13.749615    2588 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-652d3f-29735535-mtnjb"]
Jul 15 16:15:13.752030 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:15:13.752007    2588 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-652d3f-29735535-mtnjb"]
Jul 15 16:15:14.910086 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:15:14.910053    2588 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b8014976-7a2e-443a-a331-12cd5d77688d" path="/var/lib/kubelet/pods/b8014976-7a2e-443a-a331-12cd5d77688d/volumes"
Jul 15 16:15:15.004194 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:15:15.004167    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-5f7f494dd4-lbdlp_c80ed5cd-4b7c-4981-95c6-a02cf058f709/cluster-monitoring-operator/0.log"
Jul 15 16:15:15.009867 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:15:15.009844    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-qcvqk_eb866034-d7d1-4bee-b8b7-616b355d371d/console-operator/1.log"
Jul 15 16:15:15.010558 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:15:15.010541    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-5f7f494dd4-lbdlp_c80ed5cd-4b7c-4981-95c6-a02cf058f709/cluster-monitoring-operator/0.log"
Jul 15 16:15:15.012208 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:15:15.012187    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dthn7_ec82e02f-7632-41be-8e7d-8c9d59c569b6/ovn-acl-logging/0.log"
Jul 15 16:15:15.016133 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:15:15.016113    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-qcvqk_eb866034-d7d1-4bee-b8b7-616b355d371d/console-operator/1.log"
Jul 15 16:15:15.018204 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:15:15.018184    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dthn7_ec82e02f-7632-41be-8e7d-8c9d59c569b6/ovn-acl-logging/0.log"
Jul 15 16:18:33.128299 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:18:33.128262    2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-95128b/sub-test-model-95128b-kserve-78f68c8f49-dqw8v"]
Jul 15 16:18:33.128752 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:18:33.128651    2588 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b94f2ce6-6659-4c54-a8b8-4e824a1fca58" containerName="revoke-keys"
Jul 15 16:18:33.128752 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:18:33.128663    2588 state_mem.go:107] "Deleted CPUSet assignment" podUID="b94f2ce6-6659-4c54-a8b8-4e824a1fca58" containerName="revoke-keys"
Jul 15 16:18:33.128752 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:18:33.128720    2588 memory_manager.go:368] "RemoveStaleState removing state" podUID="b94f2ce6-6659-4c54-a8b8-4e824a1fca58" containerName="revoke-keys"
Jul 15 16:18:33.131431 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:18:33.131414    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-95128b/sub-test-model-95128b-kserve-78f68c8f49-dqw8v"
Jul 15 16:18:33.136778 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:18:33.136755    2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-95128b\"/\"default-dockercfg-9wr6w\""
Jul 15 16:18:33.136928 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:18:33.136769    2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-95128b\"/\"sub-test-model-95128b-kserve-self-signed-certs\""
Jul 15 16:18:33.136928 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:18:33.136785    2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-95128b\"/\"openshift-service-ca.crt\""
Jul 15 16:18:33.137058 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:18:33.136785    2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-95128b\"/\"kube-root-ca.crt\""
Jul 15 16:18:33.151685 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:18:33.151655    2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-95128b/sub-test-model-95128b-kserve-78f68c8f49-dqw8v"]
Jul 15 16:18:33.221545 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:18:33.221508    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6qbnx\" (UniqueName: \"kubernetes.io/projected/6448de7e-732e-4a1f-b588-a9ab796752d1-kube-api-access-6qbnx\") pod \"sub-test-model-95128b-kserve-78f68c8f49-dqw8v\" (UID: \"6448de7e-732e-4a1f-b588-a9ab796752d1\") " pod="ai-tenant-e2e-shared-a-95128b/sub-test-model-95128b-kserve-78f68c8f49-dqw8v"
Jul 15 16:18:33.221731 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:18:33.221564    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6448de7e-732e-4a1f-b588-a9ab796752d1-dshm\") pod \"sub-test-model-95128b-kserve-78f68c8f49-dqw8v\" (UID: \"6448de7e-732e-4a1f-b588-a9ab796752d1\") " pod="ai-tenant-e2e-shared-a-95128b/sub-test-model-95128b-kserve-78f68c8f49-dqw8v"
Jul 15 16:18:33.221731 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:18:33.221584    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6448de7e-732e-4a1f-b588-a9ab796752d1-model-cache\") pod \"sub-test-model-95128b-kserve-78f68c8f49-dqw8v\" (UID: \"6448de7e-732e-4a1f-b588-a9ab796752d1\") " pod="ai-tenant-e2e-shared-a-95128b/sub-test-model-95128b-kserve-78f68c8f49-dqw8v"
Jul 15 16:18:33.221731 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:18:33.221645    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6448de7e-732e-4a1f-b588-a9ab796752d1-tmp-dir\") pod \"sub-test-model-95128b-kserve-78f68c8f49-dqw8v\" (UID: \"6448de7e-732e-4a1f-b588-a9ab796752d1\") " pod="ai-tenant-e2e-shared-a-95128b/sub-test-model-95128b-kserve-78f68c8f49-dqw8v"
Jul 15 16:18:33.221731 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:18:33.221667    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6448de7e-732e-4a1f-b588-a9ab796752d1-home\") pod \"sub-test-model-95128b-kserve-78f68c8f49-dqw8v\" (UID: \"6448de7e-732e-4a1f-b588-a9ab796752d1\") " pod="ai-tenant-e2e-shared-a-95128b/sub-test-model-95128b-kserve-78f68c8f49-dqw8v"
Jul 15 16:18:33.221731 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:18:33.221684    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6448de7e-732e-4a1f-b588-a9ab796752d1-tls-certs\") pod \"sub-test-model-95128b-kserve-78f68c8f49-dqw8v\" (UID: \"6448de7e-732e-4a1f-b588-a9ab796752d1\") " pod="ai-tenant-e2e-shared-a-95128b/sub-test-model-95128b-kserve-78f68c8f49-dqw8v"
Jul 15 16:18:33.322585 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:18:33.322553    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6448de7e-732e-4a1f-b588-a9ab796752d1-tmp-dir\") pod \"sub-test-model-95128b-kserve-78f68c8f49-dqw8v\" (UID: \"6448de7e-732e-4a1f-b588-a9ab796752d1\") " pod="ai-tenant-e2e-shared-a-95128b/sub-test-model-95128b-kserve-78f68c8f49-dqw8v"
Jul 15 16:18:33.322774 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:18:33.322593    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6448de7e-732e-4a1f-b588-a9ab796752d1-home\") pod \"sub-test-model-95128b-kserve-78f68c8f49-dqw8v\" (UID: \"6448de7e-732e-4a1f-b588-a9ab796752d1\") " pod="ai-tenant-e2e-shared-a-95128b/sub-test-model-95128b-kserve-78f68c8f49-dqw8v"
Jul 15 16:18:33.322774 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:18:33.322613    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6448de7e-732e-4a1f-b588-a9ab796752d1-tls-certs\") pod \"sub-test-model-95128b-kserve-78f68c8f49-dqw8v\" (UID: \"6448de7e-732e-4a1f-b588-a9ab796752d1\") " pod="ai-tenant-e2e-shared-a-95128b/sub-test-model-95128b-kserve-78f68c8f49-dqw8v"
Jul 15 16:18:33.322774 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:18:33.322642    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6qbnx\" (UniqueName: \"kubernetes.io/projected/6448de7e-732e-4a1f-b588-a9ab796752d1-kube-api-access-6qbnx\") pod \"sub-test-model-95128b-kserve-78f68c8f49-dqw8v\" (UID: \"6448de7e-732e-4a1f-b588-a9ab796752d1\") " pod="ai-tenant-e2e-shared-a-95128b/sub-test-model-95128b-kserve-78f68c8f49-dqw8v"
Jul 15 16:18:33.322774 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:18:33.322680    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6448de7e-732e-4a1f-b588-a9ab796752d1-dshm\") pod \"sub-test-model-95128b-kserve-78f68c8f49-dqw8v\" (UID: \"6448de7e-732e-4a1f-b588-a9ab796752d1\") " pod="ai-tenant-e2e-shared-a-95128b/sub-test-model-95128b-kserve-78f68c8f49-dqw8v"
Jul 15 16:18:33.322774 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:18:33.322695    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6448de7e-732e-4a1f-b588-a9ab796752d1-model-cache\") pod \"sub-test-model-95128b-kserve-78f68c8f49-dqw8v\" (UID: \"6448de7e-732e-4a1f-b588-a9ab796752d1\") " pod="ai-tenant-e2e-shared-a-95128b/sub-test-model-95128b-kserve-78f68c8f49-dqw8v"
Jul 15 16:18:33.323064 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:18:33.323036    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6448de7e-732e-4a1f-b588-a9ab796752d1-tmp-dir\") pod \"sub-test-model-95128b-kserve-78f68c8f49-dqw8v\" (UID: \"6448de7e-732e-4a1f-b588-a9ab796752d1\") " pod="ai-tenant-e2e-shared-a-95128b/sub-test-model-95128b-kserve-78f68c8f49-dqw8v"
Jul 15 16:18:33.323117 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:18:33.323077    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6448de7e-732e-4a1f-b588-a9ab796752d1-home\") pod \"sub-test-model-95128b-kserve-78f68c8f49-dqw8v\" (UID: \"6448de7e-732e-4a1f-b588-a9ab796752d1\") " pod="ai-tenant-e2e-shared-a-95128b/sub-test-model-95128b-kserve-78f68c8f49-dqw8v"
Jul 15 16:18:33.323117 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:18:33.323094    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6448de7e-732e-4a1f-b588-a9ab796752d1-model-cache\") pod \"sub-test-model-95128b-kserve-78f68c8f49-dqw8v\" (UID: \"6448de7e-732e-4a1f-b588-a9ab796752d1\") " pod="ai-tenant-e2e-shared-a-95128b/sub-test-model-95128b-kserve-78f68c8f49-dqw8v"
Jul 15 16:18:33.324986 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:18:33.324964    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6448de7e-732e-4a1f-b588-a9ab796752d1-dshm\") pod \"sub-test-model-95128b-kserve-78f68c8f49-dqw8v\" (UID: \"6448de7e-732e-4a1f-b588-a9ab796752d1\") " pod="ai-tenant-e2e-shared-a-95128b/sub-test-model-95128b-kserve-78f68c8f49-dqw8v"
Jul 15 16:18:33.325376 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:18:33.325337    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6448de7e-732e-4a1f-b588-a9ab796752d1-tls-certs\") pod \"sub-test-model-95128b-kserve-78f68c8f49-dqw8v\" (UID: \"6448de7e-732e-4a1f-b588-a9ab796752d1\") " pod="ai-tenant-e2e-shared-a-95128b/sub-test-model-95128b-kserve-78f68c8f49-dqw8v"
Jul 15 16:18:33.338696 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:18:33.338665    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6qbnx\" (UniqueName: \"kubernetes.io/projected/6448de7e-732e-4a1f-b588-a9ab796752d1-kube-api-access-6qbnx\") pod \"sub-test-model-95128b-kserve-78f68c8f49-dqw8v\" (UID: \"6448de7e-732e-4a1f-b588-a9ab796752d1\") " pod="ai-tenant-e2e-shared-a-95128b/sub-test-model-95128b-kserve-78f68c8f49-dqw8v"
Jul 15 16:18:33.440795 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:18:33.440693    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-95128b/sub-test-model-95128b-kserve-78f68c8f49-dqw8v"
Jul 15 16:18:33.589763 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:18:33.589731    2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-95128b/sub-test-model-95128b-kserve-78f68c8f49-dqw8v"]
Jul 15 16:18:33.590831 ip-10-0-140-212 kubenswrapper[2588]: W0715 16:18:33.590807    2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6448de7e_732e_4a1f_b588_a9ab796752d1.slice/crio-9dd780dad0ed0f8c44ce14d993aa5a49f8fe92e520bcf0af30b9d306e806380f WatchSource:0}: Error finding container 9dd780dad0ed0f8c44ce14d993aa5a49f8fe92e520bcf0af30b9d306e806380f: Status 404 returned error can't find the container with id 9dd780dad0ed0f8c44ce14d993aa5a49f8fe92e520bcf0af30b9d306e806380f
Jul 15 16:18:33.672482 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:18:33.672449    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-95128b/sub-test-model-95128b-kserve-78f68c8f49-dqw8v" event={"ID":"6448de7e-732e-4a1f-b588-a9ab796752d1","Type":"ContainerStarted","Data":"aca767d4b181318a3de6dc78322d736adde9da038beab3514ae84f39f91a08f0"}
Jul 15 16:18:33.672482 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:18:33.672494    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-95128b/sub-test-model-95128b-kserve-78f68c8f49-dqw8v" event={"ID":"6448de7e-732e-4a1f-b588-a9ab796752d1","Type":"ContainerStarted","Data":"9dd780dad0ed0f8c44ce14d993aa5a49f8fe92e520bcf0af30b9d306e806380f"}
Jul 15 16:18:33.699376 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:18:33.699258    2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-95128b/sub-test-model-95128b-kserve-78f68c8f49-dqw8v" podStartSLOduration=0.699243568 podStartE2EDuration="699.243568ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 16:18:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:18:33.698796433 +0000 UTC m=+2599.350862217" watchObservedRunningTime="2026-07-15 16:18:33.699243568 +0000 UTC m=+2599.351309327"
Jul 15 16:18:43.441399 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:18:43.441294    2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-95128b/sub-test-model-95128b-kserve-78f68c8f49-dqw8v"
Jul 15 16:18:43.441865 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:18:43.441396    2588 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-95128b/sub-test-model-95128b-kserve-78f68c8f49-dqw8v"
Jul 15 16:18:43.453707 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:18:43.453686    2588 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-95128b/sub-test-model-95128b-kserve-78f68c8f49-dqw8v"
Jul 15 16:18:43.749399 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:18:43.749301    2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-95128b/sub-test-model-95128b-kserve-78f68c8f49-dqw8v"
Jul 15 16:19:38.848807 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:19:38.848765    2588 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-95128b/sub-test-model-95128b-kserve-78f68c8f49-dqw8v"]
Jul 15 16:19:53.868911 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:19:53.868852    2588 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-95128b/sub-test-model-95128b-kserve-78f68c8f49-dqw8v" podUID="6448de7e-732e-4a1f-b588-a9ab796752d1" containerName="main" containerID="cri-o://aca767d4b181318a3de6dc78322d736adde9da038beab3514ae84f39f91a08f0" gracePeriod=45
Jul 15 16:19:54.112467 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:19:54.112443    2588 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-95128b/sub-test-model-95128b-kserve-78f68c8f49-dqw8v"
Jul 15 16:19:54.156329 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:19:54.156136    2588 generic.go:356] "Generic (PLEG): container finished" podID="6448de7e-732e-4a1f-b588-a9ab796752d1" containerID="aca767d4b181318a3de6dc78322d736adde9da038beab3514ae84f39f91a08f0" exitCode=0
Jul 15 16:19:54.156564 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:19:54.156381    2588 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-95128b/sub-test-model-95128b-kserve-78f68c8f49-dqw8v"
Jul 15 16:19:54.156564 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:19:54.156384    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-95128b/sub-test-model-95128b-kserve-78f68c8f49-dqw8v" event={"ID":"6448de7e-732e-4a1f-b588-a9ab796752d1","Type":"ContainerDied","Data":"aca767d4b181318a3de6dc78322d736adde9da038beab3514ae84f39f91a08f0"}
Jul 15 16:19:54.156564 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:19:54.156441    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-95128b/sub-test-model-95128b-kserve-78f68c8f49-dqw8v" event={"ID":"6448de7e-732e-4a1f-b588-a9ab796752d1","Type":"ContainerDied","Data":"9dd780dad0ed0f8c44ce14d993aa5a49f8fe92e520bcf0af30b9d306e806380f"}
Jul 15 16:19:54.156564 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:19:54.156461    2588 scope.go:117] "RemoveContainer" containerID="aca767d4b181318a3de6dc78322d736adde9da038beab3514ae84f39f91a08f0"
Jul 15 16:19:54.166139 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:19:54.166120    2588 scope.go:117] "RemoveContainer" containerID="aca767d4b181318a3de6dc78322d736adde9da038beab3514ae84f39f91a08f0"
Jul 15 16:19:54.166400 ip-10-0-140-212 kubenswrapper[2588]: E0715 16:19:54.166382    2588 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aca767d4b181318a3de6dc78322d736adde9da038beab3514ae84f39f91a08f0\": container with ID starting with aca767d4b181318a3de6dc78322d736adde9da038beab3514ae84f39f91a08f0 not found: ID does not exist" containerID="aca767d4b181318a3de6dc78322d736adde9da038beab3514ae84f39f91a08f0"
Jul 15 16:19:54.166477 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:19:54.166411    2588 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aca767d4b181318a3de6dc78322d736adde9da038beab3514ae84f39f91a08f0"} err="failed to get container status \"aca767d4b181318a3de6dc78322d736adde9da038beab3514ae84f39f91a08f0\": rpc error: code = NotFound desc = could not find container \"aca767d4b181318a3de6dc78322d736adde9da038beab3514ae84f39f91a08f0\": container with ID starting with aca767d4b181318a3de6dc78322d736adde9da038beab3514ae84f39f91a08f0 not found: ID does not exist"
Jul 15 16:19:54.241950 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:19:54.241905    2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6448de7e-732e-4a1f-b588-a9ab796752d1-home\") pod \"6448de7e-732e-4a1f-b588-a9ab796752d1\" (UID: \"6448de7e-732e-4a1f-b588-a9ab796752d1\") "
Jul 15 16:19:54.242085 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:19:54.242037    2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6448de7e-732e-4a1f-b588-a9ab796752d1-tmp-dir\") pod \"6448de7e-732e-4a1f-b588-a9ab796752d1\" (UID: \"6448de7e-732e-4a1f-b588-a9ab796752d1\") "
Jul 15 16:19:54.242085 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:19:54.242071    2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6448de7e-732e-4a1f-b588-a9ab796752d1-dshm\") pod \"6448de7e-732e-4a1f-b588-a9ab796752d1\" (UID: \"6448de7e-732e-4a1f-b588-a9ab796752d1\") "
Jul 15 16:19:54.242178 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:19:54.242115    2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6448de7e-732e-4a1f-b588-a9ab796752d1-tls-certs\") pod \"6448de7e-732e-4a1f-b588-a9ab796752d1\" (UID: \"6448de7e-732e-4a1f-b588-a9ab796752d1\") "
Jul 15 16:19:54.242178 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:19:54.242167    2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6qbnx\" (UniqueName: \"kubernetes.io/projected/6448de7e-732e-4a1f-b588-a9ab796752d1-kube-api-access-6qbnx\") pod \"6448de7e-732e-4a1f-b588-a9ab796752d1\" (UID: \"6448de7e-732e-4a1f-b588-a9ab796752d1\") "
Jul 15 16:19:54.242285 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:19:54.242202    2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6448de7e-732e-4a1f-b588-a9ab796752d1-model-cache\") pod \"6448de7e-732e-4a1f-b588-a9ab796752d1\" (UID: \"6448de7e-732e-4a1f-b588-a9ab796752d1\") "
Jul 15 16:19:54.242285 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:19:54.242220    2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6448de7e-732e-4a1f-b588-a9ab796752d1-home" (OuterVolumeSpecName: "home") pod "6448de7e-732e-4a1f-b588-a9ab796752d1" (UID: "6448de7e-732e-4a1f-b588-a9ab796752d1"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 16:19:54.242430 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:19:54.242327    2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6448de7e-732e-4a1f-b588-a9ab796752d1-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "6448de7e-732e-4a1f-b588-a9ab796752d1" (UID: "6448de7e-732e-4a1f-b588-a9ab796752d1"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 16:19:54.242555 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:19:54.242534    2588 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6448de7e-732e-4a1f-b588-a9ab796752d1-home\") on node \"ip-10-0-140-212.ec2.internal\" DevicePath \"\""
Jul 15 16:19:54.242626 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:19:54.242556    2588 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6448de7e-732e-4a1f-b588-a9ab796752d1-tmp-dir\") on node \"ip-10-0-140-212.ec2.internal\" DevicePath \"\""
Jul 15 16:19:54.242626 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:19:54.242534    2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6448de7e-732e-4a1f-b588-a9ab796752d1-model-cache" (OuterVolumeSpecName: "model-cache") pod "6448de7e-732e-4a1f-b588-a9ab796752d1" (UID: "6448de7e-732e-4a1f-b588-a9ab796752d1"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 16:19:54.244383 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:19:54.244354    2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6448de7e-732e-4a1f-b588-a9ab796752d1-dshm" (OuterVolumeSpecName: "dshm") pod "6448de7e-732e-4a1f-b588-a9ab796752d1" (UID: "6448de7e-732e-4a1f-b588-a9ab796752d1"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 16:19:54.244475 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:19:54.244398    2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6448de7e-732e-4a1f-b588-a9ab796752d1-kube-api-access-6qbnx" (OuterVolumeSpecName: "kube-api-access-6qbnx") pod "6448de7e-732e-4a1f-b588-a9ab796752d1" (UID: "6448de7e-732e-4a1f-b588-a9ab796752d1"). InnerVolumeSpecName "kube-api-access-6qbnx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 16:19:54.244475 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:19:54.244404    2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6448de7e-732e-4a1f-b588-a9ab796752d1-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "6448de7e-732e-4a1f-b588-a9ab796752d1" (UID: "6448de7e-732e-4a1f-b588-a9ab796752d1"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 16:19:54.343296 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:19:54.343259    2588 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6448de7e-732e-4a1f-b588-a9ab796752d1-dshm\") on node \"ip-10-0-140-212.ec2.internal\" DevicePath \"\""
Jul 15 16:19:54.343296 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:19:54.343289    2588 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6448de7e-732e-4a1f-b588-a9ab796752d1-tls-certs\") on node \"ip-10-0-140-212.ec2.internal\" DevicePath \"\""
Jul 15 16:19:54.343296 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:19:54.343301    2588 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6qbnx\" (UniqueName: \"kubernetes.io/projected/6448de7e-732e-4a1f-b588-a9ab796752d1-kube-api-access-6qbnx\") on node \"ip-10-0-140-212.ec2.internal\" DevicePath \"\""
Jul 15 16:19:54.343555 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:19:54.343309    2588 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6448de7e-732e-4a1f-b588-a9ab796752d1-model-cache\") on node \"ip-10-0-140-212.ec2.internal\" DevicePath \"\""
Jul 15 16:19:54.480518 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:19:54.480489    2588 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-95128b/sub-test-model-95128b-kserve-78f68c8f49-dqw8v"]
Jul 15 16:19:54.484309 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:19:54.484282    2588 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-95128b/sub-test-model-95128b-kserve-78f68c8f49-dqw8v"]
Jul 15 16:19:54.910877 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:19:54.910848    2588 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6448de7e-732e-4a1f-b588-a9ab796752d1" path="/var/lib/kubelet/pods/6448de7e-732e-4a1f-b588-a9ab796752d1/volumes"
Jul 15 16:20:15.042715 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:20:15.042689    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-5f7f494dd4-lbdlp_c80ed5cd-4b7c-4981-95c6-a02cf058f709/cluster-monitoring-operator/0.log"
Jul 15 16:20:15.048401 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:20:15.048379    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-qcvqk_eb866034-d7d1-4bee-b8b7-616b355d371d/console-operator/1.log"
Jul 15 16:20:15.050865 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:20:15.050849    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dthn7_ec82e02f-7632-41be-8e7d-8c9d59c569b6/ovn-acl-logging/0.log"
Jul 15 16:20:15.050962 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:20:15.050876    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-5f7f494dd4-lbdlp_c80ed5cd-4b7c-4981-95c6-a02cf058f709/cluster-monitoring-operator/0.log"
Jul 15 16:20:15.056310 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:20:15.056294    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-qcvqk_eb866034-d7d1-4bee-b8b7-616b355d371d/console-operator/1.log"
Jul 15 16:20:15.058399 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:20:15.058385    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dthn7_ec82e02f-7632-41be-8e7d-8c9d59c569b6/ovn-acl-logging/0.log"
Jul 15 16:20:17.828321 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:20:17.828285    2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-8eb165/rate-test-model-8eb165-kserve-5f645bc895-gszmw"]
Jul 15 16:20:17.828726 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:20:17.828658    2588 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6448de7e-732e-4a1f-b588-a9ab796752d1" containerName="main"
Jul 15 16:20:17.828726 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:20:17.828670    2588 state_mem.go:107] "Deleted CPUSet assignment" podUID="6448de7e-732e-4a1f-b588-a9ab796752d1" containerName="main"
Jul 15 16:20:17.828807 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:20:17.828734    2588 memory_manager.go:368] "RemoveStaleState removing state" podUID="6448de7e-732e-4a1f-b588-a9ab796752d1" containerName="main"
Jul 15 16:20:17.833185 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:20:17.833167    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-8eb165/rate-test-model-8eb165-kserve-5f645bc895-gszmw"
Jul 15 16:20:17.837309 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:20:17.837288    2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-8eb165\"/\"openshift-service-ca.crt\""
Jul 15 16:20:17.838540 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:20:17.838521    2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-8eb165\"/\"default-dockercfg-7fx45\""
Jul 15 16:20:17.838752 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:20:17.838736    2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-8eb165\"/\"kube-root-ca.crt\""
Jul 15 16:20:17.838839 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:20:17.838758    2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-8eb165\"/\"rate-test-model-8eb165-kserve-self-signed-certs\""
Jul 15 16:20:17.873174 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:20:17.873145    2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-8eb165/rate-test-model-8eb165-kserve-5f645bc895-gszmw"]
Jul 15 16:20:17.907268 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:20:17.907233    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pvbjg\" (UniqueName: \"kubernetes.io/projected/581fc03b-5a14-4e73-a1f8-b9a26f9e49be-kube-api-access-pvbjg\") pod \"rate-test-model-8eb165-kserve-5f645bc895-gszmw\" (UID: \"581fc03b-5a14-4e73-a1f8-b9a26f9e49be\") " pod="ai-tenant-e2e-shared-b-8eb165/rate-test-model-8eb165-kserve-5f645bc895-gszmw"
Jul 15 16:20:17.907476 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:20:17.907368    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/581fc03b-5a14-4e73-a1f8-b9a26f9e49be-tmp-dir\") pod \"rate-test-model-8eb165-kserve-5f645bc895-gszmw\" (UID: \"581fc03b-5a14-4e73-a1f8-b9a26f9e49be\") " pod="ai-tenant-e2e-shared-b-8eb165/rate-test-model-8eb165-kserve-5f645bc895-gszmw"
Jul 15 16:20:17.907476 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:20:17.907404    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/581fc03b-5a14-4e73-a1f8-b9a26f9e49be-model-cache\") pod \"rate-test-model-8eb165-kserve-5f645bc895-gszmw\" (UID: \"581fc03b-5a14-4e73-a1f8-b9a26f9e49be\") " pod="ai-tenant-e2e-shared-b-8eb165/rate-test-model-8eb165-kserve-5f645bc895-gszmw"
Jul 15 16:20:17.907476 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:20:17.907440    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/581fc03b-5a14-4e73-a1f8-b9a26f9e49be-dshm\") pod \"rate-test-model-8eb165-kserve-5f645bc895-gszmw\" (UID: \"581fc03b-5a14-4e73-a1f8-b9a26f9e49be\") " pod="ai-tenant-e2e-shared-b-8eb165/rate-test-model-8eb165-kserve-5f645bc895-gszmw"
Jul 15 16:20:17.907597 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:20:17.907542    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/581fc03b-5a14-4e73-a1f8-b9a26f9e49be-home\") pod \"rate-test-model-8eb165-kserve-5f645bc895-gszmw\" (UID: \"581fc03b-5a14-4e73-a1f8-b9a26f9e49be\") " pod="ai-tenant-e2e-shared-b-8eb165/rate-test-model-8eb165-kserve-5f645bc895-gszmw"
Jul 15 16:20:17.907597 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:20:17.907579    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/581fc03b-5a14-4e73-a1f8-b9a26f9e49be-tls-certs\") pod \"rate-test-model-8eb165-kserve-5f645bc895-gszmw\" (UID: \"581fc03b-5a14-4e73-a1f8-b9a26f9e49be\") " pod="ai-tenant-e2e-shared-b-8eb165/rate-test-model-8eb165-kserve-5f645bc895-gszmw"
Jul 15 16:20:18.008305 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:20:18.008264    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/581fc03b-5a14-4e73-a1f8-b9a26f9e49be-tmp-dir\") pod \"rate-test-model-8eb165-kserve-5f645bc895-gszmw\" (UID: \"581fc03b-5a14-4e73-a1f8-b9a26f9e49be\") " pod="ai-tenant-e2e-shared-b-8eb165/rate-test-model-8eb165-kserve-5f645bc895-gszmw"
Jul 15 16:20:18.008305 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:20:18.008311    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/581fc03b-5a14-4e73-a1f8-b9a26f9e49be-model-cache\") pod \"rate-test-model-8eb165-kserve-5f645bc895-gszmw\" (UID: \"581fc03b-5a14-4e73-a1f8-b9a26f9e49be\") " pod="ai-tenant-e2e-shared-b-8eb165/rate-test-model-8eb165-kserve-5f645bc895-gszmw"
Jul 15 16:20:18.008577 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:20:18.008367    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/581fc03b-5a14-4e73-a1f8-b9a26f9e49be-dshm\") pod \"rate-test-model-8eb165-kserve-5f645bc895-gszmw\" (UID: \"581fc03b-5a14-4e73-a1f8-b9a26f9e49be\") " pod="ai-tenant-e2e-shared-b-8eb165/rate-test-model-8eb165-kserve-5f645bc895-gszmw"
Jul 15 16:20:18.008577 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:20:18.008391    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/581fc03b-5a14-4e73-a1f8-b9a26f9e49be-home\") pod \"rate-test-model-8eb165-kserve-5f645bc895-gszmw\" (UID: \"581fc03b-5a14-4e73-a1f8-b9a26f9e49be\") " pod="ai-tenant-e2e-shared-b-8eb165/rate-test-model-8eb165-kserve-5f645bc895-gszmw"
Jul 15 16:20:18.008577 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:20:18.008416    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/581fc03b-5a14-4e73-a1f8-b9a26f9e49be-tls-certs\") pod \"rate-test-model-8eb165-kserve-5f645bc895-gszmw\" (UID: \"581fc03b-5a14-4e73-a1f8-b9a26f9e49be\") " pod="ai-tenant-e2e-shared-b-8eb165/rate-test-model-8eb165-kserve-5f645bc895-gszmw"
Jul 15 16:20:18.008577 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:20:18.008446    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pvbjg\" (UniqueName: \"kubernetes.io/projected/581fc03b-5a14-4e73-a1f8-b9a26f9e49be-kube-api-access-pvbjg\") pod \"rate-test-model-8eb165-kserve-5f645bc895-gszmw\" (UID: \"581fc03b-5a14-4e73-a1f8-b9a26f9e49be\") " pod="ai-tenant-e2e-shared-b-8eb165/rate-test-model-8eb165-kserve-5f645bc895-gszmw"
Jul 15 16:20:18.008807 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:20:18.008752    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/581fc03b-5a14-4e73-a1f8-b9a26f9e49be-tmp-dir\") pod \"rate-test-model-8eb165-kserve-5f645bc895-gszmw\" (UID: \"581fc03b-5a14-4e73-a1f8-b9a26f9e49be\") " pod="ai-tenant-e2e-shared-b-8eb165/rate-test-model-8eb165-kserve-5f645bc895-gszmw"
Jul 15 16:20:18.008807 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:20:18.008797    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/581fc03b-5a14-4e73-a1f8-b9a26f9e49be-model-cache\") pod \"rate-test-model-8eb165-kserve-5f645bc895-gszmw\" (UID: \"581fc03b-5a14-4e73-a1f8-b9a26f9e49be\") " pod="ai-tenant-e2e-shared-b-8eb165/rate-test-model-8eb165-kserve-5f645bc895-gszmw"
Jul 15 16:20:18.009159 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:20:18.008856    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/581fc03b-5a14-4e73-a1f8-b9a26f9e49be-home\") pod \"rate-test-model-8eb165-kserve-5f645bc895-gszmw\" (UID: \"581fc03b-5a14-4e73-a1f8-b9a26f9e49be\") " pod="ai-tenant-e2e-shared-b-8eb165/rate-test-model-8eb165-kserve-5f645bc895-gszmw"
Jul 15 16:20:18.010671 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:20:18.010651    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/581fc03b-5a14-4e73-a1f8-b9a26f9e49be-dshm\") pod \"rate-test-model-8eb165-kserve-5f645bc895-gszmw\" (UID: \"581fc03b-5a14-4e73-a1f8-b9a26f9e49be\") " pod="ai-tenant-e2e-shared-b-8eb165/rate-test-model-8eb165-kserve-5f645bc895-gszmw"
Jul 15 16:20:18.010864 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:20:18.010847    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/581fc03b-5a14-4e73-a1f8-b9a26f9e49be-tls-certs\") pod \"rate-test-model-8eb165-kserve-5f645bc895-gszmw\" (UID: \"581fc03b-5a14-4e73-a1f8-b9a26f9e49be\") " pod="ai-tenant-e2e-shared-b-8eb165/rate-test-model-8eb165-kserve-5f645bc895-gszmw"
Jul 15 16:20:18.018691 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:20:18.018668    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pvbjg\" (UniqueName: \"kubernetes.io/projected/581fc03b-5a14-4e73-a1f8-b9a26f9e49be-kube-api-access-pvbjg\") pod \"rate-test-model-8eb165-kserve-5f645bc895-gszmw\" (UID: \"581fc03b-5a14-4e73-a1f8-b9a26f9e49be\") " pod="ai-tenant-e2e-shared-b-8eb165/rate-test-model-8eb165-kserve-5f645bc895-gszmw"
Jul 15 16:20:18.142513 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:20:18.142416    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-8eb165/rate-test-model-8eb165-kserve-5f645bc895-gszmw"
Jul 15 16:20:18.282452 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:20:18.282422    2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-8eb165/rate-test-model-8eb165-kserve-5f645bc895-gszmw"]
Jul 15 16:20:18.283136 ip-10-0-140-212 kubenswrapper[2588]: W0715 16:20:18.283108    2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod581fc03b_5a14_4e73_a1f8_b9a26f9e49be.slice/crio-156ae57ed31204cf5aae868d3e2e36e11927ed9e41d67e38a24b4553d4d40633 WatchSource:0}: Error finding container 156ae57ed31204cf5aae868d3e2e36e11927ed9e41d67e38a24b4553d4d40633: Status 404 returned error can't find the container with id 156ae57ed31204cf5aae868d3e2e36e11927ed9e41d67e38a24b4553d4d40633
Jul 15 16:20:18.295004 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:20:18.294978    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-8eb165/rate-test-model-8eb165-kserve-5f645bc895-gszmw" event={"ID":"581fc03b-5a14-4e73-a1f8-b9a26f9e49be","Type":"ContainerStarted","Data":"156ae57ed31204cf5aae868d3e2e36e11927ed9e41d67e38a24b4553d4d40633"}
Jul 15 16:20:19.302792 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:20:19.302747    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-8eb165/rate-test-model-8eb165-kserve-5f645bc895-gszmw" event={"ID":"581fc03b-5a14-4e73-a1f8-b9a26f9e49be","Type":"ContainerStarted","Data":"73d2e066f851fb9f32f1de0acd480db9d89186be3d653f2200f490bdb3036bc2"}
Jul 15 16:20:19.326709 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:20:19.326658    2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-8eb165/rate-test-model-8eb165-kserve-5f645bc895-gszmw" podStartSLOduration=2.326642741 podStartE2EDuration="2.326642741s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 16:20:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:20:19.324323163 +0000 UTC m=+2704.976388944" watchObservedRunningTime="2026-07-15 16:20:19.326642741 +0000 UTC m=+2704.978708500"
Jul 15 16:20:28.143175 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:20:28.143135    2588 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-8eb165/rate-test-model-8eb165-kserve-5f645bc895-gszmw"
Jul 15 16:20:28.143618 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:20:28.143190    2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-8eb165/rate-test-model-8eb165-kserve-5f645bc895-gszmw"
Jul 15 16:20:28.155430 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:20:28.155404    2588 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-8eb165/rate-test-model-8eb165-kserve-5f645bc895-gszmw"
Jul 15 16:20:28.368979 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:20:28.368949    2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-8eb165/rate-test-model-8eb165-kserve-5f645bc895-gszmw"
Jul 15 16:21:04.084715 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:21:04.084676    2588 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-8eb165/rate-test-model-8eb165-kserve-5f645bc895-gszmw"]
Jul 15 16:21:05.065418 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:21:05.065379    2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7479-140547418675760"]
Jul 15 16:21:05.068549 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:21:05.068531    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7479-140547418675760"
Jul 15 16:21:05.071446 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:21:05.071414    2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-n79n7\""
Jul 15 16:21:05.076188 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:21:05.076162    2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7479-140547418675760"]
Jul 15 16:21:05.221176 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:21:05.221142    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qbdrd\" (UniqueName: \"kubernetes.io/projected/e0480111-f061-4d82-90de-b77859eca4f9-kube-api-access-qbdrd\") pod \"test-curl-7479-140547418675760\" (UID: \"e0480111-f061-4d82-90de-b77859eca4f9\") " pod="opendatahub/test-curl-7479-140547418675760"
Jul 15 16:21:05.322633 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:21:05.322548    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qbdrd\" (UniqueName: \"kubernetes.io/projected/e0480111-f061-4d82-90de-b77859eca4f9-kube-api-access-qbdrd\") pod \"test-curl-7479-140547418675760\" (UID: \"e0480111-f061-4d82-90de-b77859eca4f9\") " pod="opendatahub/test-curl-7479-140547418675760"
Jul 15 16:21:05.331949 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:21:05.331914    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qbdrd\" (UniqueName: \"kubernetes.io/projected/e0480111-f061-4d82-90de-b77859eca4f9-kube-api-access-qbdrd\") pod \"test-curl-7479-140547418675760\" (UID: \"e0480111-f061-4d82-90de-b77859eca4f9\") " pod="opendatahub/test-curl-7479-140547418675760"
Jul 15 16:21:05.379198 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:21:05.379150    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7479-140547418675760"
Jul 15 16:21:05.531197 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:21:05.531164    2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7479-140547418675760"]
Jul 15 16:21:05.535058 ip-10-0-140-212 kubenswrapper[2588]: W0715 16:21:05.535020    2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode0480111_f061_4d82_90de_b77859eca4f9.slice/crio-e4d1bdb55567ffeebeb1bbcc4a870b46b1729bb817f42948d8ceee2fb2fcec34 WatchSource:0}: Error finding container e4d1bdb55567ffeebeb1bbcc4a870b46b1729bb817f42948d8ceee2fb2fcec34: Status 404 returned error can't find the container with id e4d1bdb55567ffeebeb1bbcc4a870b46b1729bb817f42948d8ceee2fb2fcec34
Jul 15 16:21:05.536403 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:21:05.536384    2588 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 15 16:21:05.575079 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:21:05.575005    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7479-140547418675760" event={"ID":"e0480111-f061-4d82-90de-b77859eca4f9","Type":"ContainerStarted","Data":"e4d1bdb55567ffeebeb1bbcc4a870b46b1729bb817f42948d8ceee2fb2fcec34"}
Jul 15 16:21:06.582584 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:21:06.582556    2588 generic.go:356] "Generic (PLEG): container finished" podID="e0480111-f061-4d82-90de-b77859eca4f9" containerID="91281eb32aae4a28dbdf30eb0a91fbf0186a299c8d5278e4d5fdb82fa70eb3e4" exitCode=0
Jul 15 16:21:06.582941 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:21:06.582591    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7479-140547418675760" event={"ID":"e0480111-f061-4d82-90de-b77859eca4f9","Type":"ContainerDied","Data":"91281eb32aae4a28dbdf30eb0a91fbf0186a299c8d5278e4d5fdb82fa70eb3e4"}
Jul 15 16:21:07.718791 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:21:07.718765    2588 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7479-140547418675760"
Jul 15 16:21:07.760547 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:21:07.760520    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7479-140547418675760_e0480111-f061-4d82-90de-b77859eca4f9/test-curl-7479-140547418675760/0.log"
Jul 15 16:21:07.787355 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:21:07.787313    2588 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7479-140547418675760"]
Jul 15 16:21:07.790988 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:21:07.790964    2588 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7479-140547418675760"]
Jul 15 16:21:07.846418 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:21:07.846335    2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qbdrd\" (UniqueName: \"kubernetes.io/projected/e0480111-f061-4d82-90de-b77859eca4f9-kube-api-access-qbdrd\") pod \"e0480111-f061-4d82-90de-b77859eca4f9\" (UID: \"e0480111-f061-4d82-90de-b77859eca4f9\") "
Jul 15 16:21:07.848533 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:21:07.848506    2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e0480111-f061-4d82-90de-b77859eca4f9-kube-api-access-qbdrd" (OuterVolumeSpecName: "kube-api-access-qbdrd") pod "e0480111-f061-4d82-90de-b77859eca4f9" (UID: "e0480111-f061-4d82-90de-b77859eca4f9"). InnerVolumeSpecName "kube-api-access-qbdrd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 16:21:07.914890 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:21:07.914863    2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7479-140547418759856"]
Jul 15 16:21:07.915230 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:21:07.915218    2588 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e0480111-f061-4d82-90de-b77859eca4f9" containerName="test-curl-7479-140547418675760"
Jul 15 16:21:07.915277 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:21:07.915232    2588 state_mem.go:107] "Deleted CPUSet assignment" podUID="e0480111-f061-4d82-90de-b77859eca4f9" containerName="test-curl-7479-140547418675760"
Jul 15 16:21:07.915323 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:21:07.915313    2588 memory_manager.go:368] "RemoveStaleState removing state" podUID="e0480111-f061-4d82-90de-b77859eca4f9" containerName="test-curl-7479-140547418675760"
Jul 15 16:21:07.921822 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:21:07.921799    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7479-140547418759856"
Jul 15 16:21:07.924864 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:21:07.924838    2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7479-140547418759856"]
Jul 15 16:21:07.947170 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:21:07.947142    2588 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qbdrd\" (UniqueName: \"kubernetes.io/projected/e0480111-f061-4d82-90de-b77859eca4f9-kube-api-access-qbdrd\") on node \"ip-10-0-140-212.ec2.internal\" DevicePath \"\""
Jul 15 16:21:08.048149 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:21:08.048120    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bhkc7\" (UniqueName: \"kubernetes.io/projected/f0919a12-306a-4b91-afdd-d00d994420f8-kube-api-access-bhkc7\") pod \"test-curl-7479-140547418759856\" (UID: \"f0919a12-306a-4b91-afdd-d00d994420f8\") " pod="opendatahub/test-curl-7479-140547418759856"
Jul 15 16:21:08.148861 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:21:08.148784    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bhkc7\" (UniqueName: \"kubernetes.io/projected/f0919a12-306a-4b91-afdd-d00d994420f8-kube-api-access-bhkc7\") pod \"test-curl-7479-140547418759856\" (UID: \"f0919a12-306a-4b91-afdd-d00d994420f8\") " pod="opendatahub/test-curl-7479-140547418759856"
Jul 15 16:21:08.157820 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:21:08.157794    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bhkc7\" (UniqueName: \"kubernetes.io/projected/f0919a12-306a-4b91-afdd-d00d994420f8-kube-api-access-bhkc7\") pod \"test-curl-7479-140547418759856\" (UID: \"f0919a12-306a-4b91-afdd-d00d994420f8\") " pod="opendatahub/test-curl-7479-140547418759856"
Jul 15 16:21:08.232927 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:21:08.232903    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7479-140547418759856"
Jul 15 16:21:08.373008 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:21:08.372986    2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7479-140547418759856"]
Jul 15 16:21:08.375546 ip-10-0-140-212 kubenswrapper[2588]: W0715 16:21:08.375516    2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf0919a12_306a_4b91_afdd_d00d994420f8.slice/crio-99301d333972f9321373207da458e5f89707de375225121dc4e5a759f33610bf WatchSource:0}: Error finding container 99301d333972f9321373207da458e5f89707de375225121dc4e5a759f33610bf: Status 404 returned error can't find the container with id 99301d333972f9321373207da458e5f89707de375225121dc4e5a759f33610bf
Jul 15 16:21:08.595269 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:21:08.595230    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7479-140547418759856" event={"ID":"f0919a12-306a-4b91-afdd-d00d994420f8","Type":"ContainerStarted","Data":"99301d333972f9321373207da458e5f89707de375225121dc4e5a759f33610bf"}
Jul 15 16:21:08.596478 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:21:08.596458    2588 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e4d1bdb55567ffeebeb1bbcc4a870b46b1729bb817f42948d8ceee2fb2fcec34"
Jul 15 16:21:08.596591 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:21:08.596492    2588 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7479-140547418675760"
Jul 15 16:21:08.607465 ip-10-0-140-212 kubenswrapper[2588]: E0715 16:21:08.607438    2588 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7479-140547418675760\" is forbidden: User \"system:node:ip-10-0-140-212.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-140-212.ec2.internal' and this object" podUID="e0480111-f061-4d82-90de-b77859eca4f9" pod="opendatahub/test-curl-7479-140547418675760"
Jul 15 16:21:08.910984 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:21:08.910949    2588 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e0480111-f061-4d82-90de-b77859eca4f9" path="/var/lib/kubelet/pods/e0480111-f061-4d82-90de-b77859eca4f9/volumes"
Jul 15 16:21:09.604059 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:21:09.604006    2588 generic.go:356] "Generic (PLEG): container finished" podID="f0919a12-306a-4b91-afdd-d00d994420f8" containerID="c400ed5c20e6c7fa5c2b8404cf35920a0d76d2450dc777a043a79a5d1065288a" exitCode=0
Jul 15 16:21:09.604228 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:21:09.604095    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7479-140547418759856" event={"ID":"f0919a12-306a-4b91-afdd-d00d994420f8","Type":"ContainerDied","Data":"c400ed5c20e6c7fa5c2b8404cf35920a0d76d2450dc777a043a79a5d1065288a"}
Jul 15 16:21:10.748449 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:21:10.748425    2588 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7479-140547418759856"
Jul 15 16:21:10.770446 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:21:10.770407    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7479-140547418759856_f0919a12-306a-4b91-afdd-d00d994420f8/test-curl-7479-140547418759856/0.log"
Jul 15 16:21:10.796746 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:21:10.796712    2588 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7479-140547418759856"]
Jul 15 16:21:10.800391 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:21:10.800366    2588 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7479-140547418759856"]
Jul 15 16:21:10.871821 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:21:10.871731    2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bhkc7\" (UniqueName: \"kubernetes.io/projected/f0919a12-306a-4b91-afdd-d00d994420f8-kube-api-access-bhkc7\") pod \"f0919a12-306a-4b91-afdd-d00d994420f8\" (UID: \"f0919a12-306a-4b91-afdd-d00d994420f8\") "
Jul 15 16:21:10.873787 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:21:10.873760    2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f0919a12-306a-4b91-afdd-d00d994420f8-kube-api-access-bhkc7" (OuterVolumeSpecName: "kube-api-access-bhkc7") pod "f0919a12-306a-4b91-afdd-d00d994420f8" (UID: "f0919a12-306a-4b91-afdd-d00d994420f8"). InnerVolumeSpecName "kube-api-access-bhkc7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 16:21:10.911155 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:21:10.911114    2588 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f0919a12-306a-4b91-afdd-d00d994420f8" path="/var/lib/kubelet/pods/f0919a12-306a-4b91-afdd-d00d994420f8/volumes"
Jul 15 16:21:10.965121 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:21:10.965091    2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7479-140547418746928"]
Jul 15 16:21:10.965462 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:21:10.965448    2588 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f0919a12-306a-4b91-afdd-d00d994420f8" containerName="test-curl-7479-140547418759856"
Jul 15 16:21:10.965518 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:21:10.965463    2588 state_mem.go:107] "Deleted CPUSet assignment" podUID="f0919a12-306a-4b91-afdd-d00d994420f8" containerName="test-curl-7479-140547418759856"
Jul 15 16:21:10.965550 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:21:10.965522    2588 memory_manager.go:368] "RemoveStaleState removing state" podUID="f0919a12-306a-4b91-afdd-d00d994420f8" containerName="test-curl-7479-140547418759856"
Jul 15 16:21:10.968631 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:21:10.968615    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7479-140547418746928"
Jul 15 16:21:10.972616 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:21:10.972590    2588 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bhkc7\" (UniqueName: \"kubernetes.io/projected/f0919a12-306a-4b91-afdd-d00d994420f8-kube-api-access-bhkc7\") on node \"ip-10-0-140-212.ec2.internal\" DevicePath \"\""
Jul 15 16:21:10.977462 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:21:10.977437    2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7479-140547418746928"]
Jul 15 16:21:11.073328 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:21:11.073295    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qbvrz\" (UniqueName: \"kubernetes.io/projected/48f796d2-010c-42d9-94d9-d3e91995180f-kube-api-access-qbvrz\") pod \"test-curl-7479-140547418746928\" (UID: \"48f796d2-010c-42d9-94d9-d3e91995180f\") " pod="opendatahub/test-curl-7479-140547418746928"
Jul 15 16:21:11.174440 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:21:11.174354    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qbvrz\" (UniqueName: \"kubernetes.io/projected/48f796d2-010c-42d9-94d9-d3e91995180f-kube-api-access-qbvrz\") pod \"test-curl-7479-140547418746928\" (UID: \"48f796d2-010c-42d9-94d9-d3e91995180f\") " pod="opendatahub/test-curl-7479-140547418746928"
Jul 15 16:21:11.183192 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:21:11.183169    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qbvrz\" (UniqueName: \"kubernetes.io/projected/48f796d2-010c-42d9-94d9-d3e91995180f-kube-api-access-qbvrz\") pod \"test-curl-7479-140547418746928\" (UID: \"48f796d2-010c-42d9-94d9-d3e91995180f\") " pod="opendatahub/test-curl-7479-140547418746928"
Jul 15 16:21:11.278365 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:21:11.278308    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7479-140547418746928"
Jul 15 16:21:11.413001 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:21:11.412974    2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7479-140547418746928"]
Jul 15 16:21:11.413892 ip-10-0-140-212 kubenswrapper[2588]: W0715 16:21:11.413858    2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod48f796d2_010c_42d9_94d9_d3e91995180f.slice/crio-b28806ad7483e8ae4fce192118e6fe3ff9d6f72ad45dc2b665c35a709ad712bf WatchSource:0}: Error finding container b28806ad7483e8ae4fce192118e6fe3ff9d6f72ad45dc2b665c35a709ad712bf: Status 404 returned error can't find the container with id b28806ad7483e8ae4fce192118e6fe3ff9d6f72ad45dc2b665c35a709ad712bf
Jul 15 16:21:11.617609 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:21:11.617582    2588 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7479-140547418759856"
Jul 15 16:21:11.617790 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:21:11.617642    2588 scope.go:117] "RemoveContainer" containerID="c400ed5c20e6c7fa5c2b8404cf35920a0d76d2450dc777a043a79a5d1065288a"
Jul 15 16:21:11.619026 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:21:11.619003    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7479-140547418746928" event={"ID":"48f796d2-010c-42d9-94d9-d3e91995180f","Type":"ContainerStarted","Data":"b28806ad7483e8ae4fce192118e6fe3ff9d6f72ad45dc2b665c35a709ad712bf"}
Jul 15 16:21:12.632615 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:21:12.632569    2588 generic.go:356] "Generic (PLEG): container finished" podID="48f796d2-010c-42d9-94d9-d3e91995180f" containerID="9c85c21779cba02a867c0746d93c896b916cf013aa637c29f111ebb749d77dd5" exitCode=0
Jul 15 16:21:12.632978 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:21:12.632668    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7479-140547418746928" event={"ID":"48f796d2-010c-42d9-94d9-d3e91995180f","Type":"ContainerDied","Data":"9c85c21779cba02a867c0746d93c896b916cf013aa637c29f111ebb749d77dd5"}
Jul 15 16:21:13.772320 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:21:13.772295    2588 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7479-140547418746928"
Jul 15 16:21:13.792768 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:21:13.792737    2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qbvrz\" (UniqueName: \"kubernetes.io/projected/48f796d2-010c-42d9-94d9-d3e91995180f-kube-api-access-qbvrz\") pod \"48f796d2-010c-42d9-94d9-d3e91995180f\" (UID: \"48f796d2-010c-42d9-94d9-d3e91995180f\") "
Jul 15 16:21:13.795260 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:21:13.795233    2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/48f796d2-010c-42d9-94d9-d3e91995180f-kube-api-access-qbvrz" (OuterVolumeSpecName: "kube-api-access-qbvrz") pod "48f796d2-010c-42d9-94d9-d3e91995180f" (UID: "48f796d2-010c-42d9-94d9-d3e91995180f"). InnerVolumeSpecName "kube-api-access-qbvrz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 16:21:13.797709 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:21:13.797678    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7479-140547418746928_48f796d2-010c-42d9-94d9-d3e91995180f/test-curl-7479-140547418746928/0.log"
Jul 15 16:21:13.826032 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:21:13.826001    2588 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7479-140547418746928"]
Jul 15 16:21:13.830418 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:21:13.830391    2588 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7479-140547418746928"]
Jul 15 16:21:13.893565 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:21:13.893492    2588 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qbvrz\" (UniqueName: \"kubernetes.io/projected/48f796d2-010c-42d9-94d9-d3e91995180f-kube-api-access-qbvrz\") on node \"ip-10-0-140-212.ec2.internal\" DevicePath \"\""
Jul 15 16:21:13.956168 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:21:13.956128    2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7479-140547418746928"]
Jul 15 16:21:13.956592 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:21:13.956573    2588 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="48f796d2-010c-42d9-94d9-d3e91995180f" containerName="test-curl-7479-140547418746928"
Jul 15 16:21:13.956708 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:21:13.956594    2588 state_mem.go:107] "Deleted CPUSet assignment" podUID="48f796d2-010c-42d9-94d9-d3e91995180f" containerName="test-curl-7479-140547418746928"
Jul 15 16:21:13.956708 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:21:13.956694    2588 memory_manager.go:368] "RemoveStaleState removing state" podUID="48f796d2-010c-42d9-94d9-d3e91995180f" containerName="test-curl-7479-140547418746928"
Jul 15 16:21:13.959846 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:21:13.959824    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7479-140547418746928"
Jul 15 16:21:13.967574 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:21:13.967542    2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7479-140547418746928"]
Jul 15 16:21:13.994318 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:21:13.994287    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5rc55\" (UniqueName: \"kubernetes.io/projected/9bc252e3-c851-4583-bf8a-13cb18bf8ccb-kube-api-access-5rc55\") pod \"test-curl-7479-140547418746928\" (UID: \"9bc252e3-c851-4583-bf8a-13cb18bf8ccb\") " pod="opendatahub/test-curl-7479-140547418746928"
Jul 15 16:21:14.094864 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:21:14.094831    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5rc55\" (UniqueName: \"kubernetes.io/projected/9bc252e3-c851-4583-bf8a-13cb18bf8ccb-kube-api-access-5rc55\") pod \"test-curl-7479-140547418746928\" (UID: \"9bc252e3-c851-4583-bf8a-13cb18bf8ccb\") " pod="opendatahub/test-curl-7479-140547418746928"
Jul 15 16:21:14.104435 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:21:14.104417    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5rc55\" (UniqueName: \"kubernetes.io/projected/9bc252e3-c851-4583-bf8a-13cb18bf8ccb-kube-api-access-5rc55\") pod \"test-curl-7479-140547418746928\" (UID: \"9bc252e3-c851-4583-bf8a-13cb18bf8ccb\") " pod="opendatahub/test-curl-7479-140547418746928"
Jul 15 16:21:14.270646 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:21:14.270556    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7479-140547418746928"
Jul 15 16:21:14.410250 ip-10-0-140-212 kubenswrapper[2588]: W0715 16:21:14.410223    2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9bc252e3_c851_4583_bf8a_13cb18bf8ccb.slice/crio-6ea3269b8e7f4c172f6c9b06d5ce4c2234036efe76d403a8c20b0bb06cce1078 WatchSource:0}: Error finding container 6ea3269b8e7f4c172f6c9b06d5ce4c2234036efe76d403a8c20b0bb06cce1078: Status 404 returned error can't find the container with id 6ea3269b8e7f4c172f6c9b06d5ce4c2234036efe76d403a8c20b0bb06cce1078
Jul 15 16:21:14.410549 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:21:14.410527    2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7479-140547418746928"]
Jul 15 16:21:14.647028 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:21:14.646979    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7479-140547418746928" event={"ID":"9bc252e3-c851-4583-bf8a-13cb18bf8ccb","Type":"ContainerStarted","Data":"6ea3269b8e7f4c172f6c9b06d5ce4c2234036efe76d403a8c20b0bb06cce1078"}
Jul 15 16:21:14.648186 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:21:14.648162    2588 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7479-140547418746928"
Jul 15 16:21:14.648186 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:21:14.648181    2588 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b28806ad7483e8ae4fce192118e6fe3ff9d6f72ad45dc2b665c35a709ad712bf"
Jul 15 16:21:14.660672 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:21:14.660642    2588 status_manager.go:1027] "Pod was deleted and then recreated, skipping status update" pod="opendatahub/test-curl-7479-140547418746928" oldPodUID="48f796d2-010c-42d9-94d9-d3e91995180f" podUID="9bc252e3-c851-4583-bf8a-13cb18bf8ccb"
Jul 15 16:21:14.911738 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:21:14.911645    2588 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="48f796d2-010c-42d9-94d9-d3e91995180f" path="/var/lib/kubelet/pods/48f796d2-010c-42d9-94d9-d3e91995180f/volumes"
Jul 15 16:21:15.185525 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:21:15.185440    2588 scope.go:117] "RemoveContainer" containerID="f0754d9d8babe2e2ec279d3108fc95c8f741b1ea6521c7ef4bfdfe69f51e6ad1"
Jul 15 16:21:15.655921 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:21:15.655880    2588 generic.go:356] "Generic (PLEG): container finished" podID="9bc252e3-c851-4583-bf8a-13cb18bf8ccb" containerID="d586c33b2e557c68c0662430fcd1abf68ee3aba1f17aee8d10f369e800cadb1f" exitCode=0
Jul 15 16:21:15.656096 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:21:15.655960    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7479-140547418746928" event={"ID":"9bc252e3-c851-4583-bf8a-13cb18bf8ccb","Type":"ContainerDied","Data":"d586c33b2e557c68c0662430fcd1abf68ee3aba1f17aee8d10f369e800cadb1f"}
Jul 15 16:21:16.796561 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:21:16.796534    2588 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7479-140547418746928"
Jul 15 16:21:16.818255 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:21:16.818225    2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5rc55\" (UniqueName: \"kubernetes.io/projected/9bc252e3-c851-4583-bf8a-13cb18bf8ccb-kube-api-access-5rc55\") pod \"9bc252e3-c851-4583-bf8a-13cb18bf8ccb\" (UID: \"9bc252e3-c851-4583-bf8a-13cb18bf8ccb\") "
Jul 15 16:21:16.820310 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:21:16.820278    2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9bc252e3-c851-4583-bf8a-13cb18bf8ccb-kube-api-access-5rc55" (OuterVolumeSpecName: "kube-api-access-5rc55") pod "9bc252e3-c851-4583-bf8a-13cb18bf8ccb" (UID: "9bc252e3-c851-4583-bf8a-13cb18bf8ccb"). InnerVolumeSpecName "kube-api-access-5rc55". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 16:21:16.827723 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:21:16.827703    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7479-140547418746928_9bc252e3-c851-4583-bf8a-13cb18bf8ccb/test-curl-7479-140547418746928/0.log"
Jul 15 16:21:16.864754 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:21:16.864728    2588 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7479-140547418746928"]
Jul 15 16:21:16.869612 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:21:16.869591    2588 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7479-140547418746928"]
Jul 15 16:21:16.910294 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:21:16.910267    2588 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9bc252e3-c851-4583-bf8a-13cb18bf8ccb" path="/var/lib/kubelet/pods/9bc252e3-c851-4583-bf8a-13cb18bf8ccb/volumes"
Jul 15 16:21:16.919534 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:21:16.919514    2588 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5rc55\" (UniqueName: \"kubernetes.io/projected/9bc252e3-c851-4583-bf8a-13cb18bf8ccb-kube-api-access-5rc55\") on node \"ip-10-0-140-212.ec2.internal\" DevicePath \"\""
Jul 15 16:21:17.021028 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:21:17.020996    2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7479-140547418747936"]
Jul 15 16:21:17.021383 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:21:17.021369    2588 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9bc252e3-c851-4583-bf8a-13cb18bf8ccb" containerName="test-curl-7479-140547418746928"
Jul 15 16:21:17.021383 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:21:17.021384    2588 state_mem.go:107] "Deleted CPUSet assignment" podUID="9bc252e3-c851-4583-bf8a-13cb18bf8ccb" containerName="test-curl-7479-140547418746928"
Jul 15 16:21:17.021485 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:21:17.021449    2588 memory_manager.go:368] "RemoveStaleState removing state" podUID="9bc252e3-c851-4583-bf8a-13cb18bf8ccb" containerName="test-curl-7479-140547418746928"
Jul 15 16:21:17.024477 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:21:17.024461    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7479-140547418747936"
Jul 15 16:21:17.046778 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:21:17.046751    2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7479-140547418747936"]
Jul 15 16:21:17.120841 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:21:17.120812    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lzh5r\" (UniqueName: \"kubernetes.io/projected/d0a804e0-1ea4-4435-b8b1-738e19f8861c-kube-api-access-lzh5r\") pod \"test-curl-7479-140547418747936\" (UID: \"d0a804e0-1ea4-4435-b8b1-738e19f8861c\") " pod="opendatahub/test-curl-7479-140547418747936"
Jul 15 16:21:17.221445 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:21:17.221336    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lzh5r\" (UniqueName: \"kubernetes.io/projected/d0a804e0-1ea4-4435-b8b1-738e19f8861c-kube-api-access-lzh5r\") pod \"test-curl-7479-140547418747936\" (UID: \"d0a804e0-1ea4-4435-b8b1-738e19f8861c\") " pod="opendatahub/test-curl-7479-140547418747936"
Jul 15 16:21:17.233580 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:21:17.233550    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lzh5r\" (UniqueName: \"kubernetes.io/projected/d0a804e0-1ea4-4435-b8b1-738e19f8861c-kube-api-access-lzh5r\") pod \"test-curl-7479-140547418747936\" (UID: \"d0a804e0-1ea4-4435-b8b1-738e19f8861c\") " pod="opendatahub/test-curl-7479-140547418747936"
Jul 15 16:21:17.332995 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:21:17.332953    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7479-140547418747936"
Jul 15 16:21:17.478403 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:21:17.478373    2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7479-140547418747936"]
Jul 15 16:21:17.479735 ip-10-0-140-212 kubenswrapper[2588]: W0715 16:21:17.479704    2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd0a804e0_1ea4_4435_b8b1_738e19f8861c.slice/crio-0a7ace54ece600635009bb90277cad2482ebbf964ef3c5d43bc5c92a43cf133b WatchSource:0}: Error finding container 0a7ace54ece600635009bb90277cad2482ebbf964ef3c5d43bc5c92a43cf133b: Status 404 returned error can't find the container with id 0a7ace54ece600635009bb90277cad2482ebbf964ef3c5d43bc5c92a43cf133b
Jul 15 16:21:17.670102 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:21:17.670070    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7479-140547418747936" event={"ID":"d0a804e0-1ea4-4435-b8b1-738e19f8861c","Type":"ContainerStarted","Data":"0a7ace54ece600635009bb90277cad2482ebbf964ef3c5d43bc5c92a43cf133b"}
Jul 15 16:21:17.671298 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:21:17.671277    2588 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7479-140547418746928"
Jul 15 16:21:17.671432 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:21:17.671329    2588 scope.go:117] "RemoveContainer" containerID="d586c33b2e557c68c0662430fcd1abf68ee3aba1f17aee8d10f369e800cadb1f"
Jul 15 16:21:18.678742 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:21:18.678713    2588 generic.go:356] "Generic (PLEG): container finished" podID="d0a804e0-1ea4-4435-b8b1-738e19f8861c" containerID="cc3e9d567318c6d3ae90d71c236ec01398c85591941e7567cf2e67827f394e9b" exitCode=0
Jul 15 16:21:18.679166 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:21:18.678809    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7479-140547418747936" event={"ID":"d0a804e0-1ea4-4435-b8b1-738e19f8861c","Type":"ContainerDied","Data":"cc3e9d567318c6d3ae90d71c236ec01398c85591941e7567cf2e67827f394e9b"}
Jul 15 16:21:19.104949 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:21:19.104914    2588 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-8eb165/rate-test-model-8eb165-kserve-5f645bc895-gszmw" podUID="581fc03b-5a14-4e73-a1f8-b9a26f9e49be" containerName="main" containerID="cri-o://73d2e066f851fb9f32f1de0acd480db9d89186be3d653f2200f490bdb3036bc2" gracePeriod=45
Jul 15 16:21:19.358058 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:21:19.358002    2588 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-8eb165/rate-test-model-8eb165-kserve-5f645bc895-gszmw"
Jul 15 16:21:19.437235 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:21:19.437201    2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/581fc03b-5a14-4e73-a1f8-b9a26f9e49be-tls-certs\") pod \"581fc03b-5a14-4e73-a1f8-b9a26f9e49be\" (UID: \"581fc03b-5a14-4e73-a1f8-b9a26f9e49be\") "
Jul 15 16:21:19.437498 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:21:19.437247    2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/581fc03b-5a14-4e73-a1f8-b9a26f9e49be-model-cache\") pod \"581fc03b-5a14-4e73-a1f8-b9a26f9e49be\" (UID: \"581fc03b-5a14-4e73-a1f8-b9a26f9e49be\") "
Jul 15 16:21:19.437498 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:21:19.437270    2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pvbjg\" (UniqueName: \"kubernetes.io/projected/581fc03b-5a14-4e73-a1f8-b9a26f9e49be-kube-api-access-pvbjg\") pod \"581fc03b-5a14-4e73-a1f8-b9a26f9e49be\" (UID: \"581fc03b-5a14-4e73-a1f8-b9a26f9e49be\") "
Jul 15 16:21:19.437498 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:21:19.437299    2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/581fc03b-5a14-4e73-a1f8-b9a26f9e49be-tmp-dir\") pod \"581fc03b-5a14-4e73-a1f8-b9a26f9e49be\" (UID: \"581fc03b-5a14-4e73-a1f8-b9a26f9e49be\") "
Jul 15 16:21:19.437498 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:21:19.437318    2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/581fc03b-5a14-4e73-a1f8-b9a26f9e49be-dshm\") pod \"581fc03b-5a14-4e73-a1f8-b9a26f9e49be\" (UID: \"581fc03b-5a14-4e73-a1f8-b9a26f9e49be\") "
Jul 15 16:21:19.437498 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:21:19.437334    2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/581fc03b-5a14-4e73-a1f8-b9a26f9e49be-home\") pod \"581fc03b-5a14-4e73-a1f8-b9a26f9e49be\" (UID: \"581fc03b-5a14-4e73-a1f8-b9a26f9e49be\") "
Jul 15 16:21:19.437748 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:21:19.437555    2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/581fc03b-5a14-4e73-a1f8-b9a26f9e49be-model-cache" (OuterVolumeSpecName: "model-cache") pod "581fc03b-5a14-4e73-a1f8-b9a26f9e49be" (UID: "581fc03b-5a14-4e73-a1f8-b9a26f9e49be"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 16:21:19.437748 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:21:19.437602    2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/581fc03b-5a14-4e73-a1f8-b9a26f9e49be-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "581fc03b-5a14-4e73-a1f8-b9a26f9e49be" (UID: "581fc03b-5a14-4e73-a1f8-b9a26f9e49be"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 16:21:19.437748 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:21:19.437695    2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/581fc03b-5a14-4e73-a1f8-b9a26f9e49be-home" (OuterVolumeSpecName: "home") pod "581fc03b-5a14-4e73-a1f8-b9a26f9e49be" (UID: "581fc03b-5a14-4e73-a1f8-b9a26f9e49be"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 16:21:19.439639 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:21:19.439618    2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/581fc03b-5a14-4e73-a1f8-b9a26f9e49be-dshm" (OuterVolumeSpecName: "dshm") pod "581fc03b-5a14-4e73-a1f8-b9a26f9e49be" (UID: "581fc03b-5a14-4e73-a1f8-b9a26f9e49be"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 16:21:19.439639 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:21:19.439625    2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/581fc03b-5a14-4e73-a1f8-b9a26f9e49be-kube-api-access-pvbjg" (OuterVolumeSpecName: "kube-api-access-pvbjg") pod "581fc03b-5a14-4e73-a1f8-b9a26f9e49be" (UID: "581fc03b-5a14-4e73-a1f8-b9a26f9e49be"). InnerVolumeSpecName "kube-api-access-pvbjg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 16:21:19.439747 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:21:19.439640    2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/581fc03b-5a14-4e73-a1f8-b9a26f9e49be-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "581fc03b-5a14-4e73-a1f8-b9a26f9e49be" (UID: "581fc03b-5a14-4e73-a1f8-b9a26f9e49be"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 16:21:19.538576 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:21:19.538544    2588 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/581fc03b-5a14-4e73-a1f8-b9a26f9e49be-tls-certs\") on node \"ip-10-0-140-212.ec2.internal\" DevicePath \"\""
Jul 15 16:21:19.538576 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:21:19.538570    2588 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/581fc03b-5a14-4e73-a1f8-b9a26f9e49be-model-cache\") on node \"ip-10-0-140-212.ec2.internal\" DevicePath \"\""
Jul 15 16:21:19.538576 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:21:19.538580    2588 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pvbjg\" (UniqueName: \"kubernetes.io/projected/581fc03b-5a14-4e73-a1f8-b9a26f9e49be-kube-api-access-pvbjg\") on node \"ip-10-0-140-212.ec2.internal\" DevicePath \"\""
Jul 15 16:21:19.538765 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:21:19.538589    2588 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/581fc03b-5a14-4e73-a1f8-b9a26f9e49be-tmp-dir\") on node \"ip-10-0-140-212.ec2.internal\" DevicePath \"\""
Jul 15 16:21:19.538765 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:21:19.538598    2588 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/581fc03b-5a14-4e73-a1f8-b9a26f9e49be-dshm\") on node \"ip-10-0-140-212.ec2.internal\" DevicePath \"\""
Jul 15 16:21:19.538765 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:21:19.538606    2588 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/581fc03b-5a14-4e73-a1f8-b9a26f9e49be-home\") on node \"ip-10-0-140-212.ec2.internal\" DevicePath \"\""
Jul 15 16:21:19.688434 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:21:19.688212    2588 generic.go:356] "Generic (PLEG): container finished" podID="581fc03b-5a14-4e73-a1f8-b9a26f9e49be" containerID="73d2e066f851fb9f32f1de0acd480db9d89186be3d653f2200f490bdb3036bc2" exitCode=0
Jul 15 16:21:19.688997 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:21:19.688975    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-8eb165/rate-test-model-8eb165-kserve-5f645bc895-gszmw" event={"ID":"581fc03b-5a14-4e73-a1f8-b9a26f9e49be","Type":"ContainerDied","Data":"73d2e066f851fb9f32f1de0acd480db9d89186be3d653f2200f490bdb3036bc2"}
Jul 15 16:21:19.689163 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:21:19.689147    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-8eb165/rate-test-model-8eb165-kserve-5f645bc895-gszmw" event={"ID":"581fc03b-5a14-4e73-a1f8-b9a26f9e49be","Type":"ContainerDied","Data":"156ae57ed31204cf5aae868d3e2e36e11927ed9e41d67e38a24b4553d4d40633"}
Jul 15 16:21:19.689262 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:21:19.689243    2588 scope.go:117] "RemoveContainer" containerID="73d2e066f851fb9f32f1de0acd480db9d89186be3d653f2200f490bdb3036bc2"
Jul 15 16:21:19.689369 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:21:19.689271    2588 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-8eb165/rate-test-model-8eb165-kserve-5f645bc895-gszmw"
Jul 15 16:21:19.699799 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:21:19.699778    2588 scope.go:117] "RemoveContainer" containerID="73d2e066f851fb9f32f1de0acd480db9d89186be3d653f2200f490bdb3036bc2"
Jul 15 16:21:19.700091 ip-10-0-140-212 kubenswrapper[2588]: E0715 16:21:19.700071    2588 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"73d2e066f851fb9f32f1de0acd480db9d89186be3d653f2200f490bdb3036bc2\": container with ID starting with 73d2e066f851fb9f32f1de0acd480db9d89186be3d653f2200f490bdb3036bc2 not found: ID does not exist" containerID="73d2e066f851fb9f32f1de0acd480db9d89186be3d653f2200f490bdb3036bc2"
Jul 15 16:21:19.700155 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:21:19.700100    2588 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"73d2e066f851fb9f32f1de0acd480db9d89186be3d653f2200f490bdb3036bc2"} err="failed to get container status \"73d2e066f851fb9f32f1de0acd480db9d89186be3d653f2200f490bdb3036bc2\": rpc error: code = NotFound desc = could not find container \"73d2e066f851fb9f32f1de0acd480db9d89186be3d653f2200f490bdb3036bc2\": container with ID starting with 73d2e066f851fb9f32f1de0acd480db9d89186be3d653f2200f490bdb3036bc2 not found: ID does not exist"
Jul 15 16:21:19.713177 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:21:19.713149    2588 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-8eb165/rate-test-model-8eb165-kserve-5f645bc895-gszmw"]
Jul 15 16:21:19.717795 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:21:19.717769    2588 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-8eb165/rate-test-model-8eb165-kserve-5f645bc895-gszmw"]
Jul 15 16:21:19.825605 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:21:19.825577    2588 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7479-140547418747936"
Jul 15 16:21:19.840060 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:21:19.840039    2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lzh5r\" (UniqueName: \"kubernetes.io/projected/d0a804e0-1ea4-4435-b8b1-738e19f8861c-kube-api-access-lzh5r\") pod \"d0a804e0-1ea4-4435-b8b1-738e19f8861c\" (UID: \"d0a804e0-1ea4-4435-b8b1-738e19f8861c\") "
Jul 15 16:21:19.841919 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:21:19.841899    2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d0a804e0-1ea4-4435-b8b1-738e19f8861c-kube-api-access-lzh5r" (OuterVolumeSpecName: "kube-api-access-lzh5r") pod "d0a804e0-1ea4-4435-b8b1-738e19f8861c" (UID: "d0a804e0-1ea4-4435-b8b1-738e19f8861c"). InnerVolumeSpecName "kube-api-access-lzh5r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 16:21:19.857677 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:21:19.857650    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7479-140547418747936_d0a804e0-1ea4-4435-b8b1-738e19f8861c/test-curl-7479-140547418747936/0.log"
Jul 15 16:21:19.906819 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:21:19.906794    2588 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7479-140547418747936"]
Jul 15 16:21:19.914781 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:21:19.914758    2588 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7479-140547418747936"]
Jul 15 16:21:19.941113 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:21:19.941056    2588 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lzh5r\" (UniqueName: \"kubernetes.io/projected/d0a804e0-1ea4-4435-b8b1-738e19f8861c-kube-api-access-lzh5r\") on node \"ip-10-0-140-212.ec2.internal\" DevicePath \"\""
Jul 15 16:21:20.052652 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:21:20.052624    2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7479-140547418747936"]
Jul 15 16:21:20.052990 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:21:20.052977    2588 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d0a804e0-1ea4-4435-b8b1-738e19f8861c" containerName="test-curl-7479-140547418747936"
Jul 15 16:21:20.053028 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:21:20.052991    2588 state_mem.go:107] "Deleted CPUSet assignment" podUID="d0a804e0-1ea4-4435-b8b1-738e19f8861c" containerName="test-curl-7479-140547418747936"
Jul 15 16:21:20.053028 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:21:20.053006    2588 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="581fc03b-5a14-4e73-a1f8-b9a26f9e49be" containerName="main"
Jul 15 16:21:20.053028 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:21:20.053011    2588 state_mem.go:107] "Deleted CPUSet assignment" podUID="581fc03b-5a14-4e73-a1f8-b9a26f9e49be" containerName="main"
Jul 15 16:21:20.053133 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:21:20.053071    2588 memory_manager.go:368] "RemoveStaleState removing state" podUID="581fc03b-5a14-4e73-a1f8-b9a26f9e49be" containerName="main"
Jul 15 16:21:20.053133 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:21:20.053081    2588 memory_manager.go:368] "RemoveStaleState removing state" podUID="d0a804e0-1ea4-4435-b8b1-738e19f8861c" containerName="test-curl-7479-140547418747936"
Jul 15 16:21:20.056092 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:21:20.056077    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7479-140547418747936"
Jul 15 16:21:20.065433 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:21:20.065407    2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7479-140547418747936"]
Jul 15 16:21:20.142804 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:21:20.142768    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hcjxf\" (UniqueName: \"kubernetes.io/projected/1a036a2e-44d4-4061-8a1b-832c8cc4a8b9-kube-api-access-hcjxf\") pod \"test-curl-7479-140547418747936\" (UID: \"1a036a2e-44d4-4061-8a1b-832c8cc4a8b9\") " pod="opendatahub/test-curl-7479-140547418747936"
Jul 15 16:21:20.244317 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:21:20.244234    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hcjxf\" (UniqueName: \"kubernetes.io/projected/1a036a2e-44d4-4061-8a1b-832c8cc4a8b9-kube-api-access-hcjxf\") pod \"test-curl-7479-140547418747936\" (UID: \"1a036a2e-44d4-4061-8a1b-832c8cc4a8b9\") " pod="opendatahub/test-curl-7479-140547418747936"
Jul 15 16:21:20.253690 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:21:20.253664    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hcjxf\" (UniqueName: \"kubernetes.io/projected/1a036a2e-44d4-4061-8a1b-832c8cc4a8b9-kube-api-access-hcjxf\") pod \"test-curl-7479-140547418747936\" (UID: \"1a036a2e-44d4-4061-8a1b-832c8cc4a8b9\") " pod="opendatahub/test-curl-7479-140547418747936"
Jul 15 16:21:20.366050 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:21:20.366016    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7479-140547418747936"
Jul 15 16:21:20.504295 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:21:20.504263    2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7479-140547418747936"]
Jul 15 16:21:20.505283 ip-10-0-140-212 kubenswrapper[2588]: W0715 16:21:20.505261    2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1a036a2e_44d4_4061_8a1b_832c8cc4a8b9.slice/crio-c75eb168c51ac31834b550b33b9daefd1931d03549860f873eb57787fa974478 WatchSource:0}: Error finding container c75eb168c51ac31834b550b33b9daefd1931d03549860f873eb57787fa974478: Status 404 returned error can't find the container with id c75eb168c51ac31834b550b33b9daefd1931d03549860f873eb57787fa974478
Jul 15 16:21:20.696470 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:21:20.696437    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7479-140547418747936" event={"ID":"1a036a2e-44d4-4061-8a1b-832c8cc4a8b9","Type":"ContainerStarted","Data":"c75eb168c51ac31834b550b33b9daefd1931d03549860f873eb57787fa974478"}
Jul 15 16:21:20.697813 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:21:20.697788    2588 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7479-140547418747936"
Jul 15 16:21:20.697813 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:21:20.697796    2588 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0a7ace54ece600635009bb90277cad2482ebbf964ef3c5d43bc5c92a43cf133b"
Jul 15 16:21:20.710064 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:21:20.710038    2588 status_manager.go:1027] "Pod was deleted and then recreated, skipping status update" pod="opendatahub/test-curl-7479-140547418747936" oldPodUID="d0a804e0-1ea4-4435-b8b1-738e19f8861c" podUID="1a036a2e-44d4-4061-8a1b-832c8cc4a8b9"
Jul 15 16:21:20.911118 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:21:20.911086    2588 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="581fc03b-5a14-4e73-a1f8-b9a26f9e49be" path="/var/lib/kubelet/pods/581fc03b-5a14-4e73-a1f8-b9a26f9e49be/volumes"
Jul 15 16:21:20.911502 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:21:20.911483    2588 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d0a804e0-1ea4-4435-b8b1-738e19f8861c" path="/var/lib/kubelet/pods/d0a804e0-1ea4-4435-b8b1-738e19f8861c/volumes"
Jul 15 16:21:21.705972 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:21:21.705935    2588 generic.go:356] "Generic (PLEG): container finished" podID="1a036a2e-44d4-4061-8a1b-832c8cc4a8b9" containerID="ed5524b4e01ffa8a5cfca6591fb2a7d85261bd62e2432d67b181136be8135288" exitCode=0
Jul 15 16:21:21.706329 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:21:21.706017    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7479-140547418747936" event={"ID":"1a036a2e-44d4-4061-8a1b-832c8cc4a8b9","Type":"ContainerDied","Data":"ed5524b4e01ffa8a5cfca6591fb2a7d85261bd62e2432d67b181136be8135288"}
Jul 15 16:21:22.861749 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:21:22.861726    2588 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7479-140547418747936"
Jul 15 16:21:22.885047 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:21:22.885019    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7479-140547418747936_1a036a2e-44d4-4061-8a1b-832c8cc4a8b9/test-curl-7479-140547418747936/0.log"
Jul 15 16:21:22.914642 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:21:22.914614    2588 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7479-140547418747936"]
Jul 15 16:21:22.917990 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:21:22.917965    2588 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7479-140547418747936"]
Jul 15 16:21:22.966705 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:21:22.966648    2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hcjxf\" (UniqueName: \"kubernetes.io/projected/1a036a2e-44d4-4061-8a1b-832c8cc4a8b9-kube-api-access-hcjxf\") pod \"1a036a2e-44d4-4061-8a1b-832c8cc4a8b9\" (UID: \"1a036a2e-44d4-4061-8a1b-832c8cc4a8b9\") "
Jul 15 16:21:22.968680 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:21:22.968658    2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1a036a2e-44d4-4061-8a1b-832c8cc4a8b9-kube-api-access-hcjxf" (OuterVolumeSpecName: "kube-api-access-hcjxf") pod "1a036a2e-44d4-4061-8a1b-832c8cc4a8b9" (UID: "1a036a2e-44d4-4061-8a1b-832c8cc4a8b9"). InnerVolumeSpecName "kube-api-access-hcjxf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 16:21:23.067829 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:21:23.067790    2588 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hcjxf\" (UniqueName: \"kubernetes.io/projected/1a036a2e-44d4-4061-8a1b-832c8cc4a8b9-kube-api-access-hcjxf\") on node \"ip-10-0-140-212.ec2.internal\" DevicePath \"\""
Jul 15 16:21:23.104024 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:21:23.103995    2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-95128b-8m44r"]
Jul 15 16:21:23.104372 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:21:23.104360    2588 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1a036a2e-44d4-4061-8a1b-832c8cc4a8b9" containerName="test-curl-7479-140547418747936"
Jul 15 16:21:23.104413 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:21:23.104375    2588 state_mem.go:107] "Deleted CPUSet assignment" podUID="1a036a2e-44d4-4061-8a1b-832c8cc4a8b9" containerName="test-curl-7479-140547418747936"
Jul 15 16:21:23.104462 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:21:23.104439    2588 memory_manager.go:368] "RemoveStaleState removing state" podUID="1a036a2e-44d4-4061-8a1b-832c8cc4a8b9" containerName="test-curl-7479-140547418747936"
Jul 15 16:21:23.107509 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:21:23.107494    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-95128b-8m44r"
Jul 15 16:21:23.110305 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:21:23.110282    2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 15 16:21:23.110434 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:21:23.110333    2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-f55c8\""
Jul 15 16:21:23.116175 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:21:23.116152    2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-95128b-8m44r"]
Jul 15 16:21:23.168366 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:21:23.168325    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/34c290eb-2142-42e2-9b8b-62a1dfaa729a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-95128b-8m44r\" (UID: \"34c290eb-2142-42e2-9b8b-62a1dfaa729a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-95128b-8m44r"
Jul 15 16:21:23.269546 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:21:23.269470    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/34c290eb-2142-42e2-9b8b-62a1dfaa729a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-95128b-8m44r\" (UID: \"34c290eb-2142-42e2-9b8b-62a1dfaa729a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-95128b-8m44r"
Jul 15 16:21:23.270074 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:21:23.270054    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/34c290eb-2142-42e2-9b8b-62a1dfaa729a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-95128b-8m44r\" (UID: \"34c290eb-2142-42e2-9b8b-62a1dfaa729a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-95128b-8m44r"
Jul 15 16:21:23.419307 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:21:23.419271    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-95128b-8m44r"
Jul 15 16:21:23.551430 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:21:23.551402    2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-95128b-8m44r"]
Jul 15 16:21:23.552855 ip-10-0-140-212 kubenswrapper[2588]: W0715 16:21:23.552830    2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34c290eb_2142_42e2_9b8b_62a1dfaa729a.slice/crio-fd7af4632125ad102bc4740be4016473d262f6358a55c1691759f0a5a541767b WatchSource:0}: Error finding container fd7af4632125ad102bc4740be4016473d262f6358a55c1691759f0a5a541767b: Status 404 returned error can't find the container with id fd7af4632125ad102bc4740be4016473d262f6358a55c1691759f0a5a541767b
Jul 15 16:21:23.719802 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:21:23.719774    2588 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c75eb168c51ac31834b550b33b9daefd1931d03549860f873eb57787fa974478"
Jul 15 16:21:23.719802 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:21:23.719775    2588 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7479-140547418747936"
Jul 15 16:21:23.721123 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:21:23.721093    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-95128b-8m44r" event={"ID":"34c290eb-2142-42e2-9b8b-62a1dfaa729a","Type":"ContainerStarted","Data":"fd7af4632125ad102bc4740be4016473d262f6358a55c1691759f0a5a541767b"}
Jul 15 16:21:23.730373 ip-10-0-140-212 kubenswrapper[2588]: E0715 16:21:23.730324    2588 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7479-140547418747936\" is forbidden: User \"system:node:ip-10-0-140-212.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-140-212.ec2.internal' and this object" podUID="1a036a2e-44d4-4061-8a1b-832c8cc4a8b9" pod="opendatahub/test-curl-7479-140547418747936"
Jul 15 16:21:24.727899 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:21:24.727862    2588 generic.go:356] "Generic (PLEG): container finished" podID="34c290eb-2142-42e2-9b8b-62a1dfaa729a" containerID="5b2a5cd4875241b41e25a8514b648441bf960c1d353d69417fd1ee76a26e1b7d" exitCode=0
Jul 15 16:21:24.728289 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:21:24.727914    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-95128b-8m44r" event={"ID":"34c290eb-2142-42e2-9b8b-62a1dfaa729a","Type":"ContainerDied","Data":"5b2a5cd4875241b41e25a8514b648441bf960c1d353d69417fd1ee76a26e1b7d"}
Jul 15 16:21:24.747894 ip-10-0-140-212 kubenswrapper[2588]: E0715 16:21:24.747859    2588 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7479-140547418747936\" is forbidden: User \"system:node:ip-10-0-140-212.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-140-212.ec2.internal' and this object" podUID="1a036a2e-44d4-4061-8a1b-832c8cc4a8b9" pod="opendatahub/test-curl-7479-140547418747936"
Jul 15 16:21:24.910450 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:21:24.910419    2588 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1a036a2e-44d4-4061-8a1b-832c8cc4a8b9" path="/var/lib/kubelet/pods/1a036a2e-44d4-4061-8a1b-832c8cc4a8b9/volumes"
Jul 15 16:21:24.914487 ip-10-0-140-212 kubenswrapper[2588]: E0715 16:21:24.914458    2588 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7479-140547418747936\" is forbidden: User \"system:node:ip-10-0-140-212.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-140-212.ec2.internal' and this object" podUID="1a036a2e-44d4-4061-8a1b-832c8cc4a8b9" pod="opendatahub/test-curl-7479-140547418747936"
Jul 15 16:21:25.868793 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:21:25.868766    2588 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-95128b-8m44r"
Jul 15 16:21:25.891794 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:21:25.891764    2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/34c290eb-2142-42e2-9b8b-62a1dfaa729a-maas-api-service-ca\") pod \"34c290eb-2142-42e2-9b8b-62a1dfaa729a\" (UID: \"34c290eb-2142-42e2-9b8b-62a1dfaa729a\") "
Jul 15 16:21:25.892241 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:21:25.892211    2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/34c290eb-2142-42e2-9b8b-62a1dfaa729a-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "34c290eb-2142-42e2-9b8b-62a1dfaa729a" (UID: "34c290eb-2142-42e2-9b8b-62a1dfaa729a"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 16:21:25.993310 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:21:25.993226    2588 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/34c290eb-2142-42e2-9b8b-62a1dfaa729a-maas-api-service-ca\") on node \"ip-10-0-140-212.ec2.internal\" DevicePath \"\""
Jul 15 16:21:26.740728 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:21:26.740698    2588 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-95128b-8m44r"
Jul 15 16:21:26.740871 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:21:26.740699    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-95128b-8m44r" event={"ID":"34c290eb-2142-42e2-9b8b-62a1dfaa729a","Type":"ContainerDied","Data":"fd7af4632125ad102bc4740be4016473d262f6358a55c1691759f0a5a541767b"}
Jul 15 16:21:26.740871 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:21:26.740834    2588 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fd7af4632125ad102bc4740be4016473d262f6358a55c1691759f0a5a541767b"
Jul 15 16:21:49.283449 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:21:49.283371    2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-8eb165-2mlx8"]
Jul 15 16:21:49.283892 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:21:49.283742    2588 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="34c290eb-2142-42e2-9b8b-62a1dfaa729a" containerName="revoke-keys"
Jul 15 16:21:49.283892 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:21:49.283753    2588 state_mem.go:107] "Deleted CPUSet assignment" podUID="34c290eb-2142-42e2-9b8b-62a1dfaa729a" containerName="revoke-keys"
Jul 15 16:21:49.283892 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:21:49.283818    2588 memory_manager.go:368] "RemoveStaleState removing state" podUID="34c290eb-2142-42e2-9b8b-62a1dfaa729a" containerName="revoke-keys"
Jul 15 16:21:49.288786 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:21:49.288770    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-8eb165-2mlx8"
Jul 15 16:21:49.291904 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:21:49.291883    2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-f55c8\""
Jul 15 16:21:49.291904 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:21:49.291882    2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 15 16:21:49.297280 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:21:49.297256    2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-8eb165-2mlx8"]
Jul 15 16:21:49.386921 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:21:49.386887    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d204defd-80ce-4fe3-98bc-7114ad8dbcf0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-8eb165-2mlx8\" (UID: \"d204defd-80ce-4fe3-98bc-7114ad8dbcf0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-8eb165-2mlx8"
Jul 15 16:21:49.488057 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:21:49.488027    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d204defd-80ce-4fe3-98bc-7114ad8dbcf0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-8eb165-2mlx8\" (UID: \"d204defd-80ce-4fe3-98bc-7114ad8dbcf0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-8eb165-2mlx8"
Jul 15 16:21:49.488663 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:21:49.488643    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d204defd-80ce-4fe3-98bc-7114ad8dbcf0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-8eb165-2mlx8\" (UID: \"d204defd-80ce-4fe3-98bc-7114ad8dbcf0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-8eb165-2mlx8"
Jul 15 16:21:49.600522 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:21:49.600495    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-8eb165-2mlx8"
Jul 15 16:21:49.740169 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:21:49.740139    2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-8eb165-2mlx8"]
Jul 15 16:21:49.741411 ip-10-0-140-212 kubenswrapper[2588]: W0715 16:21:49.741384    2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd204defd_80ce_4fe3_98bc_7114ad8dbcf0.slice/crio-7a4ab510c65824822c7157a438048feb39b523c3745c8ddd3d6d2796bdaacfb8 WatchSource:0}: Error finding container 7a4ab510c65824822c7157a438048feb39b523c3745c8ddd3d6d2796bdaacfb8: Status 404 returned error can't find the container with id 7a4ab510c65824822c7157a438048feb39b523c3745c8ddd3d6d2796bdaacfb8
Jul 15 16:21:49.888859 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:21:49.888779    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-8eb165-2mlx8" event={"ID":"d204defd-80ce-4fe3-98bc-7114ad8dbcf0","Type":"ContainerStarted","Data":"7a4ab510c65824822c7157a438048feb39b523c3745c8ddd3d6d2796bdaacfb8"}
Jul 15 16:21:50.896126 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:21:50.896092    2588 generic.go:356] "Generic (PLEG): container finished" podID="d204defd-80ce-4fe3-98bc-7114ad8dbcf0" containerID="a2ff84fba0f2189e7dd5804fee122ba0fecd155148172a2cce329c4dd4658e61" exitCode=0
Jul 15 16:21:50.896555 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:21:50.896182    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-8eb165-2mlx8" event={"ID":"d204defd-80ce-4fe3-98bc-7114ad8dbcf0","Type":"ContainerDied","Data":"a2ff84fba0f2189e7dd5804fee122ba0fecd155148172a2cce329c4dd4658e61"}
Jul 15 16:21:52.028758 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:21:52.028734    2588 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-8eb165-2mlx8"
Jul 15 16:21:52.109846 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:21:52.109817    2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d204defd-80ce-4fe3-98bc-7114ad8dbcf0-maas-api-service-ca\") pod \"d204defd-80ce-4fe3-98bc-7114ad8dbcf0\" (UID: \"d204defd-80ce-4fe3-98bc-7114ad8dbcf0\") "
Jul 15 16:21:52.110192 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:21:52.110172    2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d204defd-80ce-4fe3-98bc-7114ad8dbcf0-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "d204defd-80ce-4fe3-98bc-7114ad8dbcf0" (UID: "d204defd-80ce-4fe3-98bc-7114ad8dbcf0"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 16:21:52.210585 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:21:52.210496    2588 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d204defd-80ce-4fe3-98bc-7114ad8dbcf0-maas-api-service-ca\") on node \"ip-10-0-140-212.ec2.internal\" DevicePath \"\""
Jul 15 16:21:52.911019 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:21:52.910977    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-8eb165-2mlx8" event={"ID":"d204defd-80ce-4fe3-98bc-7114ad8dbcf0","Type":"ContainerDied","Data":"7a4ab510c65824822c7157a438048feb39b523c3745c8ddd3d6d2796bdaacfb8"}
Jul 15 16:21:52.911019 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:21:52.911027    2588 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7a4ab510c65824822c7157a438048feb39b523c3745c8ddd3d6d2796bdaacfb8"
Jul 15 16:21:52.911272 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:21:52.910993    2588 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-8eb165-2mlx8"
Jul 15 16:22:15.718764 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:22:15.718727    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-849c7c6647-7fbbk_7d927c2a-4643-4c54-89de-4fe6bcd29836/authorino/0.log"
Jul 15 16:22:21.468892 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:22:21.468864    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-grgn6_614f35e9-c64c-4d97-91d6-81180d6e13b3/server/0.log"
Jul 15 16:22:21.592152 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:22:21.592113    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-bhhnq_24cea7a7-5f27-4068-86c3-e30347ad29ee/manager/0.log"
Jul 15 16:22:21.706643 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:22:21.706617    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5ccf5c88b7-gvhbs_cc9da0b6-3217-4453-a94b-88b45bfdc6c5/copy-manifests/0.log"
Jul 15 16:22:21.714288 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:22:21.714266    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5ccf5c88b7-gvhbs_cc9da0b6-3217-4453-a94b-88b45bfdc6c5/manager/0.log"
Jul 15 16:22:22.431231 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:22:22.431191    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29735505-kzf8k_92fc32a7-d1cf-4a35-8d4b-93904912817c/cleanup/0.log"
Jul 15 16:22:22.545483 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:22:22.545451    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29735520-ttp49_dd1a33f7-24b4-4ad7-b50b-f7a4ac2677eb/cleanup/0.log"
Jul 15 16:22:22.662633 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:22:22.662603    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29735535-j6km7_8ad0408c-e7ad-460e-bce5-11ae419393ec/cleanup/0.log"
Jul 15 16:22:22.771481 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:22:22.771402    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-ait-08a5731c-vrwm4_63d2c54f-60c2-4d0f-9edc-8917e20b7c58/revoke-keys/0.log"
Jul 15 16:22:22.881190 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:22:22.881158    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-ait-18e9c399-2mqhh_a44a4e45-987d-403c-9375-65ea53007846/revoke-keys/0.log"
Jul 15 16:22:22.993517 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:22:22.993490    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-api-a-b896e0-jvf7c_b8a64d5d-8172-448d-a3ac-bf53f5a1ef21/revoke-keys/0.log"
Jul 15 16:22:23.101653 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:22:23.101630    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-api-b-652d3f-l9rrt_b94f2ce6-6659-4c54-a8b8-4e824a1fca58/revoke-keys/0.log"
Jul 15 16:22:23.206983 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:22:23.206954    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-derive-5299c21f-9dx6w_d551df01-6d25-4359-b882-dc083b8df76d/revoke-keys/0.log"
Jul 15 16:22:23.320116 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:22:23.320088    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-inf-a-24e47f-jx8mf_8338efe2-ebe8-43ce-a878-64beea02ea7f/revoke-keys/0.log"
Jul 15 16:22:23.425385 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:22:23.425294    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-inf-b-a84db0-ztp5t_453c58c5-c127-4760-82ce-c377c655bf85/revoke-keys/0.log"
Jul 15 16:22:23.541063 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:22:23.541026    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-migrate-f9b8f1b9-czc9t_4b677788-f6b8-44a4-9a2d-c37378f2df6e/revoke-keys/0.log"
Jul 15 16:22:23.655154 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:22:23.655121    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-mt-b2c9c91f-xd7lx_a68c2c3a-591c-4956-bb93-a1916865a072/revoke-keys/0.log"
Jul 15 16:22:23.765006 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:22:23.764932    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-mt-b9b40333-zmkr4_cbbceedd-8624-441a-a228-e237f177865d/revoke-keys/0.log"
Jul 15 16:22:23.885363 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:22:23.885320    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-shared-a-95128b-8m44r_34c290eb-2142-42e2-9b8b-62a1dfaa729a/revoke-keys/0.log"
Jul 15 16:22:23.994913 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:22:23.994881    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-shared-b-8eb165-2mlx8_d204defd-80ce-4fe3-98bc-7114ad8dbcf0/revoke-keys/0.log"
Jul 15 16:22:24.892173 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:22:24.892142    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zm68w_77f49f85-48dc-40d2-b3c7-8b3e03624144/util/0.log"
Jul 15 16:22:24.898589 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:22:24.898563    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zm68w_77f49f85-48dc-40d2-b3c7-8b3e03624144/pull/0.log"
Jul 15 16:22:24.904821 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:22:24.904792    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zm68w_77f49f85-48dc-40d2-b3c7-8b3e03624144/extract/0.log"
Jul 15 16:22:25.013126 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:22:25.013101    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lnl6d_4c394478-25d7-47d9-ad1f-49a257c2a5b3/util/0.log"
Jul 15 16:22:25.019693 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:22:25.019670    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lnl6d_4c394478-25d7-47d9-ad1f-49a257c2a5b3/pull/0.log"
Jul 15 16:22:25.026119 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:22:25.026101    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lnl6d_4c394478-25d7-47d9-ad1f-49a257c2a5b3/extract/0.log"
Jul 15 16:22:25.135471 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:22:25.135443    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vr5sr_1bf0fbc5-cbf0-42fb-87c6-901e0d9be3d6/util/0.log"
Jul 15 16:22:25.143209 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:22:25.143139    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vr5sr_1bf0fbc5-cbf0-42fb-87c6-901e0d9be3d6/pull/0.log"
Jul 15 16:22:25.150456 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:22:25.150437    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vr5sr_1bf0fbc5-cbf0-42fb-87c6-901e0d9be3d6/extract/0.log"
Jul 15 16:22:25.287801 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:22:25.287773    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15dt5r_660f3793-9fbe-4bb7-8447-cc68f416e9ce/util/0.log"
Jul 15 16:22:25.296293 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:22:25.296270    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15dt5r_660f3793-9fbe-4bb7-8447-cc68f416e9ce/pull/0.log"
Jul 15 16:22:25.303390 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:22:25.303363    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15dt5r_660f3793-9fbe-4bb7-8447-cc68f416e9ce/extract/0.log"
Jul 15 16:22:25.426191 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:22:25.426100    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-849c7c6647-7fbbk_7d927c2a-4643-4c54-89de-4fe6bcd29836/authorino/0.log"
Jul 15 16:22:25.783018 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:22:25.782940    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-vhw97_953e31e8-22ee-41b3-8a48-5bedfe063183/kuadrant-console-plugin/0.log"
Jul 15 16:22:26.997676 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:22:26.997650    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7cbcc54d95-fvdjg_b73ec7e0-b8b7-48c1-8e9b-59fac8eee5c2/kube-auth-proxy/0.log"
Jul 15 16:22:27.471705 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:22:27.471676    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6b6d8f8b7b-mrtkd_7f8686f6-7e33-4c8e-91fe-d5fabf84906a/router/0.log"
Jul 15 16:22:27.936324 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:22:27.936296    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-8v26d_da35dc87-88f7-4c5f-991d-74545a3920c5/main/0.log"
Jul 15 16:22:28.415010 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:22:28.414974    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5fc6fb456f-qjrtw_f44bd9c1-1729-4e57-8e43-8ab47fb1e204/main/0.log"
Jul 15 16:22:37.094377 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:22:37.094331    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-n4kpw_542b7772-fe16-4f43-b9fb-e0d1538c5134/global-pull-secret-syncer/0.log"
Jul 15 16:22:37.285592 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:22:37.285559    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-nhrz9_71307173-3bbb-4ef7-9730-88a17f2552b0/konnectivity-agent/0.log"
Jul 15 16:22:37.363597 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:22:37.363511    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-140-212.ec2.internal_83cd7df02ad08b5cd140b5486992b652/haproxy/0.log"
Jul 15 16:22:41.942455 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:22:41.942423    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zm68w_77f49f85-48dc-40d2-b3c7-8b3e03624144/extract/0.log"
Jul 15 16:22:41.972634 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:22:41.972600    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zm68w_77f49f85-48dc-40d2-b3c7-8b3e03624144/util/0.log"
Jul 15 16:22:41.997375 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:22:41.997329    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zm68w_77f49f85-48dc-40d2-b3c7-8b3e03624144/pull/0.log"
Jul 15 16:22:42.032745 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:22:42.032716    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lnl6d_4c394478-25d7-47d9-ad1f-49a257c2a5b3/extract/0.log"
Jul 15 16:22:42.060551 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:22:42.060528    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lnl6d_4c394478-25d7-47d9-ad1f-49a257c2a5b3/util/0.log"
Jul 15 16:22:42.087154 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:22:42.087132    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lnl6d_4c394478-25d7-47d9-ad1f-49a257c2a5b3/pull/0.log"
Jul 15 16:22:42.117008 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:22:42.116985    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vr5sr_1bf0fbc5-cbf0-42fb-87c6-901e0d9be3d6/extract/0.log"
Jul 15 16:22:42.151012 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:22:42.150988    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vr5sr_1bf0fbc5-cbf0-42fb-87c6-901e0d9be3d6/util/0.log"
Jul 15 16:22:42.176848 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:22:42.176831    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vr5sr_1bf0fbc5-cbf0-42fb-87c6-901e0d9be3d6/pull/0.log"
Jul 15 16:22:42.208031 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:22:42.207969    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15dt5r_660f3793-9fbe-4bb7-8447-cc68f416e9ce/extract/0.log"
Jul 15 16:22:42.238407 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:22:42.238386    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15dt5r_660f3793-9fbe-4bb7-8447-cc68f416e9ce/util/0.log"
Jul 15 16:22:42.265908 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:22:42.265888    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15dt5r_660f3793-9fbe-4bb7-8447-cc68f416e9ce/pull/0.log"
Jul 15 16:22:42.767252 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:22:42.767219    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-849c7c6647-7fbbk_7d927c2a-4643-4c54-89de-4fe6bcd29836/authorino/0.log"
Jul 15 16:22:42.891222 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:22:42.891196    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-vhw97_953e31e8-22ee-41b3-8a48-5bedfe063183/kuadrant-console-plugin/0.log"
Jul 15 16:22:44.953916 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:22:44.953882    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c8ad33d9-3444-42e2-b3eb-197a3652fb42/alertmanager/0.log"
Jul 15 16:22:45.035525 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:22:45.035500    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c8ad33d9-3444-42e2-b3eb-197a3652fb42/config-reloader/0.log"
Jul 15 16:22:45.085245 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:22:45.085216    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c8ad33d9-3444-42e2-b3eb-197a3652fb42/kube-rbac-proxy-web/0.log"
Jul 15 16:22:45.111518 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:22:45.111484    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c8ad33d9-3444-42e2-b3eb-197a3652fb42/kube-rbac-proxy/0.log"
Jul 15 16:22:45.137674 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:22:45.137651    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c8ad33d9-3444-42e2-b3eb-197a3652fb42/kube-rbac-proxy-metric/0.log"
Jul 15 16:22:45.161785 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:22:45.161760    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c8ad33d9-3444-42e2-b3eb-197a3652fb42/prom-label-proxy/0.log"
Jul 15 16:22:45.185360 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:22:45.185323    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c8ad33d9-3444-42e2-b3eb-197a3652fb42/init-config-reloader/0.log"
Jul 15 16:22:45.238150 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:22:45.238084    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-5f7f494dd4-lbdlp_c80ed5cd-4b7c-4981-95c6-a02cf058f709/cluster-monitoring-operator/1.log"
Jul 15 16:22:45.391999 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:22:45.391974    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-5f7f494dd4-lbdlp_c80ed5cd-4b7c-4981-95c6-a02cf058f709/cluster-monitoring-operator/0.log"
Jul 15 16:22:45.730859 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:22:45.730828    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-fgfgf_4b8da0b7-32e1-4251-9a9c-60b530dab461/node-exporter/0.log"
Jul 15 16:22:45.754312 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:22:45.754292    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-fgfgf_4b8da0b7-32e1-4251-9a9c-60b530dab461/kube-rbac-proxy/0.log"
Jul 15 16:22:45.776844 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:22:45.776826    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-fgfgf_4b8da0b7-32e1-4251-9a9c-60b530dab461/init-textfile/0.log"
Jul 15 16:22:47.255592 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:22:47.255563    2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-7j6b2/perf-node-gather-daemonset-bzfk5"]
Jul 15 16:22:47.255980 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:22:47.255884    2588 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d204defd-80ce-4fe3-98bc-7114ad8dbcf0" containerName="revoke-keys"
Jul 15 16:22:47.255980 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:22:47.255895    2588 state_mem.go:107] "Deleted CPUSet assignment" podUID="d204defd-80ce-4fe3-98bc-7114ad8dbcf0" containerName="revoke-keys"
Jul 15 16:22:47.256059 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:22:47.255983    2588 memory_manager.go:368] "RemoveStaleState removing state" podUID="d204defd-80ce-4fe3-98bc-7114ad8dbcf0" containerName="revoke-keys"
Jul 15 16:22:47.259286 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:22:47.259271    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-7j6b2/perf-node-gather-daemonset-bzfk5"
Jul 15 16:22:47.261948 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:22:47.261928    2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-7j6b2\"/\"default-dockercfg-zrw5m\""
Jul 15 16:22:47.262208 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:22:47.262186    2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-7j6b2\"/\"openshift-service-ca.crt\""
Jul 15 16:22:47.263383 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:22:47.263367    2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-7j6b2\"/\"kube-root-ca.crt\""
Jul 15 16:22:47.267910 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:22:47.267888    2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-7j6b2/perf-node-gather-daemonset-bzfk5"]
Jul 15 16:22:47.355288 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:22:47.355258    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d015b233-322e-4007-b12a-befb3dcd6863-lib-modules\") pod \"perf-node-gather-daemonset-bzfk5\" (UID: \"d015b233-322e-4007-b12a-befb3dcd6863\") " pod="openshift-must-gather-7j6b2/perf-node-gather-daemonset-bzfk5"
Jul 15 16:22:47.355288 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:22:47.355289    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d015b233-322e-4007-b12a-befb3dcd6863-podres\") pod \"perf-node-gather-daemonset-bzfk5\" (UID: \"d015b233-322e-4007-b12a-befb3dcd6863\") " pod="openshift-must-gather-7j6b2/perf-node-gather-daemonset-bzfk5"
Jul 15 16:22:47.355532 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:22:47.355308    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d015b233-322e-4007-b12a-befb3dcd6863-sys\") pod \"perf-node-gather-daemonset-bzfk5\" (UID: \"d015b233-322e-4007-b12a-befb3dcd6863\") " pod="openshift-must-gather-7j6b2/perf-node-gather-daemonset-bzfk5"
Jul 15 16:22:47.355532 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:22:47.355327    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d015b233-322e-4007-b12a-befb3dcd6863-proc\") pod \"perf-node-gather-daemonset-bzfk5\" (UID: \"d015b233-322e-4007-b12a-befb3dcd6863\") " pod="openshift-must-gather-7j6b2/perf-node-gather-daemonset-bzfk5"
Jul 15 16:22:47.355532 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:22:47.355427    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fzgxd\" (UniqueName: \"kubernetes.io/projected/d015b233-322e-4007-b12a-befb3dcd6863-kube-api-access-fzgxd\") pod \"perf-node-gather-daemonset-bzfk5\" (UID: \"d015b233-322e-4007-b12a-befb3dcd6863\") " pod="openshift-must-gather-7j6b2/perf-node-gather-daemonset-bzfk5"
Jul 15 16:22:47.456455 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:22:47.456425    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fzgxd\" (UniqueName: \"kubernetes.io/projected/d015b233-322e-4007-b12a-befb3dcd6863-kube-api-access-fzgxd\") pod \"perf-node-gather-daemonset-bzfk5\" (UID: \"d015b233-322e-4007-b12a-befb3dcd6863\") " pod="openshift-must-gather-7j6b2/perf-node-gather-daemonset-bzfk5"
Jul 15 16:22:47.456594 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:22:47.456484    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d015b233-322e-4007-b12a-befb3dcd6863-lib-modules\") pod \"perf-node-gather-daemonset-bzfk5\" (UID: \"d015b233-322e-4007-b12a-befb3dcd6863\") " pod="openshift-must-gather-7j6b2/perf-node-gather-daemonset-bzfk5"
Jul 15 16:22:47.456594 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:22:47.456512    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d015b233-322e-4007-b12a-befb3dcd6863-podres\") pod \"perf-node-gather-daemonset-bzfk5\" (UID: \"d015b233-322e-4007-b12a-befb3dcd6863\") " pod="openshift-must-gather-7j6b2/perf-node-gather-daemonset-bzfk5"
Jul 15 16:22:47.456594 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:22:47.456534    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d015b233-322e-4007-b12a-befb3dcd6863-sys\") pod \"perf-node-gather-daemonset-bzfk5\" (UID: \"d015b233-322e-4007-b12a-befb3dcd6863\") " pod="openshift-must-gather-7j6b2/perf-node-gather-daemonset-bzfk5"
Jul 15 16:22:47.456594 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:22:47.456565    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d015b233-322e-4007-b12a-befb3dcd6863-proc\") pod \"perf-node-gather-daemonset-bzfk5\" (UID: \"d015b233-322e-4007-b12a-befb3dcd6863\") " pod="openshift-must-gather-7j6b2/perf-node-gather-daemonset-bzfk5"
Jul 15 16:22:47.456778 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:22:47.456647    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d015b233-322e-4007-b12a-befb3dcd6863-sys\") pod \"perf-node-gather-daemonset-bzfk5\" (UID: \"d015b233-322e-4007-b12a-befb3dcd6863\") " pod="openshift-must-gather-7j6b2/perf-node-gather-daemonset-bzfk5"
Jul 15 16:22:47.456778 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:22:47.456656    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d015b233-322e-4007-b12a-befb3dcd6863-proc\") pod \"perf-node-gather-daemonset-bzfk5\" (UID: \"d015b233-322e-4007-b12a-befb3dcd6863\") " pod="openshift-must-gather-7j6b2/perf-node-gather-daemonset-bzfk5"
Jul 15 16:22:47.456778 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:22:47.456678    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d015b233-322e-4007-b12a-befb3dcd6863-podres\") pod \"perf-node-gather-daemonset-bzfk5\" (UID: \"d015b233-322e-4007-b12a-befb3dcd6863\") " pod="openshift-must-gather-7j6b2/perf-node-gather-daemonset-bzfk5"
Jul 15 16:22:47.456778 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:22:47.456698    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d015b233-322e-4007-b12a-befb3dcd6863-lib-modules\") pod \"perf-node-gather-daemonset-bzfk5\" (UID: \"d015b233-322e-4007-b12a-befb3dcd6863\") " pod="openshift-must-gather-7j6b2/perf-node-gather-daemonset-bzfk5"
Jul 15 16:22:47.465363 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:22:47.465326    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fzgxd\" (UniqueName: \"kubernetes.io/projected/d015b233-322e-4007-b12a-befb3dcd6863-kube-api-access-fzgxd\") pod \"perf-node-gather-daemonset-bzfk5\" (UID: \"d015b233-322e-4007-b12a-befb3dcd6863\") " pod="openshift-must-gather-7j6b2/perf-node-gather-daemonset-bzfk5"
Jul 15 16:22:47.527483 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:22:47.527413    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6cf856758c-sksmh_5ae097ff-d3b5-4962-afef-f78b9b65ccaa/networking-console-plugin/0.log"
Jul 15 16:22:47.570499 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:22:47.570475    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-7j6b2/perf-node-gather-daemonset-bzfk5"
Jul 15 16:22:47.705364 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:22:47.705322    2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-7j6b2/perf-node-gather-daemonset-bzfk5"]
Jul 15 16:22:47.706282 ip-10-0-140-212 kubenswrapper[2588]: W0715 16:22:47.706256    2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podd015b233_322e_4007_b12a_befb3dcd6863.slice/crio-c5286fca81ab95463f4913c94721e0a4a1f8ec0c557a7bbdfcbf83a5b3808913 WatchSource:0}: Error finding container c5286fca81ab95463f4913c94721e0a4a1f8ec0c557a7bbdfcbf83a5b3808913: Status 404 returned error can't find the container with id c5286fca81ab95463f4913c94721e0a4a1f8ec0c557a7bbdfcbf83a5b3808913
Jul 15 16:22:48.159567 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:22:48.159535    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-qcvqk_eb866034-d7d1-4bee-b8b7-616b355d371d/console-operator/1.log"
Jul 15 16:22:48.167329 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:22:48.167306    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-qcvqk_eb866034-d7d1-4bee-b8b7-616b355d371d/console-operator/2.log"
Jul 15 16:22:48.246616 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:22:48.246587    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-7j6b2/perf-node-gather-daemonset-bzfk5" event={"ID":"d015b233-322e-4007-b12a-befb3dcd6863","Type":"ContainerStarted","Data":"8728b5b01ab000d5780511198923fc2d8f416a0874cc1eacdd470b0c3b96ac6e"}
Jul 15 16:22:48.246756 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:22:48.246654    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-7j6b2/perf-node-gather-daemonset-bzfk5" event={"ID":"d015b233-322e-4007-b12a-befb3dcd6863","Type":"ContainerStarted","Data":"c5286fca81ab95463f4913c94721e0a4a1f8ec0c557a7bbdfcbf83a5b3808913"}
Jul 15 16:22:48.246756 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:22:48.246676    2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-7j6b2/perf-node-gather-daemonset-bzfk5"
Jul 15 16:22:48.265851 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:22:48.265809    2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-7j6b2/perf-node-gather-daemonset-bzfk5" podStartSLOduration=1.265795441 podStartE2EDuration="1.265795441s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 16:22:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:22:48.263819131 +0000 UTC m=+2853.915884891" watchObservedRunningTime="2026-07-15 16:22:48.265795441 +0000 UTC m=+2853.917861200"
Jul 15 16:22:49.293523 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:22:49.293486    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78495597f6-ntx28_1e467c41-9552-498c-92b7-6bed182b4c7a/volume-data-source-validator/0.log"
Jul 15 16:22:50.386511 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:22:50.386483    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-btdcp_3856ae8d-74b3-4640-ac17-8800509097a6/dns/0.log"
Jul 15 16:22:50.415153 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:22:50.415132    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-btdcp_3856ae8d-74b3-4640-ac17-8800509097a6/kube-rbac-proxy/0.log"
Jul 15 16:22:50.603042 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:22:50.603013    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-wmcfh_6d4c5bcd-e4af-48c1-a49c-00ebbf891ff1/dns-node-resolver/0.log"
Jul 15 16:22:51.214740 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:22:51.214710    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-f7bpr_0bc9e977-62dc-48b4-bd53-a6ae3de45690/node-ca/0.log"
Jul 15 16:22:52.489189 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:22:52.489153    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7cbcc54d95-fvdjg_b73ec7e0-b8b7-48c1-8e9b-59fac8eee5c2/kube-auth-proxy/0.log"
Jul 15 16:22:52.699629 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:22:52.699597    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6b6d8f8b7b-mrtkd_7f8686f6-7e33-4c8e-91fe-d5fabf84906a/router/0.log"
Jul 15 16:22:53.478047 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:22:53.478020    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-cbhd5_ca4f5583-9d02-45e0-ab0a-aac9fc70bd71/serve-healthcheck-canary/0.log"
Jul 15 16:22:53.989273 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:22:53.989242    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-68d9dd94cf-d5wnr_c6536c40-bac4-4b75-9914-aa2ff4363de8/insights-operator/0.log"
Jul 15 16:22:53.990842 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:22:53.990817    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-68d9dd94cf-d5wnr_c6536c40-bac4-4b75-9914-aa2ff4363de8/insights-operator/1.log"
Jul 15 16:22:54.177110 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:22:54.177084    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-l8hv5_ee7abfdf-8181-4118-ba10-d36fef9ed9d1/kube-rbac-proxy/0.log"
Jul 15 16:22:54.200765 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:22:54.200737    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-l8hv5_ee7abfdf-8181-4118-ba10-d36fef9ed9d1/exporter/0.log"
Jul 15 16:22:54.227429 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:22:54.227401    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-l8hv5_ee7abfdf-8181-4118-ba10-d36fef9ed9d1/extractor/0.log"
Jul 15 16:22:54.262673 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:22:54.262616    2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-7j6b2/perf-node-gather-daemonset-bzfk5"
Jul 15 16:22:57.090979 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:22:57.090951    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-grgn6_614f35e9-c64c-4d97-91d6-81180d6e13b3/server/0.log"
Jul 15 16:22:57.197128 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:22:57.197103    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-bhhnq_24cea7a7-5f27-4068-86c3-e30347ad29ee/manager/0.log"
Jul 15 16:22:57.234600 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:22:57.234576    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5ccf5c88b7-gvhbs_cc9da0b6-3217-4453-a94b-88b45bfdc6c5/manager/0.log"
Jul 15 16:22:57.261160 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:22:57.261144    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5ccf5c88b7-gvhbs_cc9da0b6-3217-4453-a94b-88b45bfdc6c5/copy-manifests/0.log"
Jul 15 16:22:57.567478 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:22:57.567377    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7cbcc54d95-fvdjg_b73ec7e0-b8b7-48c1-8e9b-59fac8eee5c2/kube-auth-proxy/0.log"
Jul 15 16:22:57.730453 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:22:57.730423    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6b6d8f8b7b-mrtkd_7f8686f6-7e33-4c8e-91fe-d5fabf84906a/router/0.log"
Jul 15 16:22:58.817058 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:22:58.817010    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-c74867c7d-msd8j_4cee1b47-85ae-4812-90d7-be743f29db4f/manager/0.log"
Jul 15 16:22:59.206876 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:22:59.206844    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7cbcc54d95-fvdjg_b73ec7e0-b8b7-48c1-8e9b-59fac8eee5c2/kube-auth-proxy/0.log"
Jul 15 16:22:59.411827 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:22:59.411796    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6b6d8f8b7b-mrtkd_7f8686f6-7e33-4c8e-91fe-d5fabf84906a/router/0.log"
Jul 15 16:23:03.761328 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:23:03.761295    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-g8vnq_006b063d-5fd3-40f5-b898-27117973659a/migrator/0.log"
Jul 15 16:23:03.782729 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:23:03.782690    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-g8vnq_006b063d-5fd3-40f5-b898-27117973659a/graceful-termination/0.log"
Jul 15 16:23:04.185370 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:23:04.185310    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-799cb7f958-pxkjb_32207a22-c82a-4d3b-a044-aa9899bcdf2d/kube-storage-version-migrator-operator/1.log"
Jul 15 16:23:04.186719 ip-10-0-140-212 kubenswrapper[2588]: I0715 16:23:04.186693    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-799cb7f958-pxkjb_32207a22-c82a-4d3b-a044-aa9899bcdf2d/kube-storage-version-migrator-operator/0.log"