Jul 14 19:10:52.101055 ip-10-0-129-23 systemd[1]: Starting Kubernetes Kubelet...
Jul 14 19:10:52.453802 ip-10-0-129-23 kubenswrapper[2565]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 14 19:10:52.453802 ip-10-0-129-23 kubenswrapper[2565]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 14 19:10:52.453802 ip-10-0-129-23 kubenswrapper[2565]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 14 19:10:52.454293 ip-10-0-129-23 kubenswrapper[2565]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 14 19:10:52.454293 ip-10-0-129-23 kubenswrapper[2565]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 14 19:10:52.454728 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.454660    2565 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 14 19:10:52.459962 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.459943    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 14 19:10:52.459962 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.459960    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 14 19:10:52.459962 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.459964    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 14 19:10:52.460058 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.459968    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 14 19:10:52.460058 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.459971    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 14 19:10:52.460058 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.459974    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 14 19:10:52.460058 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.459977    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 14 19:10:52.460058 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.459980    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 14 19:10:52.460058 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.459982    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 14 19:10:52.460058 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.459992    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 14 19:10:52.460058 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.459995    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 14 19:10:52.460058 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.459998    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 14 19:10:52.460058 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.460000    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 14 19:10:52.460058 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.460003    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 14 19:10:52.460058 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.460005    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 14 19:10:52.460058 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.460008    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 14 19:10:52.460058 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.460010    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 14 19:10:52.460058 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.460013    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 14 19:10:52.460058 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.460016    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 14 19:10:52.460058 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.460018    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 14 19:10:52.460058 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.460021    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 14 19:10:52.460058 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.460023    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 14 19:10:52.460058 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.460026    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 14 19:10:52.460524 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.460028    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 14 19:10:52.460524 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.460030    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 14 19:10:52.460524 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.460033    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 14 19:10:52.460524 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.460035    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 14 19:10:52.460524 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.460038    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 14 19:10:52.460524 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.460040    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 14 19:10:52.460524 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.460042    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 14 19:10:52.460524 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.460045    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 14 19:10:52.460524 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.460047    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 14 19:10:52.460524 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.460050    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 14 19:10:52.460524 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.460052    2565 feature_gate.go:328] unrecognized feature gate: Example
Jul 14 19:10:52.460524 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.460054    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 14 19:10:52.460524 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.460056    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 14 19:10:52.460524 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.460060    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 14 19:10:52.460524 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.460063    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 14 19:10:52.460524 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.460065    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 14 19:10:52.460524 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.460068    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 14 19:10:52.460524 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.460071    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 14 19:10:52.460524 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.460074    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 14 19:10:52.460524 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.460077    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 14 19:10:52.461033 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.460079    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 14 19:10:52.461033 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.460082    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 14 19:10:52.461033 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.460084    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 14 19:10:52.461033 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.460087    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 14 19:10:52.461033 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.460089    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 14 19:10:52.461033 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.460092    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 14 19:10:52.461033 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.460094    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 14 19:10:52.461033 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.460097    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 14 19:10:52.461033 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.460099    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 14 19:10:52.461033 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.460101    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 14 19:10:52.461033 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.460104    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 14 19:10:52.461033 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.460107    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 14 19:10:52.461033 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.460109    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 14 19:10:52.461033 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.460112    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 14 19:10:52.461033 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.460114    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 14 19:10:52.461033 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.460117    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 14 19:10:52.461033 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.460119    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 14 19:10:52.461033 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.460122    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 14 19:10:52.461033 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.460124    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 14 19:10:52.461033 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.460127    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 14 19:10:52.461639 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.460129    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 14 19:10:52.461639 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.460131    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 14 19:10:52.461639 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.460134    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 14 19:10:52.461639 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.460136    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 14 19:10:52.461639 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.460139    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 14 19:10:52.461639 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.460142    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 14 19:10:52.461639 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.460145    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 14 19:10:52.461639 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.460147    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 14 19:10:52.461639 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.460150    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 14 19:10:52.461639 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.460152    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 14 19:10:52.461639 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.460156    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 14 19:10:52.461639 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.460160    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 14 19:10:52.461639 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.460164    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 14 19:10:52.461639 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.460167    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 14 19:10:52.461639 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.460169    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 14 19:10:52.461639 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.460172    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 14 19:10:52.461639 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.460174    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 14 19:10:52.461639 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.460177    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 14 19:10:52.461639 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.460179    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 14 19:10:52.462114 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.460181    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 14 19:10:52.462114 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.460184    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 14 19:10:52.462114 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.460187    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 14 19:10:52.462114 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.460189    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 14 19:10:52.462114 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.460193    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 14 19:10:52.462114 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.460196    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 14 19:10:52.462114 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.460199    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 14 19:10:52.462114 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.460202    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 14 19:10:52.462114 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.460205    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 14 19:10:52.462114 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.460208    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 14 19:10:52.462114 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.460211    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 14 19:10:52.462114 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.460213    2565 feature_gate.go:328] unrecognized feature gate: Example2
Jul 14 19:10:52.462114 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.460216    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 14 19:10:52.462114 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.460219    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 14 19:10:52.462114 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.460222    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 14 19:10:52.462114 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.460224    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 14 19:10:52.462114 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.460227    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 14 19:10:52.462114 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.460965    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 14 19:10:52.462114 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.460973    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 14 19:10:52.462602 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.460976    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 14 19:10:52.462602 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.460979    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 14 19:10:52.462602 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.460982    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 14 19:10:52.462602 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.460984    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 14 19:10:52.462602 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.460987    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 14 19:10:52.462602 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.460990    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 14 19:10:52.462602 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.460992    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 14 19:10:52.462602 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.460995    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 14 19:10:52.462602 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.460998    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 14 19:10:52.462602 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.461000    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 14 19:10:52.462602 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.461003    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 14 19:10:52.462602 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.461005    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 14 19:10:52.462602 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.461007    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 14 19:10:52.462602 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.461010    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 14 19:10:52.462602 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.461012    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 14 19:10:52.462602 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.461015    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 14 19:10:52.462602 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.461017    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 14 19:10:52.462602 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.461020    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 14 19:10:52.462602 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.461023    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 14 19:10:52.462602 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.461025    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 14 19:10:52.463111 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.461028    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 14 19:10:52.463111 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.461030    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 14 19:10:52.463111 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.461033    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 14 19:10:52.463111 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.461036    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 14 19:10:52.463111 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.461039    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 14 19:10:52.463111 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.461042    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 14 19:10:52.463111 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.461046    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 14 19:10:52.463111 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.461049    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 14 19:10:52.463111 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.461053    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 14 19:10:52.463111 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.461056    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 14 19:10:52.463111 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.461059    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 14 19:10:52.463111 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.461062    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 14 19:10:52.463111 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.461064    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 14 19:10:52.463111 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.461067    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 14 19:10:52.463111 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.461070    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 14 19:10:52.463111 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.461072    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 14 19:10:52.463111 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.461075    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 14 19:10:52.463111 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.461077    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 14 19:10:52.463111 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.461080    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 14 19:10:52.463620 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.461083    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 14 19:10:52.463620 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.461086    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 14 19:10:52.463620 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.461088    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 14 19:10:52.463620 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.461092    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 14 19:10:52.463620 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.461096    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 14 19:10:52.463620 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.461100    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 14 19:10:52.463620 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.461104    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 14 19:10:52.463620 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.461107    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 14 19:10:52.463620 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.461110    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 14 19:10:52.463620 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.461113    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 14 19:10:52.463620 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.461115    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 14 19:10:52.463620 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.461118    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 14 19:10:52.463620 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.461121    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 14 19:10:52.463620 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.461124    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 14 19:10:52.463620 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.461126    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 14 19:10:52.463620 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.461129    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 14 19:10:52.463620 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.461131    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 14 19:10:52.463620 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.461134    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 14 19:10:52.463620 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.461137    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 14 19:10:52.464114 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.461139    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 14 19:10:52.464114 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.461142    2565 feature_gate.go:328] unrecognized feature gate: Example2
Jul 14 19:10:52.464114 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.461144    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 14 19:10:52.464114 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.461148    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 14 19:10:52.464114 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.461150    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 14 19:10:52.464114 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.461153    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 14 19:10:52.464114 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.461156    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 14 19:10:52.464114 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.461159    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 14 19:10:52.464114 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.461161    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 14 19:10:52.464114 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.461163    2565 feature_gate.go:328] unrecognized feature gate: Example
Jul 14 19:10:52.464114 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.461166    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 14 19:10:52.464114 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.461168    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 14 19:10:52.464114 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.461171    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 14 19:10:52.464114 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.461173    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 14 19:10:52.464114 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.461176    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 14 19:10:52.464114 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.461178    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 14 19:10:52.464114 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.461181    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 14 19:10:52.464114 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.461183    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 14 19:10:52.464114 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.461185    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 14 19:10:52.464114 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.461188    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 14 19:10:52.464612 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.461190    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 14 19:10:52.464612 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.461192    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 14 19:10:52.464612 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.461195    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 14 19:10:52.464612 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.461197    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 14 19:10:52.464612 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.461200    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 14 19:10:52.464612 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.461202    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 14 19:10:52.464612 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.461205    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 14 19:10:52.464612 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.461208    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 14 19:10:52.464612 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.461210    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 14 19:10:52.464612 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.461213    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 14 19:10:52.464612 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.461216    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 14 19:10:52.464612 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.461218    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 14 19:10:52.464612 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.461220    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 14 19:10:52.464612 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.461223    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 14 19:10:52.464612 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.461226    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 14 19:10:52.464612 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.461229    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 14 19:10:52.464612 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.461231    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 14 19:10:52.464612 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.461234    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 14 19:10:52.464612 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.461237    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 14 19:10:52.464612 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.461604    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 14 19:10:52.465126 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.461609    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 14 19:10:52.465126 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.461612    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 14 19:10:52.465126 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.461615    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 14 19:10:52.465126 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.461618    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 14 19:10:52.465126 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.461621    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 14 19:10:52.465126 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.461623    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 14 19:10:52.465126 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.461626    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 14 19:10:52.465126 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.461629    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 14 19:10:52.465126 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.461631    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 14 19:10:52.465126 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.461634    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 14 19:10:52.465126 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.461636    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 14 19:10:52.465126 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.461639    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 14 19:10:52.465126 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.461642    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 14 19:10:52.465126 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.461644    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 14 19:10:52.465126 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.461647    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 14 19:10:52.465126 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.461649    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 14 19:10:52.465126 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.461652    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 14 19:10:52.465126 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.461655    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 14 19:10:52.465126 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.461657    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 14 19:10:52.465126 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.461660    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 14 19:10:52.465614 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.461662    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 14 19:10:52.465614 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.461665    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 14 19:10:52.465614 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.461667    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 14 19:10:52.465614 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.461670    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 14 19:10:52.465614 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.461672    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 14 19:10:52.465614 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.461675    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 14 19:10:52.465614 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.461677    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 14 19:10:52.465614 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.461680    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 14 19:10:52.465614 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.461682    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 14 19:10:52.465614 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.461685    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 14 19:10:52.465614 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.461687    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 14 19:10:52.465614 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.461689    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 14 19:10:52.465614 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.461692    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 14 19:10:52.465614 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.461694    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 14 19:10:52.465614 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.461697    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 14 19:10:52.465614 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.461699    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 14 19:10:52.465614 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.461702    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 14 19:10:52.465614 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.461704    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 14 19:10:52.465614 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.461706    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 14 19:10:52.465614 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.461709    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 14 19:10:52.466107 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.461711    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 14 19:10:52.466107 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.461714    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 14 19:10:52.466107 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.461716    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 14 19:10:52.466107 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.461721    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 14 19:10:52.466107 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.461724    2565 feature_gate.go:328] unrecognized feature gate: Example
Jul 14 19:10:52.466107 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.461726    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 14 19:10:52.466107 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.461728    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 14 19:10:52.466107 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.461731    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 14 19:10:52.466107 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.461734    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 14 19:10:52.466107 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.461736    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 14 19:10:52.466107 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.461739    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 14 19:10:52.466107 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.461741    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 14 19:10:52.466107 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.461744    2565 feature_gate.go:328] unrecognized feature gate: Example2
Jul 14 19:10:52.466107 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.461746    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 14 19:10:52.466107 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.461748    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 14 19:10:52.466107 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.461751    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 14 19:10:52.466107 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.461754    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 14 19:10:52.466107 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.461756    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 14 19:10:52.466107 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.461759    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 14 19:10:52.466107 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.461762    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 14 19:10:52.466588 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.461764    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 14 19:10:52.466588 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.461766    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 14 19:10:52.466588 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.461769    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 14 19:10:52.466588 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.461773    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 14 19:10:52.466588 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.461776    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 14 19:10:52.466588 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.461779    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 14 19:10:52.466588 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.461782    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 14 19:10:52.466588 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.461801    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 14 19:10:52.466588 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.461804    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 14 19:10:52.466588 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.461807    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 14 19:10:52.466588 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.461810    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 14 19:10:52.466588 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.461813    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 14 19:10:52.466588 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.461816    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 14 19:10:52.466588 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.461820    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 14 19:10:52.466588 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.461823    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 14 19:10:52.466588 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.461827    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 14 19:10:52.466588 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.461829    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 14 19:10:52.466588 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.461832    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 14 19:10:52.466588 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.461835    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 14 19:10:52.467066 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.461837    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 14 19:10:52.467066 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.461840    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 14 19:10:52.467066 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.461842    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 14 19:10:52.467066 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.461845    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 14 19:10:52.467066 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.461847    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 14 19:10:52.467066 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.461849    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 14 19:10:52.467066 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.461852    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 14 19:10:52.467066 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.461856    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 14 19:10:52.467066 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.461858    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 14 19:10:52.467066 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.461861    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 14 19:10:52.467066 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.461864    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 14 19:10:52.467066 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.461867    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 14 19:10:52.467066 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.461870    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 14 19:10:52.467066 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.461872    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 14 19:10:52.467066 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.461874    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 14 19:10:52.467066 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.461877    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 14 19:10:52.467066 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.461879    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 14 19:10:52.467066 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.461883    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 14 19:10:52.467066 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.461886    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 14 19:10:52.467530 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.461948    2565 flags.go:64] FLAG: --address="0.0.0.0"
Jul 14 19:10:52.467530 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.461959    2565 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 14 19:10:52.467530 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.461968    2565 flags.go:64] FLAG: --anonymous-auth="true"
Jul 14 19:10:52.467530 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.461972    2565 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 14 19:10:52.467530 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.461975    2565 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 14 19:10:52.467530 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.461978    2565 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 14 19:10:52.467530 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.461982    2565 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 14 19:10:52.467530 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.461986    2565 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 14 19:10:52.467530 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.461990    2565 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 14 19:10:52.467530 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.461997    2565 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 14 19:10:52.467530 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.462001    2565 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 14 19:10:52.467530 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.462004    2565 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 14 19:10:52.467530 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.462007    2565 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 14 19:10:52.467530 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.462010    2565 flags.go:64] FLAG: --cgroup-root=""
Jul 14 19:10:52.467530 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.462013    2565 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 14 19:10:52.467530 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.462015    2565 flags.go:64] FLAG: --client-ca-file=""
Jul 14 19:10:52.467530 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.462018    2565 flags.go:64] FLAG: --cloud-provider="external"
Jul 14 19:10:52.467530 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.462021    2565 flags.go:64] FLAG: --cluster-dns="[]"
Jul 14 19:10:52.467530 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.462025    2565 flags.go:64] FLAG: --cluster-domain=""
Jul 14 19:10:52.467530 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.462028    2565 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 14 19:10:52.467530 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.462030    2565 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 14 19:10:52.467530 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.462033    2565 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 14 19:10:52.467530 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.462036    2565 flags.go:64] FLAG: --container-log-max-files="5"
Jul 14 19:10:52.467530 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.462040    2565 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 14 19:10:52.468377 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.462043    2565 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 14 19:10:52.468377 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.462046    2565 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 14 19:10:52.468377 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.462049    2565 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 14 19:10:52.468377 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.462052    2565 flags.go:64] FLAG: --contention-profiling="false"
Jul 14 19:10:52.468377 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.462055    2565 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 14 19:10:52.468377 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.462057    2565 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 14 19:10:52.468377 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.462060    2565 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 14 19:10:52.468377 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.462063    2565 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 14 19:10:52.468377 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.462067    2565 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 14 19:10:52.468377 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.462070    2565 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 14 19:10:52.468377 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.462072    2565 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 14 19:10:52.468377 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.462075    2565 flags.go:64] FLAG: --enable-load-reader="false"
Jul 14 19:10:52.468377 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.462078    2565 flags.go:64] FLAG: --enable-server="true"
Jul 14 19:10:52.468377 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.462081    2565 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 14 19:10:52.468377 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.462085    2565 flags.go:64] FLAG: --event-burst="100"
Jul 14 19:10:52.468377 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.462088    2565 flags.go:64] FLAG: --event-qps="50"
Jul 14 19:10:52.468377 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.462091    2565 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 14 19:10:52.468377 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.462095    2565 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 14 19:10:52.468377 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.462098    2565 flags.go:64] FLAG: --eviction-hard=""
Jul 14 19:10:52.468377 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.462102    2565 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 14 19:10:52.468377 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.462104    2565 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 14 19:10:52.468377 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.462107    2565 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 14 19:10:52.468377 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.462110    2565 flags.go:64] FLAG: --eviction-soft=""
Jul 14 19:10:52.468377 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.462113    2565 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 14 19:10:52.468377 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.462116    2565 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 14 19:10:52.469509 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.462119    2565 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 14 19:10:52.469509 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.462122    2565 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 14 19:10:52.469509 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.462125    2565 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 14 19:10:52.469509 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.462128    2565 flags.go:64] FLAG: --fail-swap-on="true"
Jul 14 19:10:52.469509 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.462131    2565 flags.go:64] FLAG: --feature-gates=""
Jul 14 19:10:52.469509 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.462134    2565 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 14 19:10:52.469509 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.462138    2565 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 14 19:10:52.469509 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.462141    2565 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 14 19:10:52.469509 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.462143    2565 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 14 19:10:52.469509 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.462146    2565 flags.go:64] FLAG: --healthz-port="10248"
Jul 14 19:10:52.469509 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.462149    2565 flags.go:64] FLAG: --help="false"
Jul 14 19:10:52.469509 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.462152    2565 flags.go:64] FLAG: --hostname-override="ip-10-0-129-23.ec2.internal"
Jul 14 19:10:52.469509 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.462155    2565 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 14 19:10:52.469509 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.462158    2565 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 14 19:10:52.469509 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.462161    2565 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 14 19:10:52.469509 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.462164    2565 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 14 19:10:52.469509 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.462167    2565 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 14 19:10:52.469509 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.462170    2565 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 14 19:10:52.469509 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.462173    2565 flags.go:64] FLAG: --image-service-endpoint=""
Jul 14 19:10:52.469509 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.462176    2565 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 14 19:10:52.469509 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.462179    2565 flags.go:64] FLAG: --kube-api-burst="100"
Jul 14 19:10:52.469509 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.462182    2565 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 14 19:10:52.469509 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.462185    2565 flags.go:64] FLAG: --kube-api-qps="50"
Jul 14 19:10:52.469509 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.462187    2565 flags.go:64] FLAG: --kube-reserved=""
Jul 14 19:10:52.470173 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.462191    2565 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 14 19:10:52.470173 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.462194    2565 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 14 19:10:52.470173 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.462197    2565 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 14 19:10:52.470173 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.462200    2565 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 14 19:10:52.470173 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.462202    2565 flags.go:64] FLAG: --lock-file=""
Jul 14 19:10:52.470173 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.462205    2565 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 14 19:10:52.470173 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.462208    2565 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 14 19:10:52.470173 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.462211    2565 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 14 19:10:52.470173 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.462215    2565 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 14 19:10:52.470173 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.462218    2565 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 14 19:10:52.470173 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.462221    2565 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 14 19:10:52.470173 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.462224    2565 flags.go:64] FLAG: --logging-format="text"
Jul 14 19:10:52.470173 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.462226    2565 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 14 19:10:52.470173 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.462230    2565 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 14 19:10:52.470173 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.462232    2565 flags.go:64] FLAG: --manifest-url=""
Jul 14 19:10:52.470173 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.462235    2565 flags.go:64] FLAG: --manifest-url-header=""
Jul 14 19:10:52.470173 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.462239    2565 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 14 19:10:52.470173 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.462242    2565 flags.go:64] FLAG: --max-open-files="1000000"
Jul 14 19:10:52.470173 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.462246    2565 flags.go:64] FLAG: --max-pods="110"
Jul 14 19:10:52.470173 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.462249    2565 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 14 19:10:52.470173 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.462251    2565 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 14 19:10:52.470173 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.462254    2565 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 14 19:10:52.470173 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.462257    2565 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 14 19:10:52.470173 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.462260    2565 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 14 19:10:52.470173 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.462263    2565 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 14 19:10:52.470768 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.462266    2565 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 14 19:10:52.470768 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.462273    2565 flags.go:64] FLAG: --node-status-max-images="50"
Jul 14 19:10:52.470768 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.462276    2565 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 14 19:10:52.470768 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.462279    2565 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 14 19:10:52.470768 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.462282    2565 flags.go:64] FLAG: --pod-cidr=""
Jul 14 19:10:52.470768 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.462284    2565 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926"
Jul 14 19:10:52.470768 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.462290    2565 flags.go:64] FLAG: --pod-manifest-path=""
Jul 14 19:10:52.470768 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.462292    2565 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 14 19:10:52.470768 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.462295    2565 flags.go:64] FLAG: --pods-per-core="0"
Jul 14 19:10:52.470768 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.462298    2565 flags.go:64] FLAG: --port="10250"
Jul 14 19:10:52.470768 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.462301    2565 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 14 19:10:52.470768 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.462304    2565 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0b34c3a51d42746cd"
Jul 14 19:10:52.470768 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.462307    2565 flags.go:64] FLAG: --qos-reserved=""
Jul 14 19:10:52.470768 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.462310    2565 flags.go:64] FLAG: --read-only-port="10255"
Jul 14 19:10:52.470768 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.462312    2565 flags.go:64] FLAG: --register-node="true"
Jul 14 19:10:52.470768 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.462315    2565 flags.go:64] FLAG: --register-with-taints=""
Jul 14 19:10:52.470768 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.462318    2565 flags.go:64] FLAG: --registry-burst="10"
Jul 14 19:10:52.470768 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.462321    2565 flags.go:64] FLAG: --registry-qps="5"
Jul 14 19:10:52.470768 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.462324    2565 flags.go:64] FLAG: --reserved-cpus=""
Jul 14 19:10:52.470768 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.462326    2565 flags.go:64] FLAG: --reserved-memory=""
Jul 14 19:10:52.470768 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.462330    2565 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 14 19:10:52.470768 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.462332    2565 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 14 19:10:52.470768 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.462337    2565 flags.go:64] FLAG: --rotate-certificates="false"
Jul 14 19:10:52.470768 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.462340    2565 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 14 19:10:52.470768 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.462343    2565 flags.go:64] FLAG: --runonce="false"
Jul 14 19:10:52.471379 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.462345    2565 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 14 19:10:52.471379 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.462348    2565 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 14 19:10:52.471379 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.462351    2565 flags.go:64] FLAG: --seccomp-default="false"
Jul 14 19:10:52.471379 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.462354    2565 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 14 19:10:52.471379 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.462357    2565 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 14 19:10:52.471379 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.462360    2565 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 14 19:10:52.471379 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.462363    2565 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 14 19:10:52.471379 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.462366    2565 flags.go:64] FLAG: --storage-driver-password="root"
Jul 14 19:10:52.471379 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.462368    2565 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 14 19:10:52.471379 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.462371    2565 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 14 19:10:52.471379 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.462374    2565 flags.go:64] FLAG: --storage-driver-user="root"
Jul 14 19:10:52.471379 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.462377    2565 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 14 19:10:52.471379 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.462380    2565 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 14 19:10:52.471379 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.462382    2565 flags.go:64] FLAG: --system-cgroups=""
Jul 14 19:10:52.471379 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.462385    2565 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 14 19:10:52.471379 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.462390    2565 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 14 19:10:52.471379 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.462393    2565 flags.go:64] FLAG: --tls-cert-file=""
Jul 14 19:10:52.471379 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.462396    2565 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 14 19:10:52.471379 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.462400    2565 flags.go:64] FLAG: --tls-min-version=""
Jul 14 19:10:52.471379 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.462402    2565 flags.go:64] FLAG: --tls-private-key-file=""
Jul 14 19:10:52.471379 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.462405    2565 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 14 19:10:52.471379 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.462407    2565 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 14 19:10:52.471379 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.462410    2565 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 14 19:10:52.471379 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.462413    2565 flags.go:64] FLAG: --v="2"
Jul 14 19:10:52.471379 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.462416    2565 flags.go:64] FLAG: --version="false"
Jul 14 19:10:52.472009 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.462420    2565 flags.go:64] FLAG: --vmodule=""
Jul 14 19:10:52.472009 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.462423    2565 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 14 19:10:52.472009 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.462426    2565 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 14 19:10:52.472009 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.462530    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 14 19:10:52.472009 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.462535    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 14 19:10:52.472009 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.462538    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 14 19:10:52.472009 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.462541    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 14 19:10:52.472009 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.462544    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 14 19:10:52.472009 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.462547    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 14 19:10:52.472009 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.462550    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 14 19:10:52.472009 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.462553    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 14 19:10:52.472009 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.462556    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 14 19:10:52.472009 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.462558    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 14 19:10:52.472009 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.462561    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 14 19:10:52.472009 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.462564    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 14 19:10:52.472009 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.462566    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 14 19:10:52.472009 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.462569    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 14 19:10:52.472009 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.462571    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 14 19:10:52.472009 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.462573    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 14 19:10:52.472009 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.462576    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 14 19:10:52.472495 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.462578    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 14 19:10:52.472495 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.462581    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 14 19:10:52.472495 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.462583    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 14 19:10:52.472495 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.462586    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 14 19:10:52.472495 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.462588    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 14 19:10:52.472495 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.462591    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 14 19:10:52.472495 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.462594    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 14 19:10:52.472495 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.462596    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 14 19:10:52.472495 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.462599    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 14 19:10:52.472495 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.462601    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 14 19:10:52.472495 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.462604    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 14 19:10:52.472495 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.462607    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 14 19:10:52.472495 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.462609    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 14 19:10:52.472495 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.462612    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 14 19:10:52.472495 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.462614    2565 feature_gate.go:328] unrecognized feature gate: Example
Jul 14 19:10:52.472495 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.462617    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 14 19:10:52.472495 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.462620    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 14 19:10:52.472495 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.462623    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 14 19:10:52.472495 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.462625    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 14 19:10:52.472495 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.462628    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 14 19:10:52.473041 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.462630    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 14 19:10:52.473041 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.462633    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 14 19:10:52.473041 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.462636    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 14 19:10:52.473041 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.462638    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 14 19:10:52.473041 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.462640    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 14 19:10:52.473041 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.462645    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 14 19:10:52.473041 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.462648    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 14 19:10:52.473041 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.462650    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 14 19:10:52.473041 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.462653    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 14 19:10:52.473041 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.462655    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 14 19:10:52.473041 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.462658    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 14 19:10:52.473041 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.462660    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 14 19:10:52.473041 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.462663    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 14 19:10:52.473041 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.462665    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 14 19:10:52.473041 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.462667    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 14 19:10:52.473041 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.462670    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 14 19:10:52.473041 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.462672    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 14 19:10:52.473041 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.462675    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 14 19:10:52.473041 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.462678    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 14 19:10:52.473041 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.462680    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 14 19:10:52.473517 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.462683    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 14 19:10:52.473517 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.462685    2565 feature_gate.go:328] unrecognized feature gate: Example2
Jul 14 19:10:52.473517 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.462688    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 14 19:10:52.473517 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.462690    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 14 19:10:52.473517 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.462692    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 14 19:10:52.473517 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.462696    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 14 19:10:52.473517 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.462699    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 14 19:10:52.473517 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.462702    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 14 19:10:52.473517 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.462706    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 14 19:10:52.473517 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.462710    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 14 19:10:52.473517 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.462713    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 14 19:10:52.473517 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.462716    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 14 19:10:52.473517 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.462719    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 14 19:10:52.473517 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.462722    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 14 19:10:52.473517 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.462724    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 14 19:10:52.473517 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.462727    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 14 19:10:52.473517 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.462729    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 14 19:10:52.473517 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.462733    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 14 19:10:52.473517 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.462736    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 14 19:10:52.474044 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.462738    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 14 19:10:52.474044 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.462741    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 14 19:10:52.474044 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.462743    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 14 19:10:52.474044 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.462746    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 14 19:10:52.474044 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.462748    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 14 19:10:52.474044 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.462750    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 14 19:10:52.474044 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.462753    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 14 19:10:52.474044 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.462755    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 14 19:10:52.474044 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.462757    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 14 19:10:52.474044 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.462760    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 14 19:10:52.474044 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.462762    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 14 19:10:52.474044 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.462765    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 14 19:10:52.474044 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.462767    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 14 19:10:52.474044 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.462770    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 14 19:10:52.474044 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.462773    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 14 19:10:52.474044 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.462776    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 14 19:10:52.474044 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.462779    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 14 19:10:52.474044 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.462798    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 14 19:10:52.474044 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.462802    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 14 19:10:52.474527 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.462807    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 14 19:10:52.474527 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.462811    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 14 19:10:52.474527 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.462816    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 14 19:10:52.474527 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.462819    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 14 19:10:52.474527 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.463385    2565 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 14 19:10:52.474527 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.470856    2565 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 14 19:10:52.474527 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.470871    2565 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 14 19:10:52.474527 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.470889    2565 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 14 19:10:52.474527 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.470895    2565 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 14 19:10:52.474527 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.470947    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 14 19:10:52.474527 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.470952    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 14 19:10:52.474527 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.470955    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 14 19:10:52.474527 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.470958    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 14 19:10:52.474527 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.470960    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 14 19:10:52.474527 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.470963    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 14 19:10:52.475032 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.470965    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 14 19:10:52.475032 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.470968    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 14 19:10:52.475032 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.470971    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 14 19:10:52.475032 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.470973    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 14 19:10:52.475032 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.470975    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 14 19:10:52.475032 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.470978    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 14 19:10:52.475032 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.470980    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 14 19:10:52.475032 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.470983    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 14 19:10:52.475032 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.470987    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 14 19:10:52.475032 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.470990    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 14 19:10:52.475032 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.470994    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 14 19:10:52.475032 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.470996    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 14 19:10:52.475032 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.470999    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 14 19:10:52.475032 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.471001    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 14 19:10:52.475032 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.471004    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 14 19:10:52.475032 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.471007    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 14 19:10:52.475032 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.471009    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 14 19:10:52.475032 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.471013    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 14 19:10:52.475032 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.471017    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 14 19:10:52.475520 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.471020    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 14 19:10:52.475520 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.471022    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 14 19:10:52.475520 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.471025    2565 feature_gate.go:328] unrecognized feature gate: Example
Jul 14 19:10:52.475520 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.471029    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 14 19:10:52.475520 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.471032    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 14 19:10:52.475520 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.471035    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 14 19:10:52.475520 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.471038    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 14 19:10:52.475520 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.471040    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 14 19:10:52.475520 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.471043    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 14 19:10:52.475520 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.471046    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 14 19:10:52.475520 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.471049    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 14 19:10:52.475520 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.471051    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 14 19:10:52.475520 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.471053    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 14 19:10:52.475520 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.471056    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 14 19:10:52.475520 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.471058    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 14 19:10:52.475520 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.471060    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 14 19:10:52.475520 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.471063    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 14 19:10:52.475520 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.471066    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 14 19:10:52.475520 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.471068    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 14 19:10:52.475520 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.471071    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 14 19:10:52.476111 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.471073    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 14 19:10:52.476111 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.471076    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 14 19:10:52.476111 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.471078    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 14 19:10:52.476111 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.471081    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 14 19:10:52.476111 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.471083    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 14 19:10:52.476111 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.471085    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 14 19:10:52.476111 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.471088    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 14 19:10:52.476111 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.471091    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 14 19:10:52.476111 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.471093    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 14 19:10:52.476111 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.471096    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 14 19:10:52.476111 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.471098    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 14 19:10:52.476111 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.471101    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 14 19:10:52.476111 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.471103    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 14 19:10:52.476111 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.471106    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 14 19:10:52.476111 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.471109    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 14 19:10:52.476111 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.471112    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 14 19:10:52.476111 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.471114    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 14 19:10:52.476111 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.471117    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 14 19:10:52.476111 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.471119    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 14 19:10:52.476837 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.471122    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 14 19:10:52.476837 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.471124    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 14 19:10:52.476837 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.471127    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 14 19:10:52.476837 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.471129    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 14 19:10:52.476837 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.471132    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 14 19:10:52.476837 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.471134    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 14 19:10:52.476837 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.471136    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 14 19:10:52.476837 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.471139    2565 feature_gate.go:328] unrecognized feature gate: Example2
Jul 14 19:10:52.476837 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.471141    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 14 19:10:52.476837 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.471144    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 14 19:10:52.476837 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.471146    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 14 19:10:52.476837 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.471149    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 14 19:10:52.476837 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.471153    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 14 19:10:52.476837 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.471156    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 14 19:10:52.476837 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.471158    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 14 19:10:52.476837 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.471162    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 14 19:10:52.476837 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.471164    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 14 19:10:52.476837 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.471167    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 14 19:10:52.476837 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.471169    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 14 19:10:52.476837 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.471172    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 14 19:10:52.477586 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.471174    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 14 19:10:52.477586 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.471177    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 14 19:10:52.477586 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.471179    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 14 19:10:52.477586 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.471181    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 14 19:10:52.477586 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.471184    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 14 19:10:52.477586 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.471187    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 14 19:10:52.477586 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.471189    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 14 19:10:52.477586 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.471192    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 14 19:10:52.477586 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.471195    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 14 19:10:52.477586 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.471197    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 14 19:10:52.477586 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.471200    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 14 19:10:52.477586 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.471202    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 14 19:10:52.477586 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.471205    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 14 19:10:52.477586 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.471207    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 14 19:10:52.477586 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.471210    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 14 19:10:52.478000 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.471215    2565 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 14 19:10:52.478000 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.471321    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 14 19:10:52.478000 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.471325    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 14 19:10:52.478000 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.471328    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 14 19:10:52.478000 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.471331    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 14 19:10:52.478000 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.471334    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 14 19:10:52.478000 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.471336    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 14 19:10:52.478000 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.471339    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 14 19:10:52.478000 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.471342    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 14 19:10:52.478000 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.471345    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 14 19:10:52.478000 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.471348    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 14 19:10:52.478000 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.471350    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 14 19:10:52.478000 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.471353    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 14 19:10:52.478000 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.471356    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 14 19:10:52.478586 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.471358    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 14 19:10:52.478586 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.471361    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 14 19:10:52.478586 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.471363    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 14 19:10:52.478586 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.471365    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 14 19:10:52.478586 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.471368    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 14 19:10:52.478586 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.471370    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 14 19:10:52.478586 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.471373    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 14 19:10:52.478586 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.471376    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 14 19:10:52.478586 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.471378    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 14 19:10:52.478586 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.471381    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 14 19:10:52.478586 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.471383    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 14 19:10:52.478586 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.471386    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 14 19:10:52.478586 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.471389    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 14 19:10:52.478586 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.471391    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 14 19:10:52.478586 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.471394    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 14 19:10:52.478586 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.471396    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 14 19:10:52.478586 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.471399    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 14 19:10:52.478586 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.471401    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 14 19:10:52.478586 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.471404    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 14 19:10:52.479225 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.471406    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 14 19:10:52.479225 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.471408    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 14 19:10:52.479225 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.471411    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 14 19:10:52.479225 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.471414    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 14 19:10:52.479225 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.471418    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 14 19:10:52.479225 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.471420    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 14 19:10:52.479225 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.471423    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 14 19:10:52.479225 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.471426    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 14 19:10:52.479225 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.471428    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 14 19:10:52.479225 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.471431    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 14 19:10:52.479225 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.471433    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 14 19:10:52.479225 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.471436    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 14 19:10:52.479225 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.471438    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 14 19:10:52.479225 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.471442    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 14 19:10:52.479225 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.471444    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 14 19:10:52.479225 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.471446    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 14 19:10:52.479225 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.471449    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 14 19:10:52.479225 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.471451    2565 feature_gate.go:328] unrecognized feature gate: Example
Jul 14 19:10:52.479225 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.471454    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 14 19:10:52.479225 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.471456    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 14 19:10:52.479772 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.471459    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 14 19:10:52.479772 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.471462    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 14 19:10:52.479772 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.471465    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 14 19:10:52.479772 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.471468    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 14 19:10:52.479772 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.471472    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 14 19:10:52.479772 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.471476    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 14 19:10:52.479772 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.471479    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 14 19:10:52.479772 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.471482    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 14 19:10:52.479772 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.471485    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 14 19:10:52.479772 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.471487    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 14 19:10:52.479772 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.471490    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 14 19:10:52.479772 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.471492    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 14 19:10:52.479772 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.471494    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 14 19:10:52.479772 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.471497    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 14 19:10:52.479772 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.471499    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 14 19:10:52.479772 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.471502    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 14 19:10:52.479772 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.471504    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 14 19:10:52.479772 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.471506    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 14 19:10:52.479772 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.471509    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 14 19:10:52.480443 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.471511    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 14 19:10:52.480443 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.471514    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 14 19:10:52.480443 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.471516    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 14 19:10:52.480443 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.471518    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 14 19:10:52.480443 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.471521    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 14 19:10:52.480443 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.471523    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 14 19:10:52.480443 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.471525    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 14 19:10:52.480443 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.471529    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 14 19:10:52.480443 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.471531    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 14 19:10:52.480443 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.471534    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 14 19:10:52.480443 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.471536    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 14 19:10:52.480443 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.471538    2565 feature_gate.go:328] unrecognized feature gate: Example2
Jul 14 19:10:52.480443 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.471541    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 14 19:10:52.480443 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.471544    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 14 19:10:52.480443 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.471546    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 14 19:10:52.480443 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.471548    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 14 19:10:52.480443 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.471551    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 14 19:10:52.480443 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.471554    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 14 19:10:52.480443 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.471556    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 14 19:10:52.480443 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.471558    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 14 19:10:52.480955 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.471561    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 14 19:10:52.480955 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.471563    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 14 19:10:52.480955 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.471566    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 14 19:10:52.480955 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.471568    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 14 19:10:52.480955 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.471570    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 14 19:10:52.480955 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.471573    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 14 19:10:52.480955 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.471575    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 14 19:10:52.480955 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:52.471577    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 14 19:10:52.480955 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.471582    2565 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 14 19:10:52.480955 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.471670    2565 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 14 19:10:52.480955 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.473428    2565 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 14 19:10:52.480955 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.474549    2565 server.go:1019] "Starting client certificate rotation"
Jul 14 19:10:52.480955 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.474664    2565 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 14 19:10:52.480955 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.474714    2565 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 14 19:10:52.481374 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.476427    2565 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 14 19:10:52.481374 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.477604    2565 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 14 19:10:52.488513 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.488492    2565 log.go:25] "Validated CRI v1 runtime API"
Jul 14 19:10:52.490342 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.490327    2565 log.go:25] "Validated CRI v1 image API"
Jul 14 19:10:52.491100 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.491087    2565 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 14 19:10:52.494888 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.494871    2565 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 e8861938-d435-48cf-b9c0-3280c2e06936:/dev/nvme0n1p4 f5668a97-9026-4c79-9c1b-13703ced62a7:/dev/nvme0n1p3]
Jul 14 19:10:52.494952 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.494888    2565 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 14 19:10:52.500532 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.500512    2565 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 14 19:10:52.500711 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.500611    2565 manager.go:216] Machine: {Timestamp:2026-07-14 19:10:52.500119399 +0000 UTC m=+0.293343858 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100878 MemoryCapacity:32812179456 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2cf10d894fc82637750fbad78f617a SystemUUID:ec2cf10d-894f-c826-3775-0fbad78f617a BootID:473826de-31e7-4d15-8125-46b16d00a403 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406089728 Type:vfs Inodes:4005393 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562439168 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:c3:ec:1a:d9:c5 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:c3:ec:1a:d9:c5 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:42:3a:f9:3b:cd:c6 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812179456 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 14 19:10:52.500711 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.500710    2565 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 14 19:10:52.500819 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.500775    2565 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 14 19:10:52.504148 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.504124    2565 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 14 19:10:52.504269 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.504151    2565 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-129-23.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 14 19:10:52.504752 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.504743    2565 topology_manager.go:138] "Creating topology manager with none policy"
Jul 14 19:10:52.504801 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.504754    2565 container_manager_linux.go:309] "Creating device plugin manager"
Jul 14 19:10:52.504801 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.504761    2565 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 14 19:10:52.505297 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.505286    2565 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 14 19:10:52.506247 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.506237    2565 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 14 19:10:52.508538 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.508526    2565 state_mem.go:36] "Initialized new in-memory state store"
Jul 14 19:10:52.508781 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.508772    2565 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 14 19:10:52.508833 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.508819    2565 kubelet.go:486] "Attempting to sync node with API server"
Jul 14 19:10:52.508863 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.508833    2565 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 14 19:10:52.508863 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.508853    2565 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 14 19:10:52.508925 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.508864    2565 kubelet.go:398] "Adding apiserver pod source"
Jul 14 19:10:52.508925 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.508874    2565 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 14 19:10:52.509202 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.509177    2565 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 14 19:10:52.509202 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.509194    2565 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 14 19:10:52.511161 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.511144    2565 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 14 19:10:52.512636 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.512619    2565 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 14 19:10:52.512722 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.512658    2565 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 14 19:10:52.512874 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.512859    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 14 19:10:52.512939 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.512880    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 14 19:10:52.512939 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.512890    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 14 19:10:52.512939 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.512899    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 14 19:10:52.512939 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.512911    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 14 19:10:52.512939 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.512920    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 14 19:10:52.513232 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.513222    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 14 19:10:52.513289 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.513235    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 14 19:10:52.513289 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.513246    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 14 19:10:52.513289 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.513254    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 14 19:10:52.513289 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.513267    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 14 19:10:52.513289 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.513278    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 14 19:10:52.514010 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.513998    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 14 19:10:52.514071 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.514013    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 14 19:10:52.516935 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.516912    2565 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-129-23.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 14 19:10:52.517188 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.517168    2565 server.go:1268] "Started kubelet"
Jul 14 19:10:52.517337 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.517286    2565 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 14 19:10:52.517410 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:10:52.517272    2565 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 14 19:10:52.517459 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.517392    2565 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 14 19:10:52.517502 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.517457    2565 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 14 19:10:52.517502 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:10:52.517425    2565 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-129-23.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 14 19:10:52.518053 ip-10-0-129-23 systemd[1]: Started Kubernetes Kubelet.
Jul 14 19:10:52.518479 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.518418    2565 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 14 19:10:52.519695 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.519677    2565 server.go:310] "Adding debug handlers to kubelet server"
Jul 14 19:10:52.521921 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:10:52.521118    2565 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-23.ec2.internal.18c23db59699391b  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-23.ec2.internal,UID:ip-10-0-129-23.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-129-23.ec2.internal,},FirstTimestamp:2026-07-14 19:10:52.517136667 +0000 UTC m=+0.310361107,LastTimestamp:2026-07-14 19:10:52.517136667 +0000 UTC m=+0.310361107,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-23.ec2.internal,}"
Jul 14 19:10:52.522159 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:10:52.522142    2565 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 14 19:10:52.522734 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.522714    2565 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 14 19:10:52.522842 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.522731    2565 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 14 19:10:52.522900 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:10:52.522851    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-23.ec2.internal\" not found"
Jul 14 19:10:52.523124 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.523095    2565 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-d562v"
Jul 14 19:10:52.523241 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.523224    2565 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 14 19:10:52.523314 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.523243    2565 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 14 19:10:52.523367 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.523347    2565 reconstruct.go:97] "Volume reconstruction finished"
Jul 14 19:10:52.523367 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.523356    2565 reconciler.go:29] "Reconciler: start to sync state"
Jul 14 19:10:52.523493 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.523471    2565 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 14 19:10:52.523686 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.523670    2565 factory.go:55] Registering systemd factory
Jul 14 19:10:52.523781 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.523710    2565 factory.go:223] Registration of the systemd container factory successfully
Jul 14 19:10:52.523919 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.523900    2565 factory.go:153] Registering CRI-O factory
Jul 14 19:10:52.523919 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.523910    2565 factory.go:223] Registration of the crio container factory successfully
Jul 14 19:10:52.524021 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.523948    2565 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 14 19:10:52.524021 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.523964    2565 factory.go:103] Registering Raw factory
Jul 14 19:10:52.524021 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.523976    2565 manager.go:1196] Started watching for new ooms in manager
Jul 14 19:10:52.524897 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.524882    2565 manager.go:349] Starting recovery of all containers
Jul 14 19:10:52.526417 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:10:52.526388    2565 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-129-23.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 14 19:10:52.526513 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:10:52.526472    2565 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 14 19:10:52.533017 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.532856    2565 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-d562v"
Jul 14 19:10:52.537701 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.537685    2565 manager.go:354] Recovery completed
Jul 14 19:10:52.538862 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:10:52.538838    2565 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory
Jul 14 19:10:52.541673 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.541659    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 14 19:10:52.543613 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.543597    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-23.ec2.internal" event="NodeHasSufficientMemory"
Jul 14 19:10:52.543684 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.543625    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-23.ec2.internal" event="NodeHasNoDiskPressure"
Jul 14 19:10:52.543684 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.543636    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-23.ec2.internal" event="NodeHasSufficientPID"
Jul 14 19:10:52.544214 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.544199    2565 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 14 19:10:52.544214 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.544211    2565 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 14 19:10:52.544349 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.544229    2565 state_mem.go:36] "Initialized new in-memory state store"
Jul 14 19:10:52.544349 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.544242    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 14 19:10:52.545194 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.545175    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-23.ec2.internal" event="NodeHasSufficientMemory"
Jul 14 19:10:52.545194 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.545189    2565 policy_none.go:49] "None policy: Start"
Jul 14 19:10:52.545336 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.545202    2565 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 14 19:10:52.545336 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.545209    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-23.ec2.internal" event="NodeHasNoDiskPressure"
Jul 14 19:10:52.545336 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.545211    2565 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 14 19:10:52.545336 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.545226    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-23.ec2.internal" event="NodeHasSufficientPID"
Jul 14 19:10:52.545740 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:10:52.545660    2565 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-23.ec2.internal.18c23db5982d364a  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-23.ec2.internal,UID:ip-10-0-129-23.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-129-23.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-129-23.ec2.internal,},FirstTimestamp:2026-07-14 19:10:52.54361249 +0000 UTC m=+0.336836929,LastTimestamp:2026-07-14 19:10:52.54361249 +0000 UTC m=+0.336836929,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-23.ec2.internal,}"
Jul 14 19:10:52.546067 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.546056    2565 policy_none.go:47] "Start"
Jul 14 19:10:52.578335 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.578321    2565 manager.go:337] "Starting Device Plugin manager"
Jul 14 19:10:52.578393 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:10:52.578352    2565 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 14 19:10:52.578393 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.578361    2565 server.go:87] "Starting device plugin registration server"
Jul 14 19:10:52.578590 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.578573    2565 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 14 19:10:52.578675 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.578589    2565 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 14 19:10:52.578675 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.578657    2565 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 14 19:10:52.578772 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.578731    2565 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 14 19:10:52.578772 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.578739    2565 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 14 19:10:52.579192 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:10:52.579175    2565 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 14 19:10:52.579269 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:10:52.579225    2565 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-129-23.ec2.internal\" not found"
Jul 14 19:10:52.679278 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.679244    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 14 19:10:52.680166 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.680151    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-23.ec2.internal" event="NodeHasSufficientMemory"
Jul 14 19:10:52.680215 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.680180    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-23.ec2.internal" event="NodeHasNoDiskPressure"
Jul 14 19:10:52.680215 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.680190    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-23.ec2.internal" event="NodeHasSufficientPID"
Jul 14 19:10:52.680215 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.680213    2565 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-129-23.ec2.internal"
Jul 14 19:10:52.688026 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.688008    2565 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-129-23.ec2.internal"
Jul 14 19:10:52.688110 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:10:52.688029    2565 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-129-23.ec2.internal\": node \"ip-10-0-129-23.ec2.internal\" not found"
Jul 14 19:10:52.703274 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:10:52.703256    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-23.ec2.internal\" not found"
Jul 14 19:10:52.727897 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.727852    2565 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 14 19:10:52.729249 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.729234    2565 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 14 19:10:52.729311 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.729267    2565 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 14 19:10:52.729311 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.729283    2565 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 14 19:10:52.729391 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:10:52.729310    2565 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 14 19:10:52.731820 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.731799    2565 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 14 19:10:52.803752 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:10:52.803730    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-23.ec2.internal\" not found"
Jul 14 19:10:52.830150 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.830130    2565 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-23.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-129-23.ec2.internal"]
Jul 14 19:10:52.830208 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.830200    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 14 19:10:52.832495 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.832480    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-23.ec2.internal" event="NodeHasSufficientMemory"
Jul 14 19:10:52.832576 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.832511    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-23.ec2.internal" event="NodeHasNoDiskPressure"
Jul 14 19:10:52.832576 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.832527    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-23.ec2.internal" event="NodeHasSufficientPID"
Jul 14 19:10:52.833710 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.833695    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 14 19:10:52.833858 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.833842    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-23.ec2.internal"
Jul 14 19:10:52.833907 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.833877    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 14 19:10:52.834804 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.834774    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-23.ec2.internal" event="NodeHasSufficientMemory"
Jul 14 19:10:52.834885 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.834816    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-23.ec2.internal" event="NodeHasNoDiskPressure"
Jul 14 19:10:52.834885 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.834834    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-23.ec2.internal" event="NodeHasSufficientPID"
Jul 14 19:10:52.834885 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.834862    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-23.ec2.internal" event="NodeHasSufficientMemory"
Jul 14 19:10:52.835029 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.834888    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-23.ec2.internal" event="NodeHasNoDiskPressure"
Jul 14 19:10:52.835029 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.834901    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-23.ec2.internal" event="NodeHasSufficientPID"
Jul 14 19:10:52.835865 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.835851    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-23.ec2.internal"
Jul 14 19:10:52.835931 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.835875    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 14 19:10:52.836488 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.836471    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-23.ec2.internal" event="NodeHasSufficientMemory"
Jul 14 19:10:52.836574 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.836502    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-23.ec2.internal" event="NodeHasNoDiskPressure"
Jul 14 19:10:52.836574 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.836514    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-23.ec2.internal" event="NodeHasSufficientPID"
Jul 14 19:10:52.852341 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:10:52.852325    2565 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-23.ec2.internal\" not found" node="ip-10-0-129-23.ec2.internal"
Jul 14 19:10:52.855692 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:10:52.855678    2565 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-23.ec2.internal\" not found" node="ip-10-0-129-23.ec2.internal"
Jul 14 19:10:52.904586 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:10:52.904565    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-23.ec2.internal\" not found"
Jul 14 19:10:52.925124 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.925101    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/671780e245728d8f6e843008df2b039a-config\") pod \"kube-apiserver-proxy-ip-10-0-129-23.ec2.internal\" (UID: \"671780e245728d8f6e843008df2b039a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-23.ec2.internal"
Jul 14 19:10:52.925213 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.925130    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/fa1176d3df3d66efbed1343da676e97f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-23.ec2.internal\" (UID: \"fa1176d3df3d66efbed1343da676e97f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-23.ec2.internal"
Jul 14 19:10:52.925213 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:52.925155    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fa1176d3df3d66efbed1343da676e97f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-23.ec2.internal\" (UID: \"fa1176d3df3d66efbed1343da676e97f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-23.ec2.internal"
Jul 14 19:10:53.005400 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:10:53.005347    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-23.ec2.internal\" not found"
Jul 14 19:10:53.025849 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:53.025824    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/671780e245728d8f6e843008df2b039a-config\") pod \"kube-apiserver-proxy-ip-10-0-129-23.ec2.internal\" (UID: \"671780e245728d8f6e843008df2b039a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-23.ec2.internal"
Jul 14 19:10:53.025925 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:53.025858    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/fa1176d3df3d66efbed1343da676e97f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-23.ec2.internal\" (UID: \"fa1176d3df3d66efbed1343da676e97f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-23.ec2.internal"
Jul 14 19:10:53.025925 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:53.025882    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fa1176d3df3d66efbed1343da676e97f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-23.ec2.internal\" (UID: \"fa1176d3df3d66efbed1343da676e97f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-23.ec2.internal"
Jul 14 19:10:53.025925 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:53.025909    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fa1176d3df3d66efbed1343da676e97f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-23.ec2.internal\" (UID: \"fa1176d3df3d66efbed1343da676e97f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-23.ec2.internal"
Jul 14 19:10:53.026044 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:53.025932    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/671780e245728d8f6e843008df2b039a-config\") pod \"kube-apiserver-proxy-ip-10-0-129-23.ec2.internal\" (UID: \"671780e245728d8f6e843008df2b039a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-23.ec2.internal"
Jul 14 19:10:53.026044 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:53.025945    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/fa1176d3df3d66efbed1343da676e97f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-23.ec2.internal\" (UID: \"fa1176d3df3d66efbed1343da676e97f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-23.ec2.internal"
Jul 14 19:10:53.105970 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:10:53.105942    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-23.ec2.internal\" not found"
Jul 14 19:10:53.154493 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:53.154474    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-23.ec2.internal"
Jul 14 19:10:53.158468 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:53.158145    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-23.ec2.internal"
Jul 14 19:10:53.206618 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:10:53.206594    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-23.ec2.internal\" not found"
Jul 14 19:10:53.307158 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:10:53.307098    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-23.ec2.internal\" not found"
Jul 14 19:10:53.407689 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:10:53.407658    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-23.ec2.internal\" not found"
Jul 14 19:10:53.474150 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:53.474126    2565 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 14 19:10:53.474681 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:53.474251    2565 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 14 19:10:53.508450 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:10:53.508427    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-23.ec2.internal\" not found"
Jul 14 19:10:53.536039 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:53.535997    2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-13 19:05:53 +0000 UTC" deadline="2027-12-26 17:22:44.584257097 +0000 UTC"
Jul 14 19:10:53.536039 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:53.536029    2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12718h11m51.04823065s"
Jul 14 19:10:54.841708 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:10:54.841683    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-23.ec2.internal\" not found"
Jul 14 19:10:54.868833 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:54.868814    2565 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 14 19:10:54.878140 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:54.878113    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod671780e245728d8f6e843008df2b039a.slice/crio-b762795558b78e8dae24e65f1b45322fb574f40f15096c0f4e523db0a87fa675 WatchSource:0}: Error finding container b762795558b78e8dae24e65f1b45322fb574f40f15096c0f4e523db0a87fa675: Status 404 returned error can't find the container with id b762795558b78e8dae24e65f1b45322fb574f40f15096c0f4e523db0a87fa675
Jul 14 19:10:54.882105 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:54.882091    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 14 19:10:54.915300 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:54.915274    2565 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 14 19:10:54.918552 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:54.918532    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa1176d3df3d66efbed1343da676e97f.slice/crio-5dbe9cd769fa3fc56f5ec3b6b97d19dbd176357726d3da6a4c75ead38b3ba59c WatchSource:0}: Error finding container 5dbe9cd769fa3fc56f5ec3b6b97d19dbd176357726d3da6a4c75ead38b3ba59c: Status 404 returned error can't find the container with id 5dbe9cd769fa3fc56f5ec3b6b97d19dbd176357726d3da6a4c75ead38b3ba59c
Jul 14 19:10:54.956252 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:54.956229    2565 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-23.ec2.internal"
Jul 14 19:10:54.964149 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:54.964107    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-23.ec2.internal" event={"ID":"fa1176d3df3d66efbed1343da676e97f","Type":"ContainerStarted","Data":"5dbe9cd769fa3fc56f5ec3b6b97d19dbd176357726d3da6a4c75ead38b3ba59c"}
Jul 14 19:10:54.965142 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:54.965123    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-23.ec2.internal" event={"ID":"671780e245728d8f6e843008df2b039a","Type":"ContainerStarted","Data":"b762795558b78e8dae24e65f1b45322fb574f40f15096c0f4e523db0a87fa675"}
Jul 14 19:10:54.967167 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:54.967138    2565 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 14 19:10:54.968744 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:54.968730    2565 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-23.ec2.internal"
Jul 14 19:10:54.977472 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:54.977455    2565 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 14 19:10:55.323372 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.323346    2565 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 14 19:10:55.742098 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.742004    2565 apiserver.go:52] "Watching apiserver"
Jul 14 19:10:55.750737 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.750714    2565 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 14 19:10:55.751185 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.751126    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-lkbtz","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q9hq4","openshift-cluster-node-tuning-operator/tuned-k447l","openshift-dns/node-resolver-gx8lp","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-23.ec2.internal","openshift-multus/multus-z4v7q","openshift-multus/network-metrics-daemon-hbbrx","openshift-ovn-kubernetes/ovnkube-node-cqqv8","kube-system/konnectivity-agent-ppqk5","kube-system/kube-apiserver-proxy-ip-10-0-129-23.ec2.internal","openshift-image-registry/node-ca-kjr5k","openshift-multus/multus-additional-cni-plugins-ql9tj","openshift-network-diagnostics/network-check-target-xxs8n","openshift-network-operator/iptables-alerter-vmk5j"]
Jul 14 19:10:55.753273 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.753247    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hbbrx"
Jul 14 19:10:55.753399 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:10:55.753372    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hbbrx" podUID="a2ef2d8f-5f7b-41bd-b98a-2a272dd4090f"
Jul 14 19:10:55.754438 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.754409    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xxs8n"
Jul 14 19:10:55.754573 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:10:55.754477    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xxs8n" podUID="490a903e-0b54-40ef-82f2-4175faef060f"
Jul 14 19:10:55.755428 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.755404    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-k447l"
Jul 14 19:10:55.755756 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.755730    2565 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 14 19:10:55.756592 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.756564    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-gx8lp"
Jul 14 19:10:55.757913 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.757760    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-ql9tj"
Jul 14 19:10:55.758028 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.757922    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 14 19:10:55.758028 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.757979    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-mh4bp\""
Jul 14 19:10:55.758141 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.757924    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 14 19:10:55.759023 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.758785    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 14 19:10:55.759023 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.758868    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-z4v7q"
Jul 14 19:10:55.759023 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.758897    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 14 19:10:55.759023 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.758968    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-j2b4k\""
Jul 14 19:10:55.759903 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.759881    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-ppqk5"
Jul 14 19:10:55.760216 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.760055    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 14 19:10:55.761139 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.760597    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-f2wdd\""
Jul 14 19:10:55.762512 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.761260    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 14 19:10:55.762512 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.761326    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 14 19:10:55.762512 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.761338    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 14 19:10:55.762512 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.761663    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 14 19:10:55.762512 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.762097    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 14 19:10:55.762512 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.762138    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-svlgl\""
Jul 14 19:10:55.762512 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.762449    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-45f4p\""
Jul 14 19:10:55.763010 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.762885    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 14 19:10:55.763010 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.762903    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 14 19:10:55.764213 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.764187    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q9hq4"
Jul 14 19:10:55.764829 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.764788    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/aeff7a40-4f71-4be4-b327-d58a3fb0fc99-etc-modprobe-d\") pod \"tuned-k447l\" (UID: \"aeff7a40-4f71-4be4-b327-d58a3fb0fc99\") " pod="openshift-cluster-node-tuning-operator/tuned-k447l"
Jul 14 19:10:55.764829 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.764828    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/aeff7a40-4f71-4be4-b327-d58a3fb0fc99-lib-modules\") pod \"tuned-k447l\" (UID: \"aeff7a40-4f71-4be4-b327-d58a3fb0fc99\") " pod="openshift-cluster-node-tuning-operator/tuned-k447l"
Jul 14 19:10:55.764972 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.764854    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/aeff7a40-4f71-4be4-b327-d58a3fb0fc99-host\") pod \"tuned-k447l\" (UID: \"aeff7a40-4f71-4be4-b327-d58a3fb0fc99\") " pod="openshift-cluster-node-tuning-operator/tuned-k447l"
Jul 14 19:10:55.764972 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.764880    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9w5hd\" (UniqueName: \"kubernetes.io/projected/9d44b622-d76b-4616-af94-e7d9b6f2f67b-kube-api-access-9w5hd\") pod \"node-resolver-gx8lp\" (UID: \"9d44b622-d76b-4616-af94-e7d9b6f2f67b\") " pod="openshift-dns/node-resolver-gx8lp"
Jul 14 19:10:55.764972 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.764906    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a2ef2d8f-5f7b-41bd-b98a-2a272dd4090f-metrics-certs\") pod \"network-metrics-daemon-hbbrx\" (UID: \"a2ef2d8f-5f7b-41bd-b98a-2a272dd4090f\") " pod="openshift-multus/network-metrics-daemon-hbbrx"
Jul 14 19:10:55.764972 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.764962    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/aeff7a40-4f71-4be4-b327-d58a3fb0fc99-etc-sysctl-d\") pod \"tuned-k447l\" (UID: \"aeff7a40-4f71-4be4-b327-d58a3fb0fc99\") " pod="openshift-cluster-node-tuning-operator/tuned-k447l"
Jul 14 19:10:55.765231 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.764996    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/aeff7a40-4f71-4be4-b327-d58a3fb0fc99-etc-systemd\") pod \"tuned-k447l\" (UID: \"aeff7a40-4f71-4be4-b327-d58a3fb0fc99\") " pod="openshift-cluster-node-tuning-operator/tuned-k447l"
Jul 14 19:10:55.765231 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.765019    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/aeff7a40-4f71-4be4-b327-d58a3fb0fc99-run\") pod \"tuned-k447l\" (UID: \"aeff7a40-4f71-4be4-b327-d58a3fb0fc99\") " pod="openshift-cluster-node-tuning-operator/tuned-k447l"
Jul 14 19:10:55.765231 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.765056    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/aeff7a40-4f71-4be4-b327-d58a3fb0fc99-sys\") pod \"tuned-k447l\" (UID: \"aeff7a40-4f71-4be4-b327-d58a3fb0fc99\") " pod="openshift-cluster-node-tuning-operator/tuned-k447l"
Jul 14 19:10:55.765231 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.765091    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/aeff7a40-4f71-4be4-b327-d58a3fb0fc99-tmp\") pod \"tuned-k447l\" (UID: \"aeff7a40-4f71-4be4-b327-d58a3fb0fc99\") " pod="openshift-cluster-node-tuning-operator/tuned-k447l"
Jul 14 19:10:55.765231 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.765115    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jccnn\" (UniqueName: \"kubernetes.io/projected/aeff7a40-4f71-4be4-b327-d58a3fb0fc99-kube-api-access-jccnn\") pod \"tuned-k447l\" (UID: \"aeff7a40-4f71-4be4-b327-d58a3fb0fc99\") " pod="openshift-cluster-node-tuning-operator/tuned-k447l"
Jul 14 19:10:55.765231 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.765171    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/9d44b622-d76b-4616-af94-e7d9b6f2f67b-hosts-file\") pod \"node-resolver-gx8lp\" (UID: \"9d44b622-d76b-4616-af94-e7d9b6f2f67b\") " pod="openshift-dns/node-resolver-gx8lp"
Jul 14 19:10:55.765231 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.765205    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9d44b622-d76b-4616-af94-e7d9b6f2f67b-tmp-dir\") pod \"node-resolver-gx8lp\" (UID: \"9d44b622-d76b-4616-af94-e7d9b6f2f67b\") " pod="openshift-dns/node-resolver-gx8lp"
Jul 14 19:10:55.765501 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.765240    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/aeff7a40-4f71-4be4-b327-d58a3fb0fc99-var-lib-kubelet\") pod \"tuned-k447l\" (UID: \"aeff7a40-4f71-4be4-b327-d58a3fb0fc99\") " pod="openshift-cluster-node-tuning-operator/tuned-k447l"
Jul 14 19:10:55.765501 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.765268    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/aeff7a40-4f71-4be4-b327-d58a3fb0fc99-etc-tuned\") pod \"tuned-k447l\" (UID: \"aeff7a40-4f71-4be4-b327-d58a3fb0fc99\") " pod="openshift-cluster-node-tuning-operator/tuned-k447l"
Jul 14 19:10:55.765501 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.765296    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7wm4x\" (UniqueName: \"kubernetes.io/projected/a2ef2d8f-5f7b-41bd-b98a-2a272dd4090f-kube-api-access-7wm4x\") pod \"network-metrics-daemon-hbbrx\" (UID: \"a2ef2d8f-5f7b-41bd-b98a-2a272dd4090f\") " pod="openshift-multus/network-metrics-daemon-hbbrx"
Jul 14 19:10:55.765501 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.765324    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k77pn\" (UniqueName: \"kubernetes.io/projected/490a903e-0b54-40ef-82f2-4175faef060f-kube-api-access-k77pn\") pod \"network-check-target-xxs8n\" (UID: \"490a903e-0b54-40ef-82f2-4175faef060f\") " pod="openshift-network-diagnostics/network-check-target-xxs8n"
Jul 14 19:10:55.765501 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.765349    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/aeff7a40-4f71-4be4-b327-d58a3fb0fc99-etc-sysconfig\") pod \"tuned-k447l\" (UID: \"aeff7a40-4f71-4be4-b327-d58a3fb0fc99\") " pod="openshift-cluster-node-tuning-operator/tuned-k447l"
Jul 14 19:10:55.765501 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.765367    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/aeff7a40-4f71-4be4-b327-d58a3fb0fc99-etc-kubernetes\") pod \"tuned-k447l\" (UID: \"aeff7a40-4f71-4be4-b327-d58a3fb0fc99\") " pod="openshift-cluster-node-tuning-operator/tuned-k447l"
Jul 14 19:10:55.765501 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.765382    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/aeff7a40-4f71-4be4-b327-d58a3fb0fc99-etc-sysctl-conf\") pod \"tuned-k447l\" (UID: \"aeff7a40-4f71-4be4-b327-d58a3fb0fc99\") " pod="openshift-cluster-node-tuning-operator/tuned-k447l"
Jul 14 19:10:55.766173 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.766099    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-kjr5k"
Jul 14 19:10:55.767417 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.767389    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 14 19:10:55.767514 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.767420    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lkbtz"
Jul 14 19:10:55.767514 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.767458    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 14 19:10:55.767514 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:10:55.767497    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lkbtz" podUID="8a7994c4-4dcd-4b18-a6f3-580eda35a3d9"
Jul 14 19:10:55.767669 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.767568    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 14 19:10:55.767833 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.767817    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-fgkbc\""
Jul 14 19:10:55.768468 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.768436    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 14 19:10:55.768564 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.768451    2565 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 14 19:10:55.768564 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.768529    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 14 19:10:55.768793 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.768763    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 14 19:10:55.768859 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.768791    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-l9hsf\""
Jul 14 19:10:55.768932 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.768913    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-cqqv8"
Jul 14 19:10:55.770189 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.770144    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-vmk5j"
Jul 14 19:10:55.774478 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.774459    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 14 19:10:55.775907 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.775889    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 14 19:10:55.776407 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.776389    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 14 19:10:55.776530 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.776512    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-4zgtr\""
Jul 14 19:10:55.776606 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.776549    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 14 19:10:55.776661 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.776616    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 14 19:10:55.776755 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.776737    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 14 19:10:55.776814 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.776752    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 14 19:10:55.776814 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.776798    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 14 19:10:55.777220 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.777192    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 14 19:10:55.777220 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.777215    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-2vrb6\""
Jul 14 19:10:55.803327 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.803308    2565 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-dvgr7"
Jul 14 19:10:55.811093 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.811075    2565 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-dvgr7"
Jul 14 19:10:55.856383 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.856365    2565 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 14 19:10:55.865658 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.865635    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6mw7r\" (UniqueName: \"kubernetes.io/projected/06f772af-8888-44a7-9035-bd5ca76ac90e-kube-api-access-6mw7r\") pod \"node-ca-kjr5k\" (UID: \"06f772af-8888-44a7-9035-bd5ca76ac90e\") " pod="openshift-image-registry/node-ca-kjr5k"
Jul 14 19:10:55.865735 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.865663    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/aeff7a40-4f71-4be4-b327-d58a3fb0fc99-var-lib-kubelet\") pod \"tuned-k447l\" (UID: \"aeff7a40-4f71-4be4-b327-d58a3fb0fc99\") " pod="openshift-cluster-node-tuning-operator/tuned-k447l"
Jul 14 19:10:55.865735 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.865683    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7a447cf6-9373-4497-8028-97d590f38262-run-ovn\") pod \"ovnkube-node-cqqv8\" (UID: \"7a447cf6-9373-4497-8028-97d590f38262\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqqv8"
Jul 14 19:10:55.865735 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.865701    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7a447cf6-9373-4497-8028-97d590f38262-ovn-node-metrics-cert\") pod \"ovnkube-node-cqqv8\" (UID: \"7a447cf6-9373-4497-8028-97d590f38262\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqqv8"
Jul 14 19:10:55.865854 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.865732    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/aeff7a40-4f71-4be4-b327-d58a3fb0fc99-etc-kubernetes\") pod \"tuned-k447l\" (UID: \"aeff7a40-4f71-4be4-b327-d58a3fb0fc99\") " pod="openshift-cluster-node-tuning-operator/tuned-k447l"
Jul 14 19:10:55.865854 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.865780    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ef52564d-70d3-4e0d-a5d4-76de0d4cf5ff-tuning-conf-dir\") pod \"multus-additional-cni-plugins-ql9tj\" (UID: \"ef52564d-70d3-4e0d-a5d4-76de0d4cf5ff\") " pod="openshift-multus/multus-additional-cni-plugins-ql9tj"
Jul 14 19:10:55.865854 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.865789    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/aeff7a40-4f71-4be4-b327-d58a3fb0fc99-var-lib-kubelet\") pod \"tuned-k447l\" (UID: \"aeff7a40-4f71-4be4-b327-d58a3fb0fc99\") " pod="openshift-cluster-node-tuning-operator/tuned-k447l"
Jul 14 19:10:55.865854 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.865818    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7a447cf6-9373-4497-8028-97d590f38262-systemd-units\") pod \"ovnkube-node-cqqv8\" (UID: \"7a447cf6-9373-4497-8028-97d590f38262\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqqv8"
Jul 14 19:10:55.865854 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.865847    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7a447cf6-9373-4497-8028-97d590f38262-host-slash\") pod \"ovnkube-node-cqqv8\" (UID: \"7a447cf6-9373-4497-8028-97d590f38262\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqqv8"
Jul 14 19:10:55.866022 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.865867    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/aeff7a40-4f71-4be4-b327-d58a3fb0fc99-etc-kubernetes\") pod \"tuned-k447l\" (UID: \"aeff7a40-4f71-4be4-b327-d58a3fb0fc99\") " pod="openshift-cluster-node-tuning-operator/tuned-k447l"
Jul 14 19:10:55.866022 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.865873    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8e6a3d91-33c3-44c9-a4f0-34c6edf4997c-etc-kubernetes\") pod \"multus-z4v7q\" (UID: \"8e6a3d91-33c3-44c9-a4f0-34c6edf4997c\") " pod="openshift-multus/multus-z4v7q"
Jul 14 19:10:55.866022 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.865908    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/905db982-21b7-4ee4-be3b-0df7088e422a-registration-dir\") pod \"aws-ebs-csi-driver-node-q9hq4\" (UID: \"905db982-21b7-4ee4-be3b-0df7088e422a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q9hq4"
Jul 14 19:10:55.866022 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.865931    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/06f772af-8888-44a7-9035-bd5ca76ac90e-serviceca\") pod \"node-ca-kjr5k\" (UID: \"06f772af-8888-44a7-9035-bd5ca76ac90e\") " pod="openshift-image-registry/node-ca-kjr5k"
Jul 14 19:10:55.866022 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.865945    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/aeff7a40-4f71-4be4-b327-d58a3fb0fc99-host\") pod \"tuned-k447l\" (UID: \"aeff7a40-4f71-4be4-b327-d58a3fb0fc99\") " pod="openshift-cluster-node-tuning-operator/tuned-k447l"
Jul 14 19:10:55.866022 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.865978    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9w5hd\" (UniqueName: \"kubernetes.io/projected/9d44b622-d76b-4616-af94-e7d9b6f2f67b-kube-api-access-9w5hd\") pod \"node-resolver-gx8lp\" (UID: \"9d44b622-d76b-4616-af94-e7d9b6f2f67b\") " pod="openshift-dns/node-resolver-gx8lp"
Jul 14 19:10:55.866022 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.865994    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/aeff7a40-4f71-4be4-b327-d58a3fb0fc99-host\") pod \"tuned-k447l\" (UID: \"aeff7a40-4f71-4be4-b327-d58a3fb0fc99\") " pod="openshift-cluster-node-tuning-operator/tuned-k447l"
Jul 14 19:10:55.866022 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.866008    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a2ef2d8f-5f7b-41bd-b98a-2a272dd4090f-metrics-certs\") pod \"network-metrics-daemon-hbbrx\" (UID: \"a2ef2d8f-5f7b-41bd-b98a-2a272dd4090f\") " pod="openshift-multus/network-metrics-daemon-hbbrx"
Jul 14 19:10:55.866287 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.866035    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ef52564d-70d3-4e0d-a5d4-76de0d4cf5ff-cni-binary-copy\") pod \"multus-additional-cni-plugins-ql9tj\" (UID: \"ef52564d-70d3-4e0d-a5d4-76de0d4cf5ff\") " pod="openshift-multus/multus-additional-cni-plugins-ql9tj"
Jul 14 19:10:55.866287 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.866060    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/8a7994c4-4dcd-4b18-a6f3-580eda35a3d9-kubelet-config\") pod \"global-pull-secret-syncer-lkbtz\" (UID: \"8a7994c4-4dcd-4b18-a6f3-580eda35a3d9\") " pod="kube-system/global-pull-secret-syncer-lkbtz"
Jul 14 19:10:55.866621 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.866448    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7a447cf6-9373-4497-8028-97d590f38262-host-run-ovn-kubernetes\") pod \"ovnkube-node-cqqv8\" (UID: \"7a447cf6-9373-4497-8028-97d590f38262\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqqv8"
Jul 14 19:10:55.866717 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:10:55.866653    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 14 19:10:55.866717 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.866676    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7a447cf6-9373-4497-8028-97d590f38262-host-cni-bin\") pod \"ovnkube-node-cqqv8\" (UID: \"7a447cf6-9373-4497-8028-97d590f38262\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqqv8"
Jul 14 19:10:55.866717 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.866710    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ef52564d-70d3-4e0d-a5d4-76de0d4cf5ff-cnibin\") pod \"multus-additional-cni-plugins-ql9tj\" (UID: \"ef52564d-70d3-4e0d-a5d4-76de0d4cf5ff\") " pod="openshift-multus/multus-additional-cni-plugins-ql9tj"
Jul 14 19:10:55.866857 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:10:55.866769    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a2ef2d8f-5f7b-41bd-b98a-2a272dd4090f-metrics-certs podName:a2ef2d8f-5f7b-41bd-b98a-2a272dd4090f nodeName:}" failed. No retries permitted until 2026-07-14 19:10:56.36671643 +0000 UTC m=+2.927573320 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a2ef2d8f-5f7b-41bd-b98a-2a272dd4090f-metrics-certs") pod "network-metrics-daemon-hbbrx" (UID: "a2ef2d8f-5f7b-41bd-b98a-2a272dd4090f") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 14 19:10:55.866857 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.866823    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/aeff7a40-4f71-4be4-b327-d58a3fb0fc99-etc-sysctl-d\") pod \"tuned-k447l\" (UID: \"aeff7a40-4f71-4be4-b327-d58a3fb0fc99\") " pod="openshift-cluster-node-tuning-operator/tuned-k447l"
Jul 14 19:10:55.866958 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.866883    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/aeff7a40-4f71-4be4-b327-d58a3fb0fc99-tmp\") pod \"tuned-k447l\" (UID: \"aeff7a40-4f71-4be4-b327-d58a3fb0fc99\") " pod="openshift-cluster-node-tuning-operator/tuned-k447l"
Jul 14 19:10:55.866958 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.866929    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8e6a3d91-33c3-44c9-a4f0-34c6edf4997c-cni-binary-copy\") pod \"multus-z4v7q\" (UID: \"8e6a3d91-33c3-44c9-a4f0-34c6edf4997c\") " pod="openshift-multus/multus-z4v7q"
Jul 14 19:10:55.867045 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.866959    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/8e6a3d91-33c3-44c9-a4f0-34c6edf4997c-multus-socket-dir-parent\") pod \"multus-z4v7q\" (UID: \"8e6a3d91-33c3-44c9-a4f0-34c6edf4997c\") " pod="openshift-multus/multus-z4v7q"
Jul 14 19:10:55.867045 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.866986    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/aeff7a40-4f71-4be4-b327-d58a3fb0fc99-etc-sysctl-d\") pod \"tuned-k447l\" (UID: \"aeff7a40-4f71-4be4-b327-d58a3fb0fc99\") " pod="openshift-cluster-node-tuning-operator/tuned-k447l"
Jul 14 19:10:55.867045 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.866994    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7a447cf6-9373-4497-8028-97d590f38262-host-run-netns\") pod \"ovnkube-node-cqqv8\" (UID: \"7a447cf6-9373-4497-8028-97d590f38262\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqqv8"
Jul 14 19:10:55.867198 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.867050    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/33e87184-8973-45c3-8719-143dd1d21929-iptables-alerter-script\") pod \"iptables-alerter-vmk5j\" (UID: \"33e87184-8973-45c3-8719-143dd1d21929\") " pod="openshift-network-operator/iptables-alerter-vmk5j"
Jul 14 19:10:55.867198 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.867084    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8e6a3d91-33c3-44c9-a4f0-34c6edf4997c-system-cni-dir\") pod \"multus-z4v7q\" (UID: \"8e6a3d91-33c3-44c9-a4f0-34c6edf4997c\") " pod="openshift-multus/multus-z4v7q"
Jul 14 19:10:55.867198 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.867125    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8e6a3d91-33c3-44c9-a4f0-34c6edf4997c-host-var-lib-kubelet\") pod \"multus-z4v7q\" (UID: \"8e6a3d91-33c3-44c9-a4f0-34c6edf4997c\") " pod="openshift-multus/multus-z4v7q"
Jul 14 19:10:55.867198 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.867176    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/aeff7a40-4f71-4be4-b327-d58a3fb0fc99-etc-sysctl-conf\") pod \"tuned-k447l\" (UID: \"aeff7a40-4f71-4be4-b327-d58a3fb0fc99\") " pod="openshift-cluster-node-tuning-operator/tuned-k447l"
Jul 14 19:10:55.867373 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.867212    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ef52564d-70d3-4e0d-a5d4-76de0d4cf5ff-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-ql9tj\" (UID: \"ef52564d-70d3-4e0d-a5d4-76de0d4cf5ff\") " pod="openshift-multus/multus-additional-cni-plugins-ql9tj"
Jul 14 19:10:55.867373 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.867254    2565 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 14 19:10:55.867373 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.867355    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sxhvs\" (UniqueName: \"kubernetes.io/projected/ef52564d-70d3-4e0d-a5d4-76de0d4cf5ff-kube-api-access-sxhvs\") pod \"multus-additional-cni-plugins-ql9tj\" (UID: \"ef52564d-70d3-4e0d-a5d4-76de0d4cf5ff\") " pod="openshift-multus/multus-additional-cni-plugins-ql9tj"
Jul 14 19:10:55.867497 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.867385    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/8e6a3d91-33c3-44c9-a4f0-34c6edf4997c-hostroot\") pod \"multus-z4v7q\" (UID: \"8e6a3d91-33c3-44c9-a4f0-34c6edf4997c\") " pod="openshift-multus/multus-z4v7q"
Jul 14 19:10:55.867497 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.867417    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gl72t\" (UniqueName: \"kubernetes.io/projected/8e6a3d91-33c3-44c9-a4f0-34c6edf4997c-kube-api-access-gl72t\") pod \"multus-z4v7q\" (UID: \"8e6a3d91-33c3-44c9-a4f0-34c6edf4997c\") " pod="openshift-multus/multus-z4v7q"
Jul 14 19:10:55.867497 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.867444    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/905db982-21b7-4ee4-be3b-0df7088e422a-sys-fs\") pod \"aws-ebs-csi-driver-node-q9hq4\" (UID: \"905db982-21b7-4ee4-be3b-0df7088e422a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q9hq4"
Jul 14 19:10:55.867497 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.867473    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gq5j7\" (UniqueName: \"kubernetes.io/projected/905db982-21b7-4ee4-be3b-0df7088e422a-kube-api-access-gq5j7\") pod \"aws-ebs-csi-driver-node-q9hq4\" (UID: \"905db982-21b7-4ee4-be3b-0df7088e422a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q9hq4"
Jul 14 19:10:55.867726 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.867501    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/aeff7a40-4f71-4be4-b327-d58a3fb0fc99-lib-modules\") pod \"tuned-k447l\" (UID: \"aeff7a40-4f71-4be4-b327-d58a3fb0fc99\") " pod="openshift-cluster-node-tuning-operator/tuned-k447l"
Jul 14 19:10:55.867726 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.867576    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7a447cf6-9373-4497-8028-97d590f38262-run-openvswitch\") pod \"ovnkube-node-cqqv8\" (UID: \"7a447cf6-9373-4497-8028-97d590f38262\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqqv8"
Jul 14 19:10:55.867726 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.867626    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7a447cf6-9373-4497-8028-97d590f38262-ovnkube-script-lib\") pod \"ovnkube-node-cqqv8\" (UID: \"7a447cf6-9373-4497-8028-97d590f38262\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqqv8"
Jul 14 19:10:55.867726 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.867661    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8e6a3d91-33c3-44c9-a4f0-34c6edf4997c-multus-cni-dir\") pod \"multus-z4v7q\" (UID: \"8e6a3d91-33c3-44c9-a4f0-34c6edf4997c\") " pod="openshift-multus/multus-z4v7q"
Jul 14 19:10:55.867726 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.867684    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/8e6a3d91-33c3-44c9-a4f0-34c6edf4997c-multus-daemon-config\") pod \"multus-z4v7q\" (UID: \"8e6a3d91-33c3-44c9-a4f0-34c6edf4997c\") " pod="openshift-multus/multus-z4v7q"
Jul 14 19:10:55.867726 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.867712    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/8e6a3d91-33c3-44c9-a4f0-34c6edf4997c-host-run-multus-certs\") pod \"multus-z4v7q\" (UID: \"8e6a3d91-33c3-44c9-a4f0-34c6edf4997c\") " pod="openshift-multus/multus-z4v7q"
Jul 14 19:10:55.867979 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.867743    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/aeff7a40-4f71-4be4-b327-d58a3fb0fc99-sys\") pod \"tuned-k447l\" (UID: \"aeff7a40-4f71-4be4-b327-d58a3fb0fc99\") " pod="openshift-cluster-node-tuning-operator/tuned-k447l"
Jul 14 19:10:55.867979 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.867772    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/33e87184-8973-45c3-8719-143dd1d21929-host-slash\") pod \"iptables-alerter-vmk5j\" (UID: \"33e87184-8973-45c3-8719-143dd1d21929\") " pod="openshift-network-operator/iptables-alerter-vmk5j"
Jul 14 19:10:55.867979 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.867795    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n6hqr\" (UniqueName: \"kubernetes.io/projected/33e87184-8973-45c3-8719-143dd1d21929-kube-api-access-n6hqr\") pod \"iptables-alerter-vmk5j\" (UID: \"33e87184-8973-45c3-8719-143dd1d21929\") " pod="openshift-network-operator/iptables-alerter-vmk5j"
Jul 14 19:10:55.867979 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.867825    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8e6a3d91-33c3-44c9-a4f0-34c6edf4997c-cnibin\") pod \"multus-z4v7q\" (UID: \"8e6a3d91-33c3-44c9-a4f0-34c6edf4997c\") " pod="openshift-multus/multus-z4v7q"
Jul 14 19:10:55.867979 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.867853    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/905db982-21b7-4ee4-be3b-0df7088e422a-device-dir\") pod \"aws-ebs-csi-driver-node-q9hq4\" (UID: \"905db982-21b7-4ee4-be3b-0df7088e422a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q9hq4"
Jul 14 19:10:55.867979 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.867883    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/aeff7a40-4f71-4be4-b327-d58a3fb0fc99-etc-tuned\") pod \"tuned-k447l\" (UID: \"aeff7a40-4f71-4be4-b327-d58a3fb0fc99\") " pod="openshift-cluster-node-tuning-operator/tuned-k447l"
Jul 14 19:10:55.868250 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.868007    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k77pn\" (UniqueName: \"kubernetes.io/projected/490a903e-0b54-40ef-82f2-4175faef060f-kube-api-access-k77pn\") pod \"network-check-target-xxs8n\" (UID: \"490a903e-0b54-40ef-82f2-4175faef060f\") " pod="openshift-network-diagnostics/network-check-target-xxs8n"
Jul 14 19:10:55.868250 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.868045    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-crzgt\" (UniqueName: \"kubernetes.io/projected/7a447cf6-9373-4497-8028-97d590f38262-kube-api-access-crzgt\") pod \"ovnkube-node-cqqv8\" (UID: \"7a447cf6-9373-4497-8028-97d590f38262\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqqv8"
Jul 14 19:10:55.868250 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.868076    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d02ff63b-3fa8-432f-aa86-c517e74ae017-konnectivity-ca\") pod \"konnectivity-agent-ppqk5\" (UID: \"d02ff63b-3fa8-432f-aa86-c517e74ae017\") " pod="kube-system/konnectivity-agent-ppqk5"
Jul 14 19:10:55.868250 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.868097    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/06f772af-8888-44a7-9035-bd5ca76ac90e-host\") pod \"node-ca-kjr5k\" (UID: \"06f772af-8888-44a7-9035-bd5ca76ac90e\") " pod="openshift-image-registry/node-ca-kjr5k"
Jul 14 19:10:55.868250 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.868128    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/aeff7a40-4f71-4be4-b327-d58a3fb0fc99-etc-sysconfig\") pod \"tuned-k447l\" (UID: \"aeff7a40-4f71-4be4-b327-d58a3fb0fc99\") " pod="openshift-cluster-node-tuning-operator/tuned-k447l"
Jul 14 19:10:55.868250 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.868173    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7a447cf6-9373-4497-8028-97d590f38262-host-cni-netd\") pod \"ovnkube-node-cqqv8\" (UID: \"7a447cf6-9373-4497-8028-97d590f38262\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqqv8"
Jul 14 19:10:55.868250 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.868204    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8e6a3d91-33c3-44c9-a4f0-34c6edf4997c-host-var-lib-cni-bin\") pod \"multus-z4v7q\" (UID: \"8e6a3d91-33c3-44c9-a4f0-34c6edf4997c\") " pod="openshift-multus/multus-z4v7q"
Jul 14 19:10:55.868250 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.868236    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jccnn\" (UniqueName: \"kubernetes.io/projected/aeff7a40-4f71-4be4-b327-d58a3fb0fc99-kube-api-access-jccnn\") pod \"tuned-k447l\" (UID: \"aeff7a40-4f71-4be4-b327-d58a3fb0fc99\") " pod="openshift-cluster-node-tuning-operator/tuned-k447l"
Jul 14 19:10:55.868577 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.868262    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7a447cf6-9373-4497-8028-97d590f38262-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-cqqv8\" (UID: \"7a447cf6-9373-4497-8028-97d590f38262\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqqv8"
Jul 14 19:10:55.868577 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.868356    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/aeff7a40-4f71-4be4-b327-d58a3fb0fc99-etc-sysconfig\") pod \"tuned-k447l\" (UID: \"aeff7a40-4f71-4be4-b327-d58a3fb0fc99\") " pod="openshift-cluster-node-tuning-operator/tuned-k447l"
Jul 14 19:10:55.868577 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.868392    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7a447cf6-9373-4497-8028-97d590f38262-env-overrides\") pod \"ovnkube-node-cqqv8\" (UID: \"7a447cf6-9373-4497-8028-97d590f38262\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqqv8"
Jul 14 19:10:55.868577 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.868435    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7wm4x\" (UniqueName: \"kubernetes.io/projected/a2ef2d8f-5f7b-41bd-b98a-2a272dd4090f-kube-api-access-7wm4x\") pod \"network-metrics-daemon-hbbrx\" (UID: \"a2ef2d8f-5f7b-41bd-b98a-2a272dd4090f\") " pod="openshift-multus/network-metrics-daemon-hbbrx"
Jul 14 19:10:55.868577 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.868501    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ef52564d-70d3-4e0d-a5d4-76de0d4cf5ff-system-cni-dir\") pod \"multus-additional-cni-plugins-ql9tj\" (UID: \"ef52564d-70d3-4e0d-a5d4-76de0d4cf5ff\") " pod="openshift-multus/multus-additional-cni-plugins-ql9tj"
Jul 14 19:10:55.868577 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.868534    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ef52564d-70d3-4e0d-a5d4-76de0d4cf5ff-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-ql9tj\" (UID: \"ef52564d-70d3-4e0d-a5d4-76de0d4cf5ff\") " pod="openshift-multus/multus-additional-cni-plugins-ql9tj"
Jul 14 19:10:55.868577 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.868560    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7a447cf6-9373-4497-8028-97d590f38262-host-kubelet\") pod \"ovnkube-node-cqqv8\" (UID: \"7a447cf6-9373-4497-8028-97d590f38262\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqqv8"
Jul 14 19:10:55.868878 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.868585    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7a447cf6-9373-4497-8028-97d590f38262-run-systemd\") pod \"ovnkube-node-cqqv8\" (UID: \"7a447cf6-9373-4497-8028-97d590f38262\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqqv8"
Jul 14 19:10:55.868878 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.868612    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7a447cf6-9373-4497-8028-97d590f38262-var-lib-openvswitch\") pod \"ovnkube-node-cqqv8\" (UID: \"7a447cf6-9373-4497-8028-97d590f38262\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqqv8"
Jul 14 19:10:55.868878 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.868633    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7a447cf6-9373-4497-8028-97d590f38262-log-socket\") pod \"ovnkube-node-cqqv8\" (UID: \"7a447cf6-9373-4497-8028-97d590f38262\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqqv8"
Jul 14 19:10:55.868878 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.868660    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/8e6a3d91-33c3-44c9-a4f0-34c6edf4997c-host-var-lib-cni-multus\") pod \"multus-z4v7q\" (UID: \"8e6a3d91-33c3-44c9-a4f0-34c6edf4997c\") " pod="openshift-multus/multus-z4v7q"
Jul 14 19:10:55.868878 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.868693    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8a7994c4-4dcd-4b18-a6f3-580eda35a3d9-original-pull-secret\") pod \"global-pull-secret-syncer-lkbtz\" (UID: \"8a7994c4-4dcd-4b18-a6f3-580eda35a3d9\") " pod="kube-system/global-pull-secret-syncer-lkbtz"
Jul 14 19:10:55.868878 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.868764    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/aeff7a40-4f71-4be4-b327-d58a3fb0fc99-sys\") pod \"tuned-k447l\" (UID: \"aeff7a40-4f71-4be4-b327-d58a3fb0fc99\") " pod="openshift-cluster-node-tuning-operator/tuned-k447l"
Jul 14 19:10:55.869142 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.868902    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7a447cf6-9373-4497-8028-97d590f38262-etc-openvswitch\") pod \"ovnkube-node-cqqv8\" (UID: \"7a447cf6-9373-4497-8028-97d590f38262\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqqv8"
Jul 14 19:10:55.869142 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.868939    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7a447cf6-9373-4497-8028-97d590f38262-node-log\") pod \"ovnkube-node-cqqv8\" (UID: \"7a447cf6-9373-4497-8028-97d590f38262\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqqv8"
Jul 14 19:10:55.869142 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.868968    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8e6a3d91-33c3-44c9-a4f0-34c6edf4997c-os-release\") pod \"multus-z4v7q\" (UID: \"8e6a3d91-33c3-44c9-a4f0-34c6edf4997c\") " pod="openshift-multus/multus-z4v7q"
Jul 14 19:10:55.869142 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.869001    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8e6a3d91-33c3-44c9-a4f0-34c6edf4997c-host-run-netns\") pod \"multus-z4v7q\" (UID: \"8e6a3d91-33c3-44c9-a4f0-34c6edf4997c\") " pod="openshift-multus/multus-z4v7q"
Jul 14 19:10:55.869142 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.869034    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d02ff63b-3fa8-432f-aa86-c517e74ae017-agent-certs\") pod \"konnectivity-agent-ppqk5\" (UID: \"d02ff63b-3fa8-432f-aa86-c517e74ae017\") " pod="kube-system/konnectivity-agent-ppqk5"
Jul 14 19:10:55.869142 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.869062    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/905db982-21b7-4ee4-be3b-0df7088e422a-socket-dir\") pod \"aws-ebs-csi-driver-node-q9hq4\" (UID: \"905db982-21b7-4ee4-be3b-0df7088e422a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q9hq4"
Jul 14 19:10:55.869142 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.869091    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/905db982-21b7-4ee4-be3b-0df7088e422a-etc-selinux\") pod \"aws-ebs-csi-driver-node-q9hq4\" (UID: \"905db982-21b7-4ee4-be3b-0df7088e422a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q9hq4"
Jul 14 19:10:55.869142 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.869119    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/aeff7a40-4f71-4be4-b327-d58a3fb0fc99-etc-modprobe-d\") pod \"tuned-k447l\" (UID: \"aeff7a40-4f71-4be4-b327-d58a3fb0fc99\") " pod="openshift-cluster-node-tuning-operator/tuned-k447l"
Jul 14 19:10:55.869564 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.869171    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ef52564d-70d3-4e0d-a5d4-76de0d4cf5ff-os-release\") pod \"multus-additional-cni-plugins-ql9tj\" (UID: \"ef52564d-70d3-4e0d-a5d4-76de0d4cf5ff\") " pod="openshift-multus/multus-additional-cni-plugins-ql9tj"
Jul 14 19:10:55.869564 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.869202    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/8a7994c4-4dcd-4b18-a6f3-580eda35a3d9-dbus\") pod \"global-pull-secret-syncer-lkbtz\" (UID: \"8a7994c4-4dcd-4b18-a6f3-580eda35a3d9\") " pod="kube-system/global-pull-secret-syncer-lkbtz"
Jul 14 19:10:55.869564 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.869232    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7a447cf6-9373-4497-8028-97d590f38262-ovnkube-config\") pod \"ovnkube-node-cqqv8\" (UID: \"7a447cf6-9373-4497-8028-97d590f38262\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqqv8"
Jul 14 19:10:55.869564 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.869263    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8e6a3d91-33c3-44c9-a4f0-34c6edf4997c-multus-conf-dir\") pod \"multus-z4v7q\" (UID: \"8e6a3d91-33c3-44c9-a4f0-34c6edf4997c\") " pod="openshift-multus/multus-z4v7q"
Jul 14 19:10:55.869564 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.869293    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/905db982-21b7-4ee4-be3b-0df7088e422a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-q9hq4\" (UID: \"905db982-21b7-4ee4-be3b-0df7088e422a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q9hq4"
Jul 14 19:10:55.869564 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.869334    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/aeff7a40-4f71-4be4-b327-d58a3fb0fc99-etc-systemd\") pod \"tuned-k447l\" (UID: \"aeff7a40-4f71-4be4-b327-d58a3fb0fc99\") " pod="openshift-cluster-node-tuning-operator/tuned-k447l"
Jul 14 19:10:55.869564 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.869366    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/aeff7a40-4f71-4be4-b327-d58a3fb0fc99-run\") pod \"tuned-k447l\" (UID: \"aeff7a40-4f71-4be4-b327-d58a3fb0fc99\") " pod="openshift-cluster-node-tuning-operator/tuned-k447l"
Jul 14 19:10:55.869564 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.869397    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/9d44b622-d76b-4616-af94-e7d9b6f2f67b-hosts-file\") pod \"node-resolver-gx8lp\" (UID: \"9d44b622-d76b-4616-af94-e7d9b6f2f67b\") " pod="openshift-dns/node-resolver-gx8lp"
Jul 14 19:10:55.869564 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.869424    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9d44b622-d76b-4616-af94-e7d9b6f2f67b-tmp-dir\") pod \"node-resolver-gx8lp\" (UID: \"9d44b622-d76b-4616-af94-e7d9b6f2f67b\") " pod="openshift-dns/node-resolver-gx8lp"
Jul 14 19:10:55.869564 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.869455    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/8e6a3d91-33c3-44c9-a4f0-34c6edf4997c-host-run-k8s-cni-cncf-io\") pod \"multus-z4v7q\" (UID: \"8e6a3d91-33c3-44c9-a4f0-34c6edf4997c\") " pod="openshift-multus/multus-z4v7q"
Jul 14 19:10:55.869995 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.869780    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/aeff7a40-4f71-4be4-b327-d58a3fb0fc99-run\") pod \"tuned-k447l\" (UID: \"aeff7a40-4f71-4be4-b327-d58a3fb0fc99\") " pod="openshift-cluster-node-tuning-operator/tuned-k447l"
Jul 14 19:10:55.869995 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.869778    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/aeff7a40-4f71-4be4-b327-d58a3fb0fc99-etc-systemd\") pod \"tuned-k447l\" (UID: \"aeff7a40-4f71-4be4-b327-d58a3fb0fc99\") " pod="openshift-cluster-node-tuning-operator/tuned-k447l"
Jul 14 19:10:55.869995 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.869833    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/aeff7a40-4f71-4be4-b327-d58a3fb0fc99-lib-modules\") pod \"tuned-k447l\" (UID: \"aeff7a40-4f71-4be4-b327-d58a3fb0fc99\") " pod="openshift-cluster-node-tuning-operator/tuned-k447l"
Jul 14 19:10:55.870304 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.870184    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/9d44b622-d76b-4616-af94-e7d9b6f2f67b-hosts-file\") pod \"node-resolver-gx8lp\" (UID: \"9d44b622-d76b-4616-af94-e7d9b6f2f67b\") " pod="openshift-dns/node-resolver-gx8lp"
Jul 14 19:10:55.870304 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.870239    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/aeff7a40-4f71-4be4-b327-d58a3fb0fc99-etc-sysctl-conf\") pod \"tuned-k447l\" (UID: \"aeff7a40-4f71-4be4-b327-d58a3fb0fc99\") " pod="openshift-cluster-node-tuning-operator/tuned-k447l"
Jul 14 19:10:55.870304 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.870253    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/aeff7a40-4f71-4be4-b327-d58a3fb0fc99-etc-modprobe-d\") pod \"tuned-k447l\" (UID: \"aeff7a40-4f71-4be4-b327-d58a3fb0fc99\") " pod="openshift-cluster-node-tuning-operator/tuned-k447l"
Jul 14 19:10:55.870304 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.870264    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9d44b622-d76b-4616-af94-e7d9b6f2f67b-tmp-dir\") pod \"node-resolver-gx8lp\" (UID: \"9d44b622-d76b-4616-af94-e7d9b6f2f67b\") " pod="openshift-dns/node-resolver-gx8lp"
Jul 14 19:10:55.871279 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.871242    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/aeff7a40-4f71-4be4-b327-d58a3fb0fc99-etc-tuned\") pod \"tuned-k447l\" (UID: \"aeff7a40-4f71-4be4-b327-d58a3fb0fc99\") " pod="openshift-cluster-node-tuning-operator/tuned-k447l"
Jul 14 19:10:55.871279 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.871275    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/aeff7a40-4f71-4be4-b327-d58a3fb0fc99-tmp\") pod \"tuned-k447l\" (UID: \"aeff7a40-4f71-4be4-b327-d58a3fb0fc99\") " pod="openshift-cluster-node-tuning-operator/tuned-k447l"
Jul 14 19:10:55.871942 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.871926    2565 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 14 19:10:55.875429 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.875404    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9w5hd\" (UniqueName: \"kubernetes.io/projected/9d44b622-d76b-4616-af94-e7d9b6f2f67b-kube-api-access-9w5hd\") pod \"node-resolver-gx8lp\" (UID: \"9d44b622-d76b-4616-af94-e7d9b6f2f67b\") " pod="openshift-dns/node-resolver-gx8lp"
Jul 14 19:10:55.876250 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.876232    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jccnn\" (UniqueName: \"kubernetes.io/projected/aeff7a40-4f71-4be4-b327-d58a3fb0fc99-kube-api-access-jccnn\") pod \"tuned-k447l\" (UID: \"aeff7a40-4f71-4be4-b327-d58a3fb0fc99\") " pod="openshift-cluster-node-tuning-operator/tuned-k447l"
Jul 14 19:10:55.879718 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:10:55.879695    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 14 19:10:55.879718 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:10:55.879717    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 14 19:10:55.879826 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:10:55.879727    2565 projected.go:196] Error preparing data for projected volume kube-api-access-k77pn for pod openshift-network-diagnostics/network-check-target-xxs8n: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 14 19:10:55.879826 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:10:55.879771    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/490a903e-0b54-40ef-82f2-4175faef060f-kube-api-access-k77pn podName:490a903e-0b54-40ef-82f2-4175faef060f nodeName:}" failed. No retries permitted until 2026-07-14 19:10:56.379758428 +0000 UTC m=+2.940615314 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-k77pn" (UniqueName: "kubernetes.io/projected/490a903e-0b54-40ef-82f2-4175faef060f-kube-api-access-k77pn") pod "network-check-target-xxs8n" (UID: "490a903e-0b54-40ef-82f2-4175faef060f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 14 19:10:55.881380 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.881361    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7wm4x\" (UniqueName: \"kubernetes.io/projected/a2ef2d8f-5f7b-41bd-b98a-2a272dd4090f-kube-api-access-7wm4x\") pod \"network-metrics-daemon-hbbrx\" (UID: \"a2ef2d8f-5f7b-41bd-b98a-2a272dd4090f\") " pod="openshift-multus/network-metrics-daemon-hbbrx"
Jul 14 19:10:55.970272 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.970249    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ef52564d-70d3-4e0d-a5d4-76de0d4cf5ff-system-cni-dir\") pod \"multus-additional-cni-plugins-ql9tj\" (UID: \"ef52564d-70d3-4e0d-a5d4-76de0d4cf5ff\") " pod="openshift-multus/multus-additional-cni-plugins-ql9tj"
Jul 14 19:10:55.970361 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.970274    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ef52564d-70d3-4e0d-a5d4-76de0d4cf5ff-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-ql9tj\" (UID: \"ef52564d-70d3-4e0d-a5d4-76de0d4cf5ff\") " pod="openshift-multus/multus-additional-cni-plugins-ql9tj"
Jul 14 19:10:55.970361 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.970290    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7a447cf6-9373-4497-8028-97d590f38262-host-kubelet\") pod \"ovnkube-node-cqqv8\" (UID: \"7a447cf6-9373-4497-8028-97d590f38262\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqqv8"
Jul 14 19:10:55.970361 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.970305    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7a447cf6-9373-4497-8028-97d590f38262-run-systemd\") pod \"ovnkube-node-cqqv8\" (UID: \"7a447cf6-9373-4497-8028-97d590f38262\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqqv8"
Jul 14 19:10:55.970361 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.970318    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7a447cf6-9373-4497-8028-97d590f38262-var-lib-openvswitch\") pod \"ovnkube-node-cqqv8\" (UID: \"7a447cf6-9373-4497-8028-97d590f38262\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqqv8"
Jul 14 19:10:55.970361 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.970335    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7a447cf6-9373-4497-8028-97d590f38262-log-socket\") pod \"ovnkube-node-cqqv8\" (UID: \"7a447cf6-9373-4497-8028-97d590f38262\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqqv8"
Jul 14 19:10:55.970361 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.970356    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/8e6a3d91-33c3-44c9-a4f0-34c6edf4997c-host-var-lib-cni-multus\") pod \"multus-z4v7q\" (UID: \"8e6a3d91-33c3-44c9-a4f0-34c6edf4997c\") " pod="openshift-multus/multus-z4v7q"
Jul 14 19:10:55.970662 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.970380    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7a447cf6-9373-4497-8028-97d590f38262-host-kubelet\") pod \"ovnkube-node-cqqv8\" (UID: \"7a447cf6-9373-4497-8028-97d590f38262\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqqv8"
Jul 14 19:10:55.970662 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.970363    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ef52564d-70d3-4e0d-a5d4-76de0d4cf5ff-system-cni-dir\") pod \"multus-additional-cni-plugins-ql9tj\" (UID: \"ef52564d-70d3-4e0d-a5d4-76de0d4cf5ff\") " pod="openshift-multus/multus-additional-cni-plugins-ql9tj"
Jul 14 19:10:55.970662 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.970412    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7a447cf6-9373-4497-8028-97d590f38262-log-socket\") pod \"ovnkube-node-cqqv8\" (UID: \"7a447cf6-9373-4497-8028-97d590f38262\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqqv8"
Jul 14 19:10:55.970662 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.970427    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/8e6a3d91-33c3-44c9-a4f0-34c6edf4997c-host-var-lib-cni-multus\") pod \"multus-z4v7q\" (UID: \"8e6a3d91-33c3-44c9-a4f0-34c6edf4997c\") " pod="openshift-multus/multus-z4v7q"
Jul 14 19:10:55.970662 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.970381    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8a7994c4-4dcd-4b18-a6f3-580eda35a3d9-original-pull-secret\") pod \"global-pull-secret-syncer-lkbtz\" (UID: \"8a7994c4-4dcd-4b18-a6f3-580eda35a3d9\") " pod="kube-system/global-pull-secret-syncer-lkbtz"
Jul 14 19:10:55.970662 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.970432    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7a447cf6-9373-4497-8028-97d590f38262-var-lib-openvswitch\") pod \"ovnkube-node-cqqv8\" (UID: \"7a447cf6-9373-4497-8028-97d590f38262\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqqv8"
Jul 14 19:10:55.970662 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.970434    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7a447cf6-9373-4497-8028-97d590f38262-run-systemd\") pod \"ovnkube-node-cqqv8\" (UID: \"7a447cf6-9373-4497-8028-97d590f38262\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqqv8"
Jul 14 19:10:55.970662 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.970470    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7a447cf6-9373-4497-8028-97d590f38262-etc-openvswitch\") pod \"ovnkube-node-cqqv8\" (UID: \"7a447cf6-9373-4497-8028-97d590f38262\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqqv8"
Jul 14 19:10:55.970662 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.970490    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7a447cf6-9373-4497-8028-97d590f38262-node-log\") pod \"ovnkube-node-cqqv8\" (UID: \"7a447cf6-9373-4497-8028-97d590f38262\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqqv8"
Jul 14 19:10:55.970662 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:10:55.970498    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 14 19:10:55.970662 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.970514    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8e6a3d91-33c3-44c9-a4f0-34c6edf4997c-os-release\") pod \"multus-z4v7q\" (UID: \"8e6a3d91-33c3-44c9-a4f0-34c6edf4997c\") " pod="openshift-multus/multus-z4v7q"
Jul 14 19:10:55.970662 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.970532    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7a447cf6-9373-4497-8028-97d590f38262-etc-openvswitch\") pod \"ovnkube-node-cqqv8\" (UID: \"7a447cf6-9373-4497-8028-97d590f38262\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqqv8"
Jul 14 19:10:55.970662 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:10:55.970539    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a7994c4-4dcd-4b18-a6f3-580eda35a3d9-original-pull-secret podName:8a7994c4-4dcd-4b18-a6f3-580eda35a3d9 nodeName:}" failed. No retries permitted until 2026-07-14 19:10:56.470522309 +0000 UTC m=+3.031379178 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8a7994c4-4dcd-4b18-a6f3-580eda35a3d9-original-pull-secret") pod "global-pull-secret-syncer-lkbtz" (UID: "8a7994c4-4dcd-4b18-a6f3-580eda35a3d9") : object "kube-system"/"original-pull-secret" not registered
Jul 14 19:10:55.970662 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.970546    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7a447cf6-9373-4497-8028-97d590f38262-node-log\") pod \"ovnkube-node-cqqv8\" (UID: \"7a447cf6-9373-4497-8028-97d590f38262\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqqv8"
Jul 14 19:10:55.970662 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.970566    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8e6a3d91-33c3-44c9-a4f0-34c6edf4997c-os-release\") pod \"multus-z4v7q\" (UID: \"8e6a3d91-33c3-44c9-a4f0-34c6edf4997c\") " pod="openshift-multus/multus-z4v7q"
Jul 14 19:10:55.970662 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.970583    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8e6a3d91-33c3-44c9-a4f0-34c6edf4997c-host-run-netns\") pod \"multus-z4v7q\" (UID: \"8e6a3d91-33c3-44c9-a4f0-34c6edf4997c\") " pod="openshift-multus/multus-z4v7q"
Jul 14 19:10:55.970662 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.970623    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d02ff63b-3fa8-432f-aa86-c517e74ae017-agent-certs\") pod \"konnectivity-agent-ppqk5\" (UID: \"d02ff63b-3fa8-432f-aa86-c517e74ae017\") " pod="kube-system/konnectivity-agent-ppqk5"
Jul 14 19:10:55.971454 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.970643    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8e6a3d91-33c3-44c9-a4f0-34c6edf4997c-host-run-netns\") pod \"multus-z4v7q\" (UID: \"8e6a3d91-33c3-44c9-a4f0-34c6edf4997c\") " pod="openshift-multus/multus-z4v7q"
Jul 14 19:10:55.971454 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.970674    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/905db982-21b7-4ee4-be3b-0df7088e422a-socket-dir\") pod \"aws-ebs-csi-driver-node-q9hq4\" (UID: \"905db982-21b7-4ee4-be3b-0df7088e422a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q9hq4"
Jul 14 19:10:55.971454 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.970702    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/905db982-21b7-4ee4-be3b-0df7088e422a-etc-selinux\") pod \"aws-ebs-csi-driver-node-q9hq4\" (UID: \"905db982-21b7-4ee4-be3b-0df7088e422a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q9hq4"
Jul 14 19:10:55.971454 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.970749    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ef52564d-70d3-4e0d-a5d4-76de0d4cf5ff-os-release\") pod \"multus-additional-cni-plugins-ql9tj\" (UID: \"ef52564d-70d3-4e0d-a5d4-76de0d4cf5ff\") " pod="openshift-multus/multus-additional-cni-plugins-ql9tj"
Jul 14 19:10:55.971454 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.970775    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/8a7994c4-4dcd-4b18-a6f3-580eda35a3d9-dbus\") pod \"global-pull-secret-syncer-lkbtz\" (UID: \"8a7994c4-4dcd-4b18-a6f3-580eda35a3d9\") " pod="kube-system/global-pull-secret-syncer-lkbtz"
Jul 14 19:10:55.971454 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.970799    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7a447cf6-9373-4497-8028-97d590f38262-ovnkube-config\") pod \"ovnkube-node-cqqv8\" (UID: \"7a447cf6-9373-4497-8028-97d590f38262\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqqv8"
Jul 14 19:10:55.971454 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.970809    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/905db982-21b7-4ee4-be3b-0df7088e422a-etc-selinux\") pod \"aws-ebs-csi-driver-node-q9hq4\" (UID: \"905db982-21b7-4ee4-be3b-0df7088e422a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q9hq4"
Jul 14 19:10:55.971454 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.970823    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8e6a3d91-33c3-44c9-a4f0-34c6edf4997c-multus-conf-dir\") pod \"multus-z4v7q\" (UID: \"8e6a3d91-33c3-44c9-a4f0-34c6edf4997c\") " pod="openshift-multus/multus-z4v7q"
Jul 14 19:10:55.971454 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.970826    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/905db982-21b7-4ee4-be3b-0df7088e422a-socket-dir\") pod \"aws-ebs-csi-driver-node-q9hq4\" (UID: \"905db982-21b7-4ee4-be3b-0df7088e422a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q9hq4"
Jul 14 19:10:55.971454 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.970846    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/905db982-21b7-4ee4-be3b-0df7088e422a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-q9hq4\" (UID: \"905db982-21b7-4ee4-be3b-0df7088e422a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q9hq4"
Jul 14 19:10:55.971454 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.970853    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ef52564d-70d3-4e0d-a5d4-76de0d4cf5ff-os-release\") pod \"multus-additional-cni-plugins-ql9tj\" (UID: \"ef52564d-70d3-4e0d-a5d4-76de0d4cf5ff\") " pod="openshift-multus/multus-additional-cni-plugins-ql9tj"
Jul 14 19:10:55.971454 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.970863    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ef52564d-70d3-4e0d-a5d4-76de0d4cf5ff-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-ql9tj\" (UID: \"ef52564d-70d3-4e0d-a5d4-76de0d4cf5ff\") " pod="openshift-multus/multus-additional-cni-plugins-ql9tj"
Jul 14 19:10:55.971454 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.970874    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/8e6a3d91-33c3-44c9-a4f0-34c6edf4997c-host-run-k8s-cni-cncf-io\") pod \"multus-z4v7q\" (UID: \"8e6a3d91-33c3-44c9-a4f0-34c6edf4997c\") " pod="openshift-multus/multus-z4v7q"
Jul 14 19:10:55.971454 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.970899    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6mw7r\" (UniqueName: \"kubernetes.io/projected/06f772af-8888-44a7-9035-bd5ca76ac90e-kube-api-access-6mw7r\") pod \"node-ca-kjr5k\" (UID: \"06f772af-8888-44a7-9035-bd5ca76ac90e\") " pod="openshift-image-registry/node-ca-kjr5k"
Jul 14 19:10:55.971454 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.970905    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8e6a3d91-33c3-44c9-a4f0-34c6edf4997c-multus-conf-dir\") pod \"multus-z4v7q\" (UID: \"8e6a3d91-33c3-44c9-a4f0-34c6edf4997c\") " pod="openshift-multus/multus-z4v7q"
Jul 14 19:10:55.971454 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.970918    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/8a7994c4-4dcd-4b18-a6f3-580eda35a3d9-dbus\") pod \"global-pull-secret-syncer-lkbtz\" (UID: \"8a7994c4-4dcd-4b18-a6f3-580eda35a3d9\") " pod="kube-system/global-pull-secret-syncer-lkbtz"
Jul 14 19:10:55.971454 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.970923    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7a447cf6-9373-4497-8028-97d590f38262-run-ovn\") pod \"ovnkube-node-cqqv8\" (UID: \"7a447cf6-9373-4497-8028-97d590f38262\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqqv8"
Jul 14 19:10:55.972263 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.970951    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/905db982-21b7-4ee4-be3b-0df7088e422a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-q9hq4\" (UID: \"905db982-21b7-4ee4-be3b-0df7088e422a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q9hq4"
Jul 14 19:10:55.972263 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.970958    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7a447cf6-9373-4497-8028-97d590f38262-run-ovn\") pod \"ovnkube-node-cqqv8\" (UID: \"7a447cf6-9373-4497-8028-97d590f38262\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqqv8"
Jul 14 19:10:55.972263 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.970947    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/8e6a3d91-33c3-44c9-a4f0-34c6edf4997c-host-run-k8s-cni-cncf-io\") pod \"multus-z4v7q\" (UID: \"8e6a3d91-33c3-44c9-a4f0-34c6edf4997c\") " pod="openshift-multus/multus-z4v7q"
Jul 14 19:10:55.972263 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.970959    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7a447cf6-9373-4497-8028-97d590f38262-ovn-node-metrics-cert\") pod \"ovnkube-node-cqqv8\" (UID: \"7a447cf6-9373-4497-8028-97d590f38262\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqqv8"
Jul 14 19:10:55.972263 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.971072    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ef52564d-70d3-4e0d-a5d4-76de0d4cf5ff-tuning-conf-dir\") pod \"multus-additional-cni-plugins-ql9tj\" (UID: \"ef52564d-70d3-4e0d-a5d4-76de0d4cf5ff\") " pod="openshift-multus/multus-additional-cni-plugins-ql9tj"
Jul 14 19:10:55.972263 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.971097    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7a447cf6-9373-4497-8028-97d590f38262-systemd-units\") pod \"ovnkube-node-cqqv8\" (UID: \"7a447cf6-9373-4497-8028-97d590f38262\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqqv8"
Jul 14 19:10:55.972263 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.971120    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7a447cf6-9373-4497-8028-97d590f38262-host-slash\") pod \"ovnkube-node-cqqv8\" (UID: \"7a447cf6-9373-4497-8028-97d590f38262\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqqv8"
Jul 14 19:10:55.972263 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.971141    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8e6a3d91-33c3-44c9-a4f0-34c6edf4997c-etc-kubernetes\") pod \"multus-z4v7q\" (UID: \"8e6a3d91-33c3-44c9-a4f0-34c6edf4997c\") " pod="openshift-multus/multus-z4v7q"
Jul 14 19:10:55.972263 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.971180    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/905db982-21b7-4ee4-be3b-0df7088e422a-registration-dir\") pod \"aws-ebs-csi-driver-node-q9hq4\" (UID: \"905db982-21b7-4ee4-be3b-0df7088e422a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q9hq4"
Jul 14 19:10:55.972263 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.971203    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/06f772af-8888-44a7-9035-bd5ca76ac90e-serviceca\") pod \"node-ca-kjr5k\" (UID: \"06f772af-8888-44a7-9035-bd5ca76ac90e\") " pod="openshift-image-registry/node-ca-kjr5k"
Jul 14 19:10:55.972263 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.971228    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7a447cf6-9373-4497-8028-97d590f38262-systemd-units\") pod \"ovnkube-node-cqqv8\" (UID: \"7a447cf6-9373-4497-8028-97d590f38262\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqqv8"
Jul 14 19:10:55.972263 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.971263    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ef52564d-70d3-4e0d-a5d4-76de0d4cf5ff-cni-binary-copy\") pod \"multus-additional-cni-plugins-ql9tj\" (UID: \"ef52564d-70d3-4e0d-a5d4-76de0d4cf5ff\") " pod="openshift-multus/multus-additional-cni-plugins-ql9tj"
Jul 14 19:10:55.972263 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.971284    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7a447cf6-9373-4497-8028-97d590f38262-host-slash\") pod \"ovnkube-node-cqqv8\" (UID: \"7a447cf6-9373-4497-8028-97d590f38262\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqqv8"
Jul 14 19:10:55.972263 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.971290    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/8a7994c4-4dcd-4b18-a6f3-580eda35a3d9-kubelet-config\") pod \"global-pull-secret-syncer-lkbtz\" (UID: \"8a7994c4-4dcd-4b18-a6f3-580eda35a3d9\") " pod="kube-system/global-pull-secret-syncer-lkbtz"
Jul 14 19:10:55.972263 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.971314    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7a447cf6-9373-4497-8028-97d590f38262-host-run-ovn-kubernetes\") pod \"ovnkube-node-cqqv8\" (UID: \"7a447cf6-9373-4497-8028-97d590f38262\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqqv8"
Jul 14 19:10:55.972263 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.971277    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8e6a3d91-33c3-44c9-a4f0-34c6edf4997c-etc-kubernetes\") pod \"multus-z4v7q\" (UID: \"8e6a3d91-33c3-44c9-a4f0-34c6edf4997c\") " pod="openshift-multus/multus-z4v7q"
Jul 14 19:10:55.972263 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.971335    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/905db982-21b7-4ee4-be3b-0df7088e422a-registration-dir\") pod \"aws-ebs-csi-driver-node-q9hq4\" (UID: \"905db982-21b7-4ee4-be3b-0df7088e422a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q9hq4"
Jul 14 19:10:55.973000 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.971358    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7a447cf6-9373-4497-8028-97d590f38262-ovnkube-config\") pod \"ovnkube-node-cqqv8\" (UID: \"7a447cf6-9373-4497-8028-97d590f38262\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqqv8"
Jul 14 19:10:55.973000 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.971368    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7a447cf6-9373-4497-8028-97d590f38262-host-cni-bin\") pod \"ovnkube-node-cqqv8\" (UID: \"7a447cf6-9373-4497-8028-97d590f38262\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqqv8"
Jul 14 19:10:55.973000 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.971395    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ef52564d-70d3-4e0d-a5d4-76de0d4cf5ff-cnibin\") pod \"multus-additional-cni-plugins-ql9tj\" (UID: \"ef52564d-70d3-4e0d-a5d4-76de0d4cf5ff\") " pod="openshift-multus/multus-additional-cni-plugins-ql9tj"
Jul 14 19:10:55.973000 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.971418    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7a447cf6-9373-4497-8028-97d590f38262-host-run-ovn-kubernetes\") pod \"ovnkube-node-cqqv8\" (UID: \"7a447cf6-9373-4497-8028-97d590f38262\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqqv8"
Jul 14 19:10:55.973000 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.971421    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8e6a3d91-33c3-44c9-a4f0-34c6edf4997c-cni-binary-copy\") pod \"multus-z4v7q\" (UID: \"8e6a3d91-33c3-44c9-a4f0-34c6edf4997c\") " pod="openshift-multus/multus-z4v7q"
Jul 14 19:10:55.973000 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.971447    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/8a7994c4-4dcd-4b18-a6f3-580eda35a3d9-kubelet-config\") pod \"global-pull-secret-syncer-lkbtz\" (UID: \"8a7994c4-4dcd-4b18-a6f3-580eda35a3d9\") " pod="kube-system/global-pull-secret-syncer-lkbtz"
Jul 14 19:10:55.973000 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.971459    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/8e6a3d91-33c3-44c9-a4f0-34c6edf4997c-multus-socket-dir-parent\") pod \"multus-z4v7q\" (UID: \"8e6a3d91-33c3-44c9-a4f0-34c6edf4997c\") " pod="openshift-multus/multus-z4v7q"
Jul 14 19:10:55.973000 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.971486    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7a447cf6-9373-4497-8028-97d590f38262-host-run-netns\") pod \"ovnkube-node-cqqv8\" (UID: \"7a447cf6-9373-4497-8028-97d590f38262\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqqv8"
Jul 14 19:10:55.973000 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.971494    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7a447cf6-9373-4497-8028-97d590f38262-host-cni-bin\") pod \"ovnkube-node-cqqv8\" (UID: \"7a447cf6-9373-4497-8028-97d590f38262\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqqv8"
Jul 14 19:10:55.973000 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.971511    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/33e87184-8973-45c3-8719-143dd1d21929-iptables-alerter-script\") pod \"iptables-alerter-vmk5j\" (UID: \"33e87184-8973-45c3-8719-143dd1d21929\") " pod="openshift-network-operator/iptables-alerter-vmk5j"
Jul 14 19:10:55.973000 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.971575    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/8e6a3d91-33c3-44c9-a4f0-34c6edf4997c-multus-socket-dir-parent\") pod \"multus-z4v7q\" (UID: \"8e6a3d91-33c3-44c9-a4f0-34c6edf4997c\") " pod="openshift-multus/multus-z4v7q"
Jul 14 19:10:55.973000 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.971622    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7a447cf6-9373-4497-8028-97d590f38262-host-run-netns\") pod \"ovnkube-node-cqqv8\" (UID: \"7a447cf6-9373-4497-8028-97d590f38262\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqqv8"
Jul 14 19:10:55.973000 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.971637    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/06f772af-8888-44a7-9035-bd5ca76ac90e-serviceca\") pod \"node-ca-kjr5k\" (UID: \"06f772af-8888-44a7-9035-bd5ca76ac90e\") " pod="openshift-image-registry/node-ca-kjr5k"
Jul 14 19:10:55.973000 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.971534    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ef52564d-70d3-4e0d-a5d4-76de0d4cf5ff-cnibin\") pod \"multus-additional-cni-plugins-ql9tj\" (UID: \"ef52564d-70d3-4e0d-a5d4-76de0d4cf5ff\") " pod="openshift-multus/multus-additional-cni-plugins-ql9tj"
Jul 14 19:10:55.973000 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.971696    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8e6a3d91-33c3-44c9-a4f0-34c6edf4997c-system-cni-dir\") pod \"multus-z4v7q\" (UID: \"8e6a3d91-33c3-44c9-a4f0-34c6edf4997c\") " pod="openshift-multus/multus-z4v7q"
Jul 14 19:10:55.973000 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.971722    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8e6a3d91-33c3-44c9-a4f0-34c6edf4997c-host-var-lib-kubelet\") pod \"multus-z4v7q\" (UID: \"8e6a3d91-33c3-44c9-a4f0-34c6edf4997c\") " pod="openshift-multus/multus-z4v7q"
Jul 14 19:10:55.973000 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.971750    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ef52564d-70d3-4e0d-a5d4-76de0d4cf5ff-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-ql9tj\" (UID: \"ef52564d-70d3-4e0d-a5d4-76de0d4cf5ff\") " pod="openshift-multus/multus-additional-cni-plugins-ql9tj"
Jul 14 19:10:55.973660 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.971769    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8e6a3d91-33c3-44c9-a4f0-34c6edf4997c-system-cni-dir\") pod \"multus-z4v7q\" (UID: \"8e6a3d91-33c3-44c9-a4f0-34c6edf4997c\") " pod="openshift-multus/multus-z4v7q"
Jul 14 19:10:55.973660 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.971777    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sxhvs\" (UniqueName: \"kubernetes.io/projected/ef52564d-70d3-4e0d-a5d4-76de0d4cf5ff-kube-api-access-sxhvs\") pod \"multus-additional-cni-plugins-ql9tj\" (UID: \"ef52564d-70d3-4e0d-a5d4-76de0d4cf5ff\") " pod="openshift-multus/multus-additional-cni-plugins-ql9tj"
Jul 14 19:10:55.973660 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.971797    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8e6a3d91-33c3-44c9-a4f0-34c6edf4997c-host-var-lib-kubelet\") pod \"multus-z4v7q\" (UID: \"8e6a3d91-33c3-44c9-a4f0-34c6edf4997c\") " pod="openshift-multus/multus-z4v7q"
Jul 14 19:10:55.973660 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.971805    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/8e6a3d91-33c3-44c9-a4f0-34c6edf4997c-hostroot\") pod \"multus-z4v7q\" (UID: \"8e6a3d91-33c3-44c9-a4f0-34c6edf4997c\") " pod="openshift-multus/multus-z4v7q"
Jul 14 19:10:55.973660 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.971857    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/8e6a3d91-33c3-44c9-a4f0-34c6edf4997c-hostroot\") pod \"multus-z4v7q\" (UID: \"8e6a3d91-33c3-44c9-a4f0-34c6edf4997c\") " pod="openshift-multus/multus-z4v7q"
Jul 14 19:10:55.973660 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.971918    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gl72t\" (UniqueName: \"kubernetes.io/projected/8e6a3d91-33c3-44c9-a4f0-34c6edf4997c-kube-api-access-gl72t\") pod \"multus-z4v7q\" (UID: \"8e6a3d91-33c3-44c9-a4f0-34c6edf4997c\") " pod="openshift-multus/multus-z4v7q"
Jul 14 19:10:55.973660 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.971946    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8e6a3d91-33c3-44c9-a4f0-34c6edf4997c-cni-binary-copy\") pod \"multus-z4v7q\" (UID: \"8e6a3d91-33c3-44c9-a4f0-34c6edf4997c\") " pod="openshift-multus/multus-z4v7q"
Jul 14 19:10:55.973660 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.971948    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/905db982-21b7-4ee4-be3b-0df7088e422a-sys-fs\") pod \"aws-ebs-csi-driver-node-q9hq4\" (UID: \"905db982-21b7-4ee4-be3b-0df7088e422a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q9hq4"
Jul 14 19:10:55.973660 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.971988    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/905db982-21b7-4ee4-be3b-0df7088e422a-sys-fs\") pod \"aws-ebs-csi-driver-node-q9hq4\" (UID: \"905db982-21b7-4ee4-be3b-0df7088e422a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q9hq4"
Jul 14 19:10:55.973660 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.972091    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ef52564d-70d3-4e0d-a5d4-76de0d4cf5ff-tuning-conf-dir\") pod \"multus-additional-cni-plugins-ql9tj\" (UID: \"ef52564d-70d3-4e0d-a5d4-76de0d4cf5ff\") " pod="openshift-multus/multus-additional-cni-plugins-ql9tj"
Jul 14 19:10:55.973660 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.972205    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ef52564d-70d3-4e0d-a5d4-76de0d4cf5ff-cni-binary-copy\") pod \"multus-additional-cni-plugins-ql9tj\" (UID: \"ef52564d-70d3-4e0d-a5d4-76de0d4cf5ff\") " pod="openshift-multus/multus-additional-cni-plugins-ql9tj"
Jul 14 19:10:55.973660 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.972236    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gq5j7\" (UniqueName: \"kubernetes.io/projected/905db982-21b7-4ee4-be3b-0df7088e422a-kube-api-access-gq5j7\") pod \"aws-ebs-csi-driver-node-q9hq4\" (UID: \"905db982-21b7-4ee4-be3b-0df7088e422a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q9hq4"
Jul 14 19:10:55.973660 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.972268    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7a447cf6-9373-4497-8028-97d590f38262-run-openvswitch\") pod \"ovnkube-node-cqqv8\" (UID: \"7a447cf6-9373-4497-8028-97d590f38262\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqqv8"
Jul 14 19:10:55.973660 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.972291    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7a447cf6-9373-4497-8028-97d590f38262-ovnkube-script-lib\") pod \"ovnkube-node-cqqv8\" (UID: \"7a447cf6-9373-4497-8028-97d590f38262\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqqv8"
Jul 14 19:10:55.973660 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.972316    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8e6a3d91-33c3-44c9-a4f0-34c6edf4997c-multus-cni-dir\") pod \"multus-z4v7q\" (UID: \"8e6a3d91-33c3-44c9-a4f0-34c6edf4997c\") " pod="openshift-multus/multus-z4v7q"
Jul 14 19:10:55.973660 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.972347    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/8e6a3d91-33c3-44c9-a4f0-34c6edf4997c-multus-daemon-config\") pod \"multus-z4v7q\" (UID: \"8e6a3d91-33c3-44c9-a4f0-34c6edf4997c\") " pod="openshift-multus/multus-z4v7q"
Jul 14 19:10:55.973660 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.972347    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7a447cf6-9373-4497-8028-97d590f38262-run-openvswitch\") pod \"ovnkube-node-cqqv8\" (UID: \"7a447cf6-9373-4497-8028-97d590f38262\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqqv8"
Jul 14 19:10:55.974107 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.972359    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ef52564d-70d3-4e0d-a5d4-76de0d4cf5ff-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-ql9tj\" (UID: \"ef52564d-70d3-4e0d-a5d4-76de0d4cf5ff\") " pod="openshift-multus/multus-additional-cni-plugins-ql9tj"
Jul 14 19:10:55.974107 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.972405    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8e6a3d91-33c3-44c9-a4f0-34c6edf4997c-multus-cni-dir\") pod \"multus-z4v7q\" (UID: \"8e6a3d91-33c3-44c9-a4f0-34c6edf4997c\") " pod="openshift-multus/multus-z4v7q"
Jul 14 19:10:55.974107 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.972446    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/8e6a3d91-33c3-44c9-a4f0-34c6edf4997c-host-run-multus-certs\") pod \"multus-z4v7q\" (UID: \"8e6a3d91-33c3-44c9-a4f0-34c6edf4997c\") " pod="openshift-multus/multus-z4v7q"
Jul 14 19:10:55.974107 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.972474    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/33e87184-8973-45c3-8719-143dd1d21929-host-slash\") pod \"iptables-alerter-vmk5j\" (UID: \"33e87184-8973-45c3-8719-143dd1d21929\") " pod="openshift-network-operator/iptables-alerter-vmk5j"
Jul 14 19:10:55.974107 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.972497    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n6hqr\" (UniqueName: \"kubernetes.io/projected/33e87184-8973-45c3-8719-143dd1d21929-kube-api-access-n6hqr\") pod \"iptables-alerter-vmk5j\" (UID: \"33e87184-8973-45c3-8719-143dd1d21929\") " pod="openshift-network-operator/iptables-alerter-vmk5j"
Jul 14 19:10:55.974107 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.972522    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8e6a3d91-33c3-44c9-a4f0-34c6edf4997c-cnibin\") pod \"multus-z4v7q\" (UID: \"8e6a3d91-33c3-44c9-a4f0-34c6edf4997c\") " pod="openshift-multus/multus-z4v7q"
Jul 14 19:10:55.974107 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.972534    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/8e6a3d91-33c3-44c9-a4f0-34c6edf4997c-host-run-multus-certs\") pod \"multus-z4v7q\" (UID: \"8e6a3d91-33c3-44c9-a4f0-34c6edf4997c\") " pod="openshift-multus/multus-z4v7q"
Jul 14 19:10:55.974107 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.972546    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/905db982-21b7-4ee4-be3b-0df7088e422a-device-dir\") pod \"aws-ebs-csi-driver-node-q9hq4\" (UID: \"905db982-21b7-4ee4-be3b-0df7088e422a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q9hq4"
Jul 14 19:10:55.974107 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.972561    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/33e87184-8973-45c3-8719-143dd1d21929-host-slash\") pod \"iptables-alerter-vmk5j\" (UID: \"33e87184-8973-45c3-8719-143dd1d21929\") " pod="openshift-network-operator/iptables-alerter-vmk5j"
Jul 14 19:10:55.974107 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.972589    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/905db982-21b7-4ee4-be3b-0df7088e422a-device-dir\") pod \"aws-ebs-csi-driver-node-q9hq4\" (UID: \"905db982-21b7-4ee4-be3b-0df7088e422a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q9hq4"
Jul 14 19:10:55.974107 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.972592    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-crzgt\" (UniqueName: \"kubernetes.io/projected/7a447cf6-9373-4497-8028-97d590f38262-kube-api-access-crzgt\") pod \"ovnkube-node-cqqv8\" (UID: \"7a447cf6-9373-4497-8028-97d590f38262\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqqv8"
Jul 14 19:10:55.974107 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.972625    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d02ff63b-3fa8-432f-aa86-c517e74ae017-konnectivity-ca\") pod \"konnectivity-agent-ppqk5\" (UID: \"d02ff63b-3fa8-432f-aa86-c517e74ae017\") " pod="kube-system/konnectivity-agent-ppqk5"
Jul 14 19:10:55.974107 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.972650    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/06f772af-8888-44a7-9035-bd5ca76ac90e-host\") pod \"node-ca-kjr5k\" (UID: \"06f772af-8888-44a7-9035-bd5ca76ac90e\") " pod="openshift-image-registry/node-ca-kjr5k"
Jul 14 19:10:55.974107 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.972678    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7a447cf6-9373-4497-8028-97d590f38262-host-cni-netd\") pod \"ovnkube-node-cqqv8\" (UID: \"7a447cf6-9373-4497-8028-97d590f38262\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqqv8"
Jul 14 19:10:55.974107 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.972705    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8e6a3d91-33c3-44c9-a4f0-34c6edf4997c-host-var-lib-cni-bin\") pod \"multus-z4v7q\" (UID: \"8e6a3d91-33c3-44c9-a4f0-34c6edf4997c\") " pod="openshift-multus/multus-z4v7q"
Jul 14 19:10:55.974107 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.972734    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7a447cf6-9373-4497-8028-97d590f38262-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-cqqv8\" (UID: \"7a447cf6-9373-4497-8028-97d590f38262\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqqv8"
Jul 14 19:10:55.974107 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.972760    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7a447cf6-9373-4497-8028-97d590f38262-env-overrides\") pod \"ovnkube-node-cqqv8\" (UID: \"7a447cf6-9373-4497-8028-97d590f38262\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqqv8"
Jul 14 19:10:55.974775 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.972773    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/06f772af-8888-44a7-9035-bd5ca76ac90e-host\") pod \"node-ca-kjr5k\" (UID: \"06f772af-8888-44a7-9035-bd5ca76ac90e\") " pod="openshift-image-registry/node-ca-kjr5k"
Jul 14 19:10:55.974775 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.972815    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/33e87184-8973-45c3-8719-143dd1d21929-iptables-alerter-script\") pod \"iptables-alerter-vmk5j\" (UID: \"33e87184-8973-45c3-8719-143dd1d21929\") " pod="openshift-network-operator/iptables-alerter-vmk5j"
Jul 14 19:10:55.974775 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.972827    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/8e6a3d91-33c3-44c9-a4f0-34c6edf4997c-multus-daemon-config\") pod \"multus-z4v7q\" (UID: \"8e6a3d91-33c3-44c9-a4f0-34c6edf4997c\") " pod="openshift-multus/multus-z4v7q"
Jul 14 19:10:55.974775 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.972844    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8e6a3d91-33c3-44c9-a4f0-34c6edf4997c-cnibin\") pod \"multus-z4v7q\" (UID: \"8e6a3d91-33c3-44c9-a4f0-34c6edf4997c\") " pod="openshift-multus/multus-z4v7q"
Jul 14 19:10:55.974775 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.972876    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8e6a3d91-33c3-44c9-a4f0-34c6edf4997c-host-var-lib-cni-bin\") pod \"multus-z4v7q\" (UID: \"8e6a3d91-33c3-44c9-a4f0-34c6edf4997c\") " pod="openshift-multus/multus-z4v7q"
Jul 14 19:10:55.974775 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.972883    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7a447cf6-9373-4497-8028-97d590f38262-host-cni-netd\") pod \"ovnkube-node-cqqv8\" (UID: \"7a447cf6-9373-4497-8028-97d590f38262\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqqv8"
Jul 14 19:10:55.974775 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.972896    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7a447cf6-9373-4497-8028-97d590f38262-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-cqqv8\" (UID: \"7a447cf6-9373-4497-8028-97d590f38262\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqqv8"
Jul 14 19:10:55.974775 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.973176    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7a447cf6-9373-4497-8028-97d590f38262-env-overrides\") pod \"ovnkube-node-cqqv8\" (UID: \"7a447cf6-9373-4497-8028-97d590f38262\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqqv8"
Jul 14 19:10:55.974775 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.973199    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7a447cf6-9373-4497-8028-97d590f38262-ovnkube-script-lib\") pod \"ovnkube-node-cqqv8\" (UID: \"7a447cf6-9373-4497-8028-97d590f38262\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqqv8"
Jul 14 19:10:55.974775 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.973246    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d02ff63b-3fa8-432f-aa86-c517e74ae017-konnectivity-ca\") pod \"konnectivity-agent-ppqk5\" (UID: \"d02ff63b-3fa8-432f-aa86-c517e74ae017\") " pod="kube-system/konnectivity-agent-ppqk5"
Jul 14 19:10:55.974775 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.973341    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7a447cf6-9373-4497-8028-97d590f38262-ovn-node-metrics-cert\") pod \"ovnkube-node-cqqv8\" (UID: \"7a447cf6-9373-4497-8028-97d590f38262\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqqv8"
Jul 14 19:10:55.974775 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.973346    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d02ff63b-3fa8-432f-aa86-c517e74ae017-agent-certs\") pod \"konnectivity-agent-ppqk5\" (UID: \"d02ff63b-3fa8-432f-aa86-c517e74ae017\") " pod="kube-system/konnectivity-agent-ppqk5"
Jul 14 19:10:55.986253 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.986223    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n6hqr\" (UniqueName: \"kubernetes.io/projected/33e87184-8973-45c3-8719-143dd1d21929-kube-api-access-n6hqr\") pod \"iptables-alerter-vmk5j\" (UID: \"33e87184-8973-45c3-8719-143dd1d21929\") " pod="openshift-network-operator/iptables-alerter-vmk5j"
Jul 14 19:10:55.986572 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.986553    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gq5j7\" (UniqueName: \"kubernetes.io/projected/905db982-21b7-4ee4-be3b-0df7088e422a-kube-api-access-gq5j7\") pod \"aws-ebs-csi-driver-node-q9hq4\" (UID: \"905db982-21b7-4ee4-be3b-0df7088e422a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q9hq4"
Jul 14 19:10:55.986642 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.986590    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6mw7r\" (UniqueName: \"kubernetes.io/projected/06f772af-8888-44a7-9035-bd5ca76ac90e-kube-api-access-6mw7r\") pod \"node-ca-kjr5k\" (UID: \"06f772af-8888-44a7-9035-bd5ca76ac90e\") " pod="openshift-image-registry/node-ca-kjr5k"
Jul 14 19:10:55.988258 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.988238    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gl72t\" (UniqueName: \"kubernetes.io/projected/8e6a3d91-33c3-44c9-a4f0-34c6edf4997c-kube-api-access-gl72t\") pod \"multus-z4v7q\" (UID: \"8e6a3d91-33c3-44c9-a4f0-34c6edf4997c\") " pod="openshift-multus/multus-z4v7q"
Jul 14 19:10:55.988994 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.988974    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-crzgt\" (UniqueName: \"kubernetes.io/projected/7a447cf6-9373-4497-8028-97d590f38262-kube-api-access-crzgt\") pod \"ovnkube-node-cqqv8\" (UID: \"7a447cf6-9373-4497-8028-97d590f38262\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqqv8"
Jul 14 19:10:55.989067 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:55.989049    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sxhvs\" (UniqueName: \"kubernetes.io/projected/ef52564d-70d3-4e0d-a5d4-76de0d4cf5ff-kube-api-access-sxhvs\") pod \"multus-additional-cni-plugins-ql9tj\" (UID: \"ef52564d-70d3-4e0d-a5d4-76de0d4cf5ff\") " pod="openshift-multus/multus-additional-cni-plugins-ql9tj"
Jul 14 19:10:56.070422 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:56.070369    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-k447l"
Jul 14 19:10:56.076983 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:56.076967    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-ppqk5"
Jul 14 19:10:56.079043 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:56.079024    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaeff7a40_4f71_4be4_b327_d58a3fb0fc99.slice/crio-107d3c5075d558df1ef50f847ee29eb744c06ddf2ee7311c5a3d5aa87ed88a86 WatchSource:0}: Error finding container 107d3c5075d558df1ef50f847ee29eb744c06ddf2ee7311c5a3d5aa87ed88a86: Status 404 returned error can't find the container with id 107d3c5075d558df1ef50f847ee29eb744c06ddf2ee7311c5a3d5aa87ed88a86
Jul 14 19:10:56.083399 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:56.083378    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-gx8lp"
Jul 14 19:10:56.084133 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:56.084115    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd02ff63b_3fa8_432f_aa86_c517e74ae017.slice/crio-94fb868d7f351085427d98998cf4848091bb59cbb18a707641595b6970be3def WatchSource:0}: Error finding container 94fb868d7f351085427d98998cf4848091bb59cbb18a707641595b6970be3def: Status 404 returned error can't find the container with id 94fb868d7f351085427d98998cf4848091bb59cbb18a707641595b6970be3def
Jul 14 19:10:56.090917 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:56.090894    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d44b622_d76b_4616_af94_e7d9b6f2f67b.slice/crio-e46e5c70283cb06b02fe2e46346895a56cca2c6f1591d9f9ffa1025dc4f45f0b WatchSource:0}: Error finding container e46e5c70283cb06b02fe2e46346895a56cca2c6f1591d9f9ffa1025dc4f45f0b: Status 404 returned error can't find the container with id e46e5c70283cb06b02fe2e46346895a56cca2c6f1591d9f9ffa1025dc4f45f0b
Jul 14 19:10:56.093562 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:56.093546    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-ql9tj"
Jul 14 19:10:56.098578 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:56.098561    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-z4v7q"
Jul 14 19:10:56.100078 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:56.100055    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef52564d_70d3_4e0d_a5d4_76de0d4cf5ff.slice/crio-433b7cc127897a8bf7746f1df4044388c9a7b1f9be92192bdc66dc910ebf7087 WatchSource:0}: Error finding container 433b7cc127897a8bf7746f1df4044388c9a7b1f9be92192bdc66dc910ebf7087: Status 404 returned error can't find the container with id 433b7cc127897a8bf7746f1df4044388c9a7b1f9be92192bdc66dc910ebf7087
Jul 14 19:10:56.104181 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:56.104146    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q9hq4"
Jul 14 19:10:56.105416 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:56.105396    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e6a3d91_33c3_44c9_a4f0_34c6edf4997c.slice/crio-4aaa0b19f2c411bf8d8eefc395ee9b6f8e0659a021da3cdc57c06145b557a7ce WatchSource:0}: Error finding container 4aaa0b19f2c411bf8d8eefc395ee9b6f8e0659a021da3cdc57c06145b557a7ce: Status 404 returned error can't find the container with id 4aaa0b19f2c411bf8d8eefc395ee9b6f8e0659a021da3cdc57c06145b557a7ce
Jul 14 19:10:56.108558 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:56.108541    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-kjr5k"
Jul 14 19:10:56.112297 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:56.112278    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod905db982_21b7_4ee4_be3b_0df7088e422a.slice/crio-00526b7cb86a8d70bd07d5bbdbd958310b74cbb8e075c04cf30e9392bdcfa883 WatchSource:0}: Error finding container 00526b7cb86a8d70bd07d5bbdbd958310b74cbb8e075c04cf30e9392bdcfa883: Status 404 returned error can't find the container with id 00526b7cb86a8d70bd07d5bbdbd958310b74cbb8e075c04cf30e9392bdcfa883
Jul 14 19:10:56.114078 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:56.114061    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-cqqv8"
Jul 14 19:10:56.115970 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:56.115954    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06f772af_8888_44a7_9035_bd5ca76ac90e.slice/crio-cf2e3e527041a016e53efc9eaa6de1cbe898c4f72ddb61b3dc2b5e09132fb7b2 WatchSource:0}: Error finding container cf2e3e527041a016e53efc9eaa6de1cbe898c4f72ddb61b3dc2b5e09132fb7b2: Status 404 returned error can't find the container with id cf2e3e527041a016e53efc9eaa6de1cbe898c4f72ddb61b3dc2b5e09132fb7b2
Jul 14 19:10:56.118319 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:56.118256    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-vmk5j"
Jul 14 19:10:56.121194 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:56.121175    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a447cf6_9373_4497_8028_97d590f38262.slice/crio-04ac385433ebe5fb864e5b0234b564b6c8a1e62fafd80b6396ce718237aec5ba WatchSource:0}: Error finding container 04ac385433ebe5fb864e5b0234b564b6c8a1e62fafd80b6396ce718237aec5ba: Status 404 returned error can't find the container with id 04ac385433ebe5fb864e5b0234b564b6c8a1e62fafd80b6396ce718237aec5ba
Jul 14 19:10:56.125444 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:10:56.125427    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33e87184_8973_45c3_8719_143dd1d21929.slice/crio-95f6bcc722dc0a3d70cb96ccf83e3a50d5e0e51456371a6bacf7e0e42743f4ac WatchSource:0}: Error finding container 95f6bcc722dc0a3d70cb96ccf83e3a50d5e0e51456371a6bacf7e0e42743f4ac: Status 404 returned error can't find the container with id 95f6bcc722dc0a3d70cb96ccf83e3a50d5e0e51456371a6bacf7e0e42743f4ac
Jul 14 19:10:56.376437 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:56.376345    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a2ef2d8f-5f7b-41bd-b98a-2a272dd4090f-metrics-certs\") pod \"network-metrics-daemon-hbbrx\" (UID: \"a2ef2d8f-5f7b-41bd-b98a-2a272dd4090f\") " pod="openshift-multus/network-metrics-daemon-hbbrx"
Jul 14 19:10:56.376437 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:10:56.376430    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 14 19:10:56.376562 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:10:56.376473    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a2ef2d8f-5f7b-41bd-b98a-2a272dd4090f-metrics-certs podName:a2ef2d8f-5f7b-41bd-b98a-2a272dd4090f nodeName:}" failed. No retries permitted until 2026-07-14 19:10:57.37646028 +0000 UTC m=+3.937317150 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a2ef2d8f-5f7b-41bd-b98a-2a272dd4090f-metrics-certs") pod "network-metrics-daemon-hbbrx" (UID: "a2ef2d8f-5f7b-41bd-b98a-2a272dd4090f") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 14 19:10:56.477028 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:56.477006    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k77pn\" (UniqueName: \"kubernetes.io/projected/490a903e-0b54-40ef-82f2-4175faef060f-kube-api-access-k77pn\") pod \"network-check-target-xxs8n\" (UID: \"490a903e-0b54-40ef-82f2-4175faef060f\") " pod="openshift-network-diagnostics/network-check-target-xxs8n"
Jul 14 19:10:56.477135 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:56.477038    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8a7994c4-4dcd-4b18-a6f3-580eda35a3d9-original-pull-secret\") pod \"global-pull-secret-syncer-lkbtz\" (UID: \"8a7994c4-4dcd-4b18-a6f3-580eda35a3d9\") " pod="kube-system/global-pull-secret-syncer-lkbtz"
Jul 14 19:10:56.477135 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:10:56.477117    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 14 19:10:56.477264 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:10:56.477150    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 14 19:10:56.477264 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:10:56.477172    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a7994c4-4dcd-4b18-a6f3-580eda35a3d9-original-pull-secret podName:8a7994c4-4dcd-4b18-a6f3-580eda35a3d9 nodeName:}" failed. No retries permitted until 2026-07-14 19:10:57.477144379 +0000 UTC m=+4.038001250 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8a7994c4-4dcd-4b18-a6f3-580eda35a3d9-original-pull-secret") pod "global-pull-secret-syncer-lkbtz" (UID: "8a7994c4-4dcd-4b18-a6f3-580eda35a3d9") : object "kube-system"/"original-pull-secret" not registered
Jul 14 19:10:56.477264 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:10:56.477183    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 14 19:10:56.477264 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:10:56.477193    2565 projected.go:196] Error preparing data for projected volume kube-api-access-k77pn for pod openshift-network-diagnostics/network-check-target-xxs8n: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 14 19:10:56.477264 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:10:56.477248    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/490a903e-0b54-40ef-82f2-4175faef060f-kube-api-access-k77pn podName:490a903e-0b54-40ef-82f2-4175faef060f nodeName:}" failed. No retries permitted until 2026-07-14 19:10:57.477230942 +0000 UTC m=+4.038087812 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-k77pn" (UniqueName: "kubernetes.io/projected/490a903e-0b54-40ef-82f2-4175faef060f-kube-api-access-k77pn") pod "network-check-target-xxs8n" (UID: "490a903e-0b54-40ef-82f2-4175faef060f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 14 19:10:56.813408 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:56.813203    2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-13 19:05:55 +0000 UTC" deadline="2027-12-13 14:36:07.456576144 +0000 UTC"
Jul 14 19:10:56.813408 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:56.813402    2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12403h25m10.64317954s"
Jul 14 19:10:56.970039 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:56.969770    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cqqv8" event={"ID":"7a447cf6-9373-4497-8028-97d590f38262","Type":"ContainerStarted","Data":"04ac385433ebe5fb864e5b0234b564b6c8a1e62fafd80b6396ce718237aec5ba"}
Jul 14 19:10:56.971481 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:56.971448    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q9hq4" event={"ID":"905db982-21b7-4ee4-be3b-0df7088e422a","Type":"ContainerStarted","Data":"00526b7cb86a8d70bd07d5bbdbd958310b74cbb8e075c04cf30e9392bdcfa883"}
Jul 14 19:10:56.973061 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:56.973037    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-z4v7q" event={"ID":"8e6a3d91-33c3-44c9-a4f0-34c6edf4997c","Type":"ContainerStarted","Data":"4aaa0b19f2c411bf8d8eefc395ee9b6f8e0659a021da3cdc57c06145b557a7ce"}
Jul 14 19:10:56.974548 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:56.974525    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-kjr5k" event={"ID":"06f772af-8888-44a7-9035-bd5ca76ac90e","Type":"ContainerStarted","Data":"cf2e3e527041a016e53efc9eaa6de1cbe898c4f72ddb61b3dc2b5e09132fb7b2"}
Jul 14 19:10:56.976193 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:56.976170    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ql9tj" event={"ID":"ef52564d-70d3-4e0d-a5d4-76de0d4cf5ff","Type":"ContainerStarted","Data":"433b7cc127897a8bf7746f1df4044388c9a7b1f9be92192bdc66dc910ebf7087"}
Jul 14 19:10:56.977596 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:56.977574    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-gx8lp" event={"ID":"9d44b622-d76b-4616-af94-e7d9b6f2f67b","Type":"ContainerStarted","Data":"e46e5c70283cb06b02fe2e46346895a56cca2c6f1591d9f9ffa1025dc4f45f0b"}
Jul 14 19:10:56.978906 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:56.978884    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-ppqk5" event={"ID":"d02ff63b-3fa8-432f-aa86-c517e74ae017","Type":"ContainerStarted","Data":"94fb868d7f351085427d98998cf4848091bb59cbb18a707641595b6970be3def"}
Jul 14 19:10:56.980264 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:56.980237    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-k447l" event={"ID":"aeff7a40-4f71-4be4-b327-d58a3fb0fc99","Type":"ContainerStarted","Data":"107d3c5075d558df1ef50f847ee29eb744c06ddf2ee7311c5a3d5aa87ed88a86"}
Jul 14 19:10:56.981799 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:56.981770    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-vmk5j" event={"ID":"33e87184-8973-45c3-8719-143dd1d21929","Type":"ContainerStarted","Data":"95f6bcc722dc0a3d70cb96ccf83e3a50d5e0e51456371a6bacf7e0e42743f4ac"}
Jul 14 19:10:57.382842 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:57.382729    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a2ef2d8f-5f7b-41bd-b98a-2a272dd4090f-metrics-certs\") pod \"network-metrics-daemon-hbbrx\" (UID: \"a2ef2d8f-5f7b-41bd-b98a-2a272dd4090f\") " pod="openshift-multus/network-metrics-daemon-hbbrx"
Jul 14 19:10:57.383000 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:10:57.382902    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 14 19:10:57.383000 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:10:57.382967    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a2ef2d8f-5f7b-41bd-b98a-2a272dd4090f-metrics-certs podName:a2ef2d8f-5f7b-41bd-b98a-2a272dd4090f nodeName:}" failed. No retries permitted until 2026-07-14 19:10:59.382947221 +0000 UTC m=+5.943804096 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a2ef2d8f-5f7b-41bd-b98a-2a272dd4090f-metrics-certs") pod "network-metrics-daemon-hbbrx" (UID: "a2ef2d8f-5f7b-41bd-b98a-2a272dd4090f") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 14 19:10:57.483992 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:57.483957    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k77pn\" (UniqueName: \"kubernetes.io/projected/490a903e-0b54-40ef-82f2-4175faef060f-kube-api-access-k77pn\") pod \"network-check-target-xxs8n\" (UID: \"490a903e-0b54-40ef-82f2-4175faef060f\") " pod="openshift-network-diagnostics/network-check-target-xxs8n"
Jul 14 19:10:57.484139 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:57.484015    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8a7994c4-4dcd-4b18-a6f3-580eda35a3d9-original-pull-secret\") pod \"global-pull-secret-syncer-lkbtz\" (UID: \"8a7994c4-4dcd-4b18-a6f3-580eda35a3d9\") " pod="kube-system/global-pull-secret-syncer-lkbtz"
Jul 14 19:10:57.484230 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:10:57.484179    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 14 19:10:57.484284 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:10:57.484232    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a7994c4-4dcd-4b18-a6f3-580eda35a3d9-original-pull-secret podName:8a7994c4-4dcd-4b18-a6f3-580eda35a3d9 nodeName:}" failed. No retries permitted until 2026-07-14 19:10:59.484218897 +0000 UTC m=+6.045075767 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8a7994c4-4dcd-4b18-a6f3-580eda35a3d9-original-pull-secret") pod "global-pull-secret-syncer-lkbtz" (UID: "8a7994c4-4dcd-4b18-a6f3-580eda35a3d9") : object "kube-system"/"original-pull-secret" not registered
Jul 14 19:10:57.484567 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:10:57.484549    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 14 19:10:57.484644 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:10:57.484571    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 14 19:10:57.484644 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:10:57.484584    2565 projected.go:196] Error preparing data for projected volume kube-api-access-k77pn for pod openshift-network-diagnostics/network-check-target-xxs8n: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 14 19:10:57.484644 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:10:57.484631    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/490a903e-0b54-40ef-82f2-4175faef060f-kube-api-access-k77pn podName:490a903e-0b54-40ef-82f2-4175faef060f nodeName:}" failed. No retries permitted until 2026-07-14 19:10:59.484616515 +0000 UTC m=+6.045473389 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-k77pn" (UniqueName: "kubernetes.io/projected/490a903e-0b54-40ef-82f2-4175faef060f-kube-api-access-k77pn") pod "network-check-target-xxs8n" (UID: "490a903e-0b54-40ef-82f2-4175faef060f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 14 19:10:57.814300 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:57.814212    2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-13 19:05:55 +0000 UTC" deadline="2028-02-21 20:48:36.286505609 +0000 UTC"
Jul 14 19:10:57.814300 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:57.814249    2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14089h37m38.472261893s"
Jul 14 19:10:57.962920 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:57.962889    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hbbrx"
Jul 14 19:10:57.962920 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:57.962912    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xxs8n"
Jul 14 19:10:57.963137 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:57.962902    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lkbtz"
Jul 14 19:10:57.963137 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:10:57.963029    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hbbrx" podUID="a2ef2d8f-5f7b-41bd-b98a-2a272dd4090f"
Jul 14 19:10:57.963269 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:10:57.963147    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lkbtz" podUID="8a7994c4-4dcd-4b18-a6f3-580eda35a3d9"
Jul 14 19:10:57.963322 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:10:57.963278    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xxs8n" podUID="490a903e-0b54-40ef-82f2-4175faef060f"
Jul 14 19:10:59.402525 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:59.402440    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a2ef2d8f-5f7b-41bd-b98a-2a272dd4090f-metrics-certs\") pod \"network-metrics-daemon-hbbrx\" (UID: \"a2ef2d8f-5f7b-41bd-b98a-2a272dd4090f\") " pod="openshift-multus/network-metrics-daemon-hbbrx"
Jul 14 19:10:59.402951 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:10:59.402636    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 14 19:10:59.402951 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:10:59.402705    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a2ef2d8f-5f7b-41bd-b98a-2a272dd4090f-metrics-certs podName:a2ef2d8f-5f7b-41bd-b98a-2a272dd4090f nodeName:}" failed. No retries permitted until 2026-07-14 19:11:03.402685967 +0000 UTC m=+9.963542838 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a2ef2d8f-5f7b-41bd-b98a-2a272dd4090f-metrics-certs") pod "network-metrics-daemon-hbbrx" (UID: "a2ef2d8f-5f7b-41bd-b98a-2a272dd4090f") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 14 19:10:59.503175 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:59.503118    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k77pn\" (UniqueName: \"kubernetes.io/projected/490a903e-0b54-40ef-82f2-4175faef060f-kube-api-access-k77pn\") pod \"network-check-target-xxs8n\" (UID: \"490a903e-0b54-40ef-82f2-4175faef060f\") " pod="openshift-network-diagnostics/network-check-target-xxs8n"
Jul 14 19:10:59.503332 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:59.503192    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8a7994c4-4dcd-4b18-a6f3-580eda35a3d9-original-pull-secret\") pod \"global-pull-secret-syncer-lkbtz\" (UID: \"8a7994c4-4dcd-4b18-a6f3-580eda35a3d9\") " pod="kube-system/global-pull-secret-syncer-lkbtz"
Jul 14 19:10:59.503408 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:10:59.503350    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 14 19:10:59.503454 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:10:59.503412    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a7994c4-4dcd-4b18-a6f3-580eda35a3d9-original-pull-secret podName:8a7994c4-4dcd-4b18-a6f3-580eda35a3d9 nodeName:}" failed. No retries permitted until 2026-07-14 19:11:03.503393658 +0000 UTC m=+10.064250542 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8a7994c4-4dcd-4b18-a6f3-580eda35a3d9-original-pull-secret") pod "global-pull-secret-syncer-lkbtz" (UID: "8a7994c4-4dcd-4b18-a6f3-580eda35a3d9") : object "kube-system"/"original-pull-secret" not registered
Jul 14 19:10:59.503853 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:10:59.503828    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 14 19:10:59.503853 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:10:59.503853    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 14 19:10:59.504118 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:10:59.503866    2565 projected.go:196] Error preparing data for projected volume kube-api-access-k77pn for pod openshift-network-diagnostics/network-check-target-xxs8n: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 14 19:10:59.504118 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:10:59.503910    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/490a903e-0b54-40ef-82f2-4175faef060f-kube-api-access-k77pn podName:490a903e-0b54-40ef-82f2-4175faef060f nodeName:}" failed. No retries permitted until 2026-07-14 19:11:03.503896073 +0000 UTC m=+10.064752958 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-k77pn" (UniqueName: "kubernetes.io/projected/490a903e-0b54-40ef-82f2-4175faef060f-kube-api-access-k77pn") pod "network-check-target-xxs8n" (UID: "490a903e-0b54-40ef-82f2-4175faef060f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 14 19:10:59.963070 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:59.962696    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lkbtz"
Jul 14 19:10:59.963070 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:10:59.962831    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lkbtz" podUID="8a7994c4-4dcd-4b18-a6f3-580eda35a3d9"
Jul 14 19:10:59.963070 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:59.962906    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hbbrx"
Jul 14 19:10:59.963070 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:10:59.963036    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hbbrx" podUID="a2ef2d8f-5f7b-41bd-b98a-2a272dd4090f"
Jul 14 19:10:59.963337 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:59.963314    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xxs8n"
Jul 14 19:10:59.963447 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:10:59.963424    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xxs8n" podUID="490a903e-0b54-40ef-82f2-4175faef060f"
Jul 14 19:10:59.991227 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:59.991195    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ql9tj" event={"ID":"ef52564d-70d3-4e0d-a5d4-76de0d4cf5ff","Type":"ContainerStarted","Data":"fd3c25b9d251fee6e03d0c57c28cb5648d1df35820e200e7cf0f4e994a9fb83c"}
Jul 14 19:10:59.994645 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:59.994582    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-ppqk5" event={"ID":"d02ff63b-3fa8-432f-aa86-c517e74ae017","Type":"ContainerStarted","Data":"d7870d4a9ae8918f513e0dc84b628b1c38b6f2c166623d34ebffa6695125d8b8"}
Jul 14 19:10:59.996729 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:10:59.996702    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-23.ec2.internal" event={"ID":"fa1176d3df3d66efbed1343da676e97f","Type":"ContainerStarted","Data":"f645ef0235c3ec4c57c6e11eea4ed802f3ee09fc44c3eb392b2d03603ec00865"}
Jul 14 19:11:00.048968 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:11:00.048909    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-ppqk5" podStartSLOduration=2.533826067 podStartE2EDuration="6.048889033s" totalImagesPullingTime="3.515062966s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 19:10:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:11:00.047397188 +0000 UTC m=+6.608254080" watchObservedRunningTime="2026-07-14 19:11:00.048889033 +0000 UTC m=+6.609745928"
Jul 14 19:11:01.000325 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:11:01.000206    2565 generic.go:356] "Generic (PLEG): container finished" podID="ef52564d-70d3-4e0d-a5d4-76de0d4cf5ff" containerID="fd3c25b9d251fee6e03d0c57c28cb5648d1df35820e200e7cf0f4e994a9fb83c" exitCode=0
Jul 14 19:11:01.000325 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:11:01.000293    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ql9tj" event={"ID":"ef52564d-70d3-4e0d-a5d4-76de0d4cf5ff","Type":"ContainerDied","Data":"fd3c25b9d251fee6e03d0c57c28cb5648d1df35820e200e7cf0f4e994a9fb83c"}
Jul 14 19:11:01.965201 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:11:01.965171    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hbbrx"
Jul 14 19:11:01.965354 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:11:01.965325    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hbbrx" podUID="a2ef2d8f-5f7b-41bd-b98a-2a272dd4090f"
Jul 14 19:11:01.965692 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:11:01.965672    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xxs8n"
Jul 14 19:11:01.965795 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:11:01.965761    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xxs8n" podUID="490a903e-0b54-40ef-82f2-4175faef060f"
Jul 14 19:11:01.965858 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:11:01.965804    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lkbtz"
Jul 14 19:11:01.965917 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:11:01.965868    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lkbtz" podUID="8a7994c4-4dcd-4b18-a6f3-580eda35a3d9"
Jul 14 19:11:02.007504 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:11:02.007468    2565 generic.go:356] "Generic (PLEG): container finished" podID="fa1176d3df3d66efbed1343da676e97f" containerID="f645ef0235c3ec4c57c6e11eea4ed802f3ee09fc44c3eb392b2d03603ec00865" exitCode=0
Jul 14 19:11:02.007928 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:11:02.007566    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-23.ec2.internal" event={"ID":"fa1176d3df3d66efbed1343da676e97f","Type":"ContainerDied","Data":"f645ef0235c3ec4c57c6e11eea4ed802f3ee09fc44c3eb392b2d03603ec00865"}
Jul 14 19:11:02.013813 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:11:02.013567    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-vmk5j" event={"ID":"33e87184-8973-45c3-8719-143dd1d21929","Type":"ContainerStarted","Data":"b83949bac852ab37f5dc35c3e55e374cf4ad7648fb2ca8d27594093e4b6341b9"}
Jul 14 19:11:02.044317 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:11:02.044260    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-vmk5j" podStartSLOduration=4.568443669 podStartE2EDuration="8.044241838s" totalImagesPullingTime="3.475798169s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 19:10:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:11:02.044119147 +0000 UTC m=+8.604976039" watchObservedRunningTime="2026-07-14 19:11:02.044241838 +0000 UTC m=+8.605098733"
Jul 14 19:11:03.434003 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:11:03.433411    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a2ef2d8f-5f7b-41bd-b98a-2a272dd4090f-metrics-certs\") pod \"network-metrics-daemon-hbbrx\" (UID: \"a2ef2d8f-5f7b-41bd-b98a-2a272dd4090f\") " pod="openshift-multus/network-metrics-daemon-hbbrx"
Jul 14 19:11:03.434003 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:11:03.433554    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 14 19:11:03.434003 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:11:03.433611    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a2ef2d8f-5f7b-41bd-b98a-2a272dd4090f-metrics-certs podName:a2ef2d8f-5f7b-41bd-b98a-2a272dd4090f nodeName:}" failed. No retries permitted until 2026-07-14 19:11:11.433593378 +0000 UTC m=+17.994450258 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a2ef2d8f-5f7b-41bd-b98a-2a272dd4090f-metrics-certs") pod "network-metrics-daemon-hbbrx" (UID: "a2ef2d8f-5f7b-41bd-b98a-2a272dd4090f") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 14 19:11:03.534483 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:11:03.533781    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k77pn\" (UniqueName: \"kubernetes.io/projected/490a903e-0b54-40ef-82f2-4175faef060f-kube-api-access-k77pn\") pod \"network-check-target-xxs8n\" (UID: \"490a903e-0b54-40ef-82f2-4175faef060f\") " pod="openshift-network-diagnostics/network-check-target-xxs8n"
Jul 14 19:11:03.534483 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:11:03.533821    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8a7994c4-4dcd-4b18-a6f3-580eda35a3d9-original-pull-secret\") pod \"global-pull-secret-syncer-lkbtz\" (UID: \"8a7994c4-4dcd-4b18-a6f3-580eda35a3d9\") " pod="kube-system/global-pull-secret-syncer-lkbtz"
Jul 14 19:11:03.534483 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:11:03.533930    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 14 19:11:03.534483 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:11:03.533988    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a7994c4-4dcd-4b18-a6f3-580eda35a3d9-original-pull-secret podName:8a7994c4-4dcd-4b18-a6f3-580eda35a3d9 nodeName:}" failed. No retries permitted until 2026-07-14 19:11:11.533969834 +0000 UTC m=+18.094826707 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8a7994c4-4dcd-4b18-a6f3-580eda35a3d9-original-pull-secret") pod "global-pull-secret-syncer-lkbtz" (UID: "8a7994c4-4dcd-4b18-a6f3-580eda35a3d9") : object "kube-system"/"original-pull-secret" not registered
Jul 14 19:11:03.534483 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:11:03.534364    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 14 19:11:03.534483 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:11:03.534384    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 14 19:11:03.534483 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:11:03.534398    2565 projected.go:196] Error preparing data for projected volume kube-api-access-k77pn for pod openshift-network-diagnostics/network-check-target-xxs8n: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 14 19:11:03.534483 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:11:03.534438    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/490a903e-0b54-40ef-82f2-4175faef060f-kube-api-access-k77pn podName:490a903e-0b54-40ef-82f2-4175faef060f nodeName:}" failed. No retries permitted until 2026-07-14 19:11:11.53442555 +0000 UTC m=+18.095282419 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-k77pn" (UniqueName: "kubernetes.io/projected/490a903e-0b54-40ef-82f2-4175faef060f-kube-api-access-k77pn") pod "network-check-target-xxs8n" (UID: "490a903e-0b54-40ef-82f2-4175faef060f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 14 19:11:03.964196 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:11:03.963241    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lkbtz"
Jul 14 19:11:03.964196 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:11:03.963335    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lkbtz" podUID="8a7994c4-4dcd-4b18-a6f3-580eda35a3d9"
Jul 14 19:11:03.964196 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:11:03.963682    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hbbrx"
Jul 14 19:11:03.964196 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:11:03.963771    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hbbrx" podUID="a2ef2d8f-5f7b-41bd-b98a-2a272dd4090f"
Jul 14 19:11:03.964196 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:11:03.963827    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xxs8n"
Jul 14 19:11:03.964196 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:11:03.963888    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xxs8n" podUID="490a903e-0b54-40ef-82f2-4175faef060f"
Jul 14 19:11:04.047697 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:11:04.047665    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-ppqk5"
Jul 14 19:11:04.048823 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:11:04.048693    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-ppqk5"
Jul 14 19:11:05.025235 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:11:05.024795    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q9hq4" event={"ID":"905db982-21b7-4ee4-be3b-0df7088e422a","Type":"ContainerStarted","Data":"7ed657274bf56ed884bafbd00797d2a484bb97e365bb9e6207283d8e6b12c1eb"}
Jul 14 19:11:05.028731 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:11:05.028006    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-23.ec2.internal" event={"ID":"671780e245728d8f6e843008df2b039a","Type":"ContainerStarted","Data":"e6fb384052790f96f260a0d3883450309aaf22fce33a155ae4416c83720c617a"}
Jul 14 19:11:05.030694 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:11:05.030571    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-kjr5k" event={"ID":"06f772af-8888-44a7-9035-bd5ca76ac90e","Type":"ContainerStarted","Data":"9e5a37554aacb1d4239c0e45f09dc95ff8bb644824d863db8dd0a92ca76e184a"}
Jul 14 19:11:05.032915 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:11:05.032897    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-gx8lp" event={"ID":"9d44b622-d76b-4616-af94-e7d9b6f2f67b","Type":"ContainerStarted","Data":"3645f3d11aef8d3b5116aeeb29c2c5326e9a69c859d0f55b674fdd16d1252f88"}
Jul 14 19:11:05.036308 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:11:05.036286    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-23.ec2.internal" event={"ID":"fa1176d3df3d66efbed1343da676e97f","Type":"ContainerStarted","Data":"a9b574939f6315358d778e2b595ea336ad3bcb26047ad310756ab1483fefe400"}
Jul 14 19:11:05.059569 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:11:05.059528    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-gx8lp" podStartSLOduration=3.561905437 podStartE2EDuration="12.059512136s" totalImagesPullingTime="8.497606699s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 19:10:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:11:05.059099512 +0000 UTC m=+11.619956429" watchObservedRunningTime="2026-07-14 19:11:05.059512136 +0000 UTC m=+11.620369028"
Jul 14 19:11:05.059927 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:11:05.059895    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-23.ec2.internal" podStartSLOduration=11.059887689 podStartE2EDuration="11.059887689s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 19:10:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:11:05.04367853 +0000 UTC m=+11.604535440" watchObservedRunningTime="2026-07-14 19:11:05.059887689 +0000 UTC m=+11.620744586"
Jul 14 19:11:05.074021 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:11:05.073975    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-kjr5k" podStartSLOduration=2.605195401 podStartE2EDuration="11.073963141s" totalImagesPullingTime="8.46876774s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 19:10:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:11:05.073686245 +0000 UTC m=+11.634543140" watchObservedRunningTime="2026-07-14 19:11:05.073963141 +0000 UTC m=+11.634820032"
Jul 14 19:11:05.089034 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:11:05.088992    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-23.ec2.internal" podStartSLOduration=11.088976172 podStartE2EDuration="11.088976172s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 19:10:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:11:05.088016224 +0000 UTC m=+11.648873120" watchObservedRunningTime="2026-07-14 19:11:05.088976172 +0000 UTC m=+11.649833065"
Jul 14 19:11:05.962284 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:11:05.962248    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lkbtz"
Jul 14 19:11:05.962459 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:11:05.962422    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lkbtz" podUID="8a7994c4-4dcd-4b18-a6f3-580eda35a3d9"
Jul 14 19:11:05.962855 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:11:05.962836    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hbbrx"
Jul 14 19:11:05.962977 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:11:05.962953    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hbbrx" podUID="a2ef2d8f-5f7b-41bd-b98a-2a272dd4090f"
Jul 14 19:11:05.965086 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:11:05.965063    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xxs8n"
Jul 14 19:11:05.965209 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:11:05.965176    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xxs8n" podUID="490a903e-0b54-40ef-82f2-4175faef060f"
Jul 14 19:11:07.962140 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:11:07.962106    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xxs8n"
Jul 14 19:11:07.962797 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:11:07.962149    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lkbtz"
Jul 14 19:11:07.962797 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:11:07.962106    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hbbrx"
Jul 14 19:11:07.962797 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:11:07.962249    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xxs8n" podUID="490a903e-0b54-40ef-82f2-4175faef060f"
Jul 14 19:11:07.962797 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:11:07.962381    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hbbrx" podUID="a2ef2d8f-5f7b-41bd-b98a-2a272dd4090f"
Jul 14 19:11:07.962797 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:11:07.962469    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lkbtz" podUID="8a7994c4-4dcd-4b18-a6f3-580eda35a3d9"
Jul 14 19:11:09.962289 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:11:09.962258    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xxs8n"
Jul 14 19:11:09.962698 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:11:09.962314    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hbbrx"
Jul 14 19:11:09.962698 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:11:09.962324    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lkbtz"
Jul 14 19:11:09.962698 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:11:09.962412    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hbbrx" podUID="a2ef2d8f-5f7b-41bd-b98a-2a272dd4090f"
Jul 14 19:11:09.962698 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:11:09.962515    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xxs8n" podUID="490a903e-0b54-40ef-82f2-4175faef060f"
Jul 14 19:11:09.962698 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:11:09.962643    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lkbtz" podUID="8a7994c4-4dcd-4b18-a6f3-580eda35a3d9"
Jul 14 19:11:11.493689 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:11:11.493635    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a2ef2d8f-5f7b-41bd-b98a-2a272dd4090f-metrics-certs\") pod \"network-metrics-daemon-hbbrx\" (UID: \"a2ef2d8f-5f7b-41bd-b98a-2a272dd4090f\") " pod="openshift-multus/network-metrics-daemon-hbbrx"
Jul 14 19:11:11.494139 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:11:11.493783    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 14 19:11:11.494139 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:11:11.493843    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a2ef2d8f-5f7b-41bd-b98a-2a272dd4090f-metrics-certs podName:a2ef2d8f-5f7b-41bd-b98a-2a272dd4090f nodeName:}" failed. No retries permitted until 2026-07-14 19:11:27.493828315 +0000 UTC m=+34.054685185 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a2ef2d8f-5f7b-41bd-b98a-2a272dd4090f-metrics-certs") pod "network-metrics-daemon-hbbrx" (UID: "a2ef2d8f-5f7b-41bd-b98a-2a272dd4090f") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 14 19:11:11.594739 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:11:11.594706    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8a7994c4-4dcd-4b18-a6f3-580eda35a3d9-original-pull-secret\") pod \"global-pull-secret-syncer-lkbtz\" (UID: \"8a7994c4-4dcd-4b18-a6f3-580eda35a3d9\") " pod="kube-system/global-pull-secret-syncer-lkbtz"
Jul 14 19:11:11.594908 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:11:11.594796    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k77pn\" (UniqueName: \"kubernetes.io/projected/490a903e-0b54-40ef-82f2-4175faef060f-kube-api-access-k77pn\") pod \"network-check-target-xxs8n\" (UID: \"490a903e-0b54-40ef-82f2-4175faef060f\") " pod="openshift-network-diagnostics/network-check-target-xxs8n"
Jul 14 19:11:11.594908 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:11:11.594866    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 14 19:11:11.594908 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:11:11.594904    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 14 19:11:11.595076 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:11:11.594920    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 14 19:11:11.595076 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:11:11.594931    2565 projected.go:196] Error preparing data for projected volume kube-api-access-k77pn for pod openshift-network-diagnostics/network-check-target-xxs8n: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 14 19:11:11.595076 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:11:11.594939    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a7994c4-4dcd-4b18-a6f3-580eda35a3d9-original-pull-secret podName:8a7994c4-4dcd-4b18-a6f3-580eda35a3d9 nodeName:}" failed. No retries permitted until 2026-07-14 19:11:27.59491735 +0000 UTC m=+34.155774224 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8a7994c4-4dcd-4b18-a6f3-580eda35a3d9-original-pull-secret") pod "global-pull-secret-syncer-lkbtz" (UID: "8a7994c4-4dcd-4b18-a6f3-580eda35a3d9") : object "kube-system"/"original-pull-secret" not registered
Jul 14 19:11:11.595076 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:11:11.594966    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/490a903e-0b54-40ef-82f2-4175faef060f-kube-api-access-k77pn podName:490a903e-0b54-40ef-82f2-4175faef060f nodeName:}" failed. No retries permitted until 2026-07-14 19:11:27.594955368 +0000 UTC m=+34.155812238 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-k77pn" (UniqueName: "kubernetes.io/projected/490a903e-0b54-40ef-82f2-4175faef060f-kube-api-access-k77pn") pod "network-check-target-xxs8n" (UID: "490a903e-0b54-40ef-82f2-4175faef060f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 14 19:11:11.962697 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:11:11.962629    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lkbtz"
Jul 14 19:11:11.962830 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:11:11.962744    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hbbrx"
Jul 14 19:11:11.962830 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:11:11.962747    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lkbtz" podUID="8a7994c4-4dcd-4b18-a6f3-580eda35a3d9"
Jul 14 19:11:11.962830 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:11:11.962785    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xxs8n"
Jul 14 19:11:11.962926 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:11:11.962856    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xxs8n" podUID="490a903e-0b54-40ef-82f2-4175faef060f"
Jul 14 19:11:11.962959 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:11:11.962914    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hbbrx" podUID="a2ef2d8f-5f7b-41bd-b98a-2a272dd4090f"
Jul 14 19:11:13.963862 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:11:13.963649    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hbbrx"
Jul 14 19:11:13.964322 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:11:13.963949    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hbbrx" podUID="a2ef2d8f-5f7b-41bd-b98a-2a272dd4090f"
Jul 14 19:11:13.964322 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:11:13.964259    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xxs8n"
Jul 14 19:11:13.964436 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:11:13.964369    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xxs8n" podUID="490a903e-0b54-40ef-82f2-4175faef060f"
Jul 14 19:11:13.964436 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:11:13.964432    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lkbtz"
Jul 14 19:11:13.964540 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:11:13.964506    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lkbtz" podUID="8a7994c4-4dcd-4b18-a6f3-580eda35a3d9"
Jul 14 19:11:15.962133 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:11:15.962088    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lkbtz"
Jul 14 19:11:15.962640 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:11:15.962093    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hbbrx"
Jul 14 19:11:15.962640 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:11:15.962229    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lkbtz" podUID="8a7994c4-4dcd-4b18-a6f3-580eda35a3d9"
Jul 14 19:11:15.962640 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:11:15.962096    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xxs8n"
Jul 14 19:11:15.962640 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:11:15.962301    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hbbrx" podUID="a2ef2d8f-5f7b-41bd-b98a-2a272dd4090f"
Jul 14 19:11:15.962640 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:11:15.962356    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xxs8n" podUID="490a903e-0b54-40ef-82f2-4175faef060f"
Jul 14 19:11:17.962442 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:11:17.962403    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lkbtz"
Jul 14 19:11:17.962990 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:11:17.962407    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hbbrx"
Jul 14 19:11:17.962990 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:11:17.962534    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lkbtz" podUID="8a7994c4-4dcd-4b18-a6f3-580eda35a3d9"
Jul 14 19:11:17.962990 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:11:17.962614    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hbbrx" podUID="a2ef2d8f-5f7b-41bd-b98a-2a272dd4090f"
Jul 14 19:11:17.962990 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:11:17.962405    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xxs8n"
Jul 14 19:11:17.962990 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:11:17.962677    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xxs8n" podUID="490a903e-0b54-40ef-82f2-4175faef060f"
Jul 14 19:11:18.489772 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:11:18.489745    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-ppqk5"
Jul 14 19:11:18.489905 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:11:18.489871    2565 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 14 19:11:18.490314 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:11:18.490292    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-ppqk5"
Jul 14 19:11:18.875376 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:11:18.875189    2565 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 14 19:11:19.065597 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:11:19.065407    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-k447l" event={"ID":"aeff7a40-4f71-4be4-b327-d58a3fb0fc99","Type":"ContainerStarted","Data":"f5051b74140e6dc9a2d20af7dabbf0a146cd07809566551fcb9b62f5027fda88"}
Jul 14 19:11:19.067368 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:11:19.067352    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cqqv8_7a447cf6-9373-4497-8028-97d590f38262/ovn-acl-logging/0.log"
Jul 14 19:11:19.067652 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:11:19.067634    2565 generic.go:356] "Generic (PLEG): container finished" podID="7a447cf6-9373-4497-8028-97d590f38262" containerID="f2ed4dc210171e2768c5ebd6c26ee28638765ca0f9f22e8c2a658ca0a46ff977" exitCode=1
Jul 14 19:11:19.067709 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:11:19.067691    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cqqv8" event={"ID":"7a447cf6-9373-4497-8028-97d590f38262","Type":"ContainerStarted","Data":"054834b956548349d5507e1e7d363c5e4e9f81f75ddcb75643c8efa039966b07"}
Jul 14 19:11:19.067759 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:11:19.067743    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cqqv8" event={"ID":"7a447cf6-9373-4497-8028-97d590f38262","Type":"ContainerStarted","Data":"2443816caf87fd8b6c2ab6038fe15f18ae09907c8a87e38ff2dbd849ff9f2b24"}
Jul 14 19:11:19.067802 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:11:19.067791    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cqqv8" event={"ID":"7a447cf6-9373-4497-8028-97d590f38262","Type":"ContainerDied","Data":"f2ed4dc210171e2768c5ebd6c26ee28638765ca0f9f22e8c2a658ca0a46ff977"}
Jul 14 19:11:19.067850 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:11:19.067829    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cqqv8" event={"ID":"7a447cf6-9373-4497-8028-97d590f38262","Type":"ContainerStarted","Data":"6c86d581b023f739e346d57e4ed3011477e8e379bab9c72ae687b31fdf10dc19"}
Jul 14 19:11:19.069300 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:11:19.069272    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q9hq4" event={"ID":"905db982-21b7-4ee4-be3b-0df7088e422a","Type":"ContainerStarted","Data":"d33c344dd6625e5e7b115aac306e366a6fcfce6c7f521850ad15d4ffc57389da"}
Jul 14 19:11:19.070444 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:11:19.070422    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-z4v7q" event={"ID":"8e6a3d91-33c3-44c9-a4f0-34c6edf4997c","Type":"ContainerStarted","Data":"10d61dff14203376c92659f4ccaeb9f028b83eb4c96e3b5497fb28c2ecd62641"}
Jul 14 19:11:19.071988 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:11:19.071968    2565 generic.go:356] "Generic (PLEG): container finished" podID="ef52564d-70d3-4e0d-a5d4-76de0d4cf5ff" containerID="d347088bb988090d4f0935d0d1e908c8dfbee813f1f8a7fe14402af7f1c5559f" exitCode=0
Jul 14 19:11:19.072070 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:11:19.072041    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ql9tj" event={"ID":"ef52564d-70d3-4e0d-a5d4-76de0d4cf5ff","Type":"ContainerDied","Data":"d347088bb988090d4f0935d0d1e908c8dfbee813f1f8a7fe14402af7f1c5559f"}
Jul 14 19:11:19.081233 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:11:19.081173    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-k447l" podStartSLOduration=3.440699546 podStartE2EDuration="26.081136498s" totalImagesPullingTime="22.640436952s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 19:10:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:11:19.08099597 +0000 UTC m=+25.641852875" watchObservedRunningTime="2026-07-14 19:11:19.081136498 +0000 UTC m=+25.641993391"
Jul 14 19:11:19.123147 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:11:19.123114    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-z4v7q" podStartSLOduration=3.508873932 podStartE2EDuration="26.123100698s" totalImagesPullingTime="22.614226766s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 19:10:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:11:19.123007402 +0000 UTC m=+25.683864293" watchObservedRunningTime="2026-07-14 19:11:19.123100698 +0000 UTC m=+25.683957589"
Jul 14 19:11:19.827410 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:11:19.827316    2565 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-14T19:11:18.875209375Z","UUID":"269de2af-2c97-40e0-8eea-1c48d92df1d4","Handler":null,"Name":"","Endpoint":""}
Jul 14 19:11:19.828591 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:11:19.828574    2565 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 14 19:11:19.828684 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:11:19.828603    2565 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 14 19:11:19.962128 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:11:19.962105    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hbbrx"
Jul 14 19:11:19.962268 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:11:19.962110    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xxs8n"
Jul 14 19:11:19.962268 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:11:19.962241    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hbbrx" podUID="a2ef2d8f-5f7b-41bd-b98a-2a272dd4090f"
Jul 14 19:11:19.962382 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:11:19.962365    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xxs8n" podUID="490a903e-0b54-40ef-82f2-4175faef060f"
Jul 14 19:11:19.962437 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:11:19.962400    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lkbtz"
Jul 14 19:11:19.962492 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:11:19.962479    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lkbtz" podUID="8a7994c4-4dcd-4b18-a6f3-580eda35a3d9"
Jul 14 19:11:20.075349 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:11:20.075294    2565 generic.go:356] "Generic (PLEG): container finished" podID="ef52564d-70d3-4e0d-a5d4-76de0d4cf5ff" containerID="b932e294344f26bbd61ce4a99b7ac5141853bad35f26446e5550875dd4640975" exitCode=0
Jul 14 19:11:20.075824 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:11:20.075370    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ql9tj" event={"ID":"ef52564d-70d3-4e0d-a5d4-76de0d4cf5ff","Type":"ContainerDied","Data":"b932e294344f26bbd61ce4a99b7ac5141853bad35f26446e5550875dd4640975"}
Jul 14 19:11:20.078242 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:11:20.078225    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cqqv8_7a447cf6-9373-4497-8028-97d590f38262/ovn-acl-logging/0.log"
Jul 14 19:11:20.078573 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:11:20.078549    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cqqv8" event={"ID":"7a447cf6-9373-4497-8028-97d590f38262","Type":"ContainerStarted","Data":"d1011a4457896d22e856efe09b90f7ca33353afed37863f8c674e0e3aed950f6"}
Jul 14 19:11:20.078655 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:11:20.078631    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cqqv8" event={"ID":"7a447cf6-9373-4497-8028-97d590f38262","Type":"ContainerStarted","Data":"8be7398012be8e30c549c38083074a4d5632759da4609fe819937a318665a0d8"}
Jul 14 19:11:21.962952 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:11:21.962922    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lkbtz"
Jul 14 19:11:21.962952 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:11:21.962951    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xxs8n"
Jul 14 19:11:21.963339 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:11:21.962922    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hbbrx"
Jul 14 19:11:21.963339 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:11:21.963028    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lkbtz" podUID="8a7994c4-4dcd-4b18-a6f3-580eda35a3d9"
Jul 14 19:11:21.963339 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:11:21.963125    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hbbrx" podUID="a2ef2d8f-5f7b-41bd-b98a-2a272dd4090f"
Jul 14 19:11:21.963339 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:11:21.963202    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xxs8n" podUID="490a903e-0b54-40ef-82f2-4175faef060f"
Jul 14 19:11:22.084419 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:11:22.084346    2565 generic.go:356] "Generic (PLEG): container finished" podID="ef52564d-70d3-4e0d-a5d4-76de0d4cf5ff" containerID="177c05576f4e69a9aa3a4dd2297db306af725ff46a30d9080eddbe5263eb0dbf" exitCode=0
Jul 14 19:11:22.084553 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:11:22.084434    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ql9tj" event={"ID":"ef52564d-70d3-4e0d-a5d4-76de0d4cf5ff","Type":"ContainerDied","Data":"177c05576f4e69a9aa3a4dd2297db306af725ff46a30d9080eddbe5263eb0dbf"}
Jul 14 19:11:22.088021 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:11:22.088004    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cqqv8_7a447cf6-9373-4497-8028-97d590f38262/ovn-acl-logging/0.log"
Jul 14 19:11:22.088442 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:11:22.088414    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cqqv8" event={"ID":"7a447cf6-9373-4497-8028-97d590f38262","Type":"ContainerStarted","Data":"411fabb800f26d0db276f02323daa037c074b975f05ef233916c7e88ac588211"}
Jul 14 19:11:22.090933 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:11:22.090906    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q9hq4" event={"ID":"905db982-21b7-4ee4-be3b-0df7088e422a","Type":"ContainerStarted","Data":"402efcf49fce30efb5fa15e2c10e061c56cfd5e576e40cc1fbb738ae21d778cf"}
Jul 14 19:11:22.122944 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:11:22.122902    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q9hq4" podStartSLOduration=3.416496386 podStartE2EDuration="28.122891144s" totalImagesPullingTime="24.706394758s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 19:10:54 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:11:22.122768665 +0000 UTC m=+28.683625548" watchObservedRunningTime="2026-07-14 19:11:22.122891144 +0000 UTC m=+28.683748035"
Jul 14 19:11:23.964638 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:11:23.964362    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lkbtz"
Jul 14 19:11:23.966056 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:11:23.964453    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hbbrx"
Jul 14 19:11:23.966056 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:11:23.964692    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lkbtz" podUID="8a7994c4-4dcd-4b18-a6f3-580eda35a3d9"
Jul 14 19:11:23.966056 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:11:23.964485    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xxs8n"
Jul 14 19:11:23.966056 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:11:23.964802    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hbbrx" podUID="a2ef2d8f-5f7b-41bd-b98a-2a272dd4090f"
Jul 14 19:11:23.966056 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:11:23.964866    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xxs8n" podUID="490a903e-0b54-40ef-82f2-4175faef060f"
Jul 14 19:11:24.099585 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:11:24.099555    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cqqv8_7a447cf6-9373-4497-8028-97d590f38262/ovn-acl-logging/0.log"
Jul 14 19:11:24.101187 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:11:24.099925    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cqqv8" event={"ID":"7a447cf6-9373-4497-8028-97d590f38262","Type":"ContainerStarted","Data":"1e12d9ba812301a2de458d440318d46f63d9b2de6c714e633d393c675999d010"}
Jul 14 19:11:24.101187 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:11:24.100256    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-cqqv8"
Jul 14 19:11:24.101187 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:11:24.100330    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-cqqv8"
Jul 14 19:11:24.101187 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:11:24.100369    2565 scope.go:117] "RemoveContainer" containerID="f2ed4dc210171e2768c5ebd6c26ee28638765ca0f9f22e8c2a658ca0a46ff977"
Jul 14 19:11:24.119962 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:11:24.119937    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-cqqv8"
Jul 14 19:11:25.106624 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:11:25.106595    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cqqv8_7a447cf6-9373-4497-8028-97d590f38262/ovn-acl-logging/0.log"
Jul 14 19:11:25.107107 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:11:25.107016    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cqqv8" event={"ID":"7a447cf6-9373-4497-8028-97d590f38262","Type":"ContainerStarted","Data":"7d1a3b38ab62afcd26ce7a4a6245126d54b74324800a1df375280eb78edbb2a2"}
Jul 14 19:11:25.107423 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:11:25.107310    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-cqqv8"
Jul 14 19:11:25.123858 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:11:25.123826    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-cqqv8"
Jul 14 19:11:25.135566 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:11:25.135511    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-cqqv8" podStartSLOduration=8.536001148 podStartE2EDuration="31.135490676s" totalImagesPullingTime="22.599489528s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 19:10:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:11:25.133711893 +0000 UTC m=+31.694568818" watchObservedRunningTime="2026-07-14 19:11:25.135490676 +0000 UTC m=+31.696347578"
Jul 14 19:11:25.662023 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:11:25.661408    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-hbbrx"]
Jul 14 19:11:25.662023 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:11:25.661567    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hbbrx"
Jul 14 19:11:25.662023 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:11:25.661687    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hbbrx" podUID="a2ef2d8f-5f7b-41bd-b98a-2a272dd4090f"
Jul 14 19:11:25.662348 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:11:25.662188    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-lkbtz"]
Jul 14 19:11:25.662348 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:11:25.662290    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lkbtz"
Jul 14 19:11:25.662443 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:11:25.662390    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lkbtz" podUID="8a7994c4-4dcd-4b18-a6f3-580eda35a3d9"
Jul 14 19:11:25.664083 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:11:25.664056    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-xxs8n"]
Jul 14 19:11:25.664213 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:11:25.664149    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xxs8n"
Jul 14 19:11:25.664289 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:11:25.664247    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xxs8n" podUID="490a903e-0b54-40ef-82f2-4175faef060f"
Jul 14 19:11:26.962906 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:11:26.962686    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hbbrx"
Jul 14 19:11:26.963283 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:11:26.962744    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lkbtz"
Jul 14 19:11:26.963283 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:11:26.962939    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hbbrx" podUID="a2ef2d8f-5f7b-41bd-b98a-2a272dd4090f"
Jul 14 19:11:26.963283 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:11:26.963004    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lkbtz" podUID="8a7994c4-4dcd-4b18-a6f3-580eda35a3d9"
Jul 14 19:11:27.112812 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:11:27.112784    2565 generic.go:356] "Generic (PLEG): container finished" podID="ef52564d-70d3-4e0d-a5d4-76de0d4cf5ff" containerID="5af23600221d190d43401d548393da04741d0364850a0e9a125703e7b1fa0440" exitCode=0
Jul 14 19:11:27.112940 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:11:27.112869    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ql9tj" event={"ID":"ef52564d-70d3-4e0d-a5d4-76de0d4cf5ff","Type":"ContainerDied","Data":"5af23600221d190d43401d548393da04741d0364850a0e9a125703e7b1fa0440"}
Jul 14 19:11:27.516051 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:11:27.516026    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a2ef2d8f-5f7b-41bd-b98a-2a272dd4090f-metrics-certs\") pod \"network-metrics-daemon-hbbrx\" (UID: \"a2ef2d8f-5f7b-41bd-b98a-2a272dd4090f\") " pod="openshift-multus/network-metrics-daemon-hbbrx"
Jul 14 19:11:27.516281 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:11:27.516209    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 14 19:11:27.516376 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:11:27.516294    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a2ef2d8f-5f7b-41bd-b98a-2a272dd4090f-metrics-certs podName:a2ef2d8f-5f7b-41bd-b98a-2a272dd4090f nodeName:}" failed. No retries permitted until 2026-07-14 19:11:59.516273256 +0000 UTC m=+66.077130128 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a2ef2d8f-5f7b-41bd-b98a-2a272dd4090f-metrics-certs") pod "network-metrics-daemon-hbbrx" (UID: "a2ef2d8f-5f7b-41bd-b98a-2a272dd4090f") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 14 19:11:27.617148 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:11:27.617125    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k77pn\" (UniqueName: \"kubernetes.io/projected/490a903e-0b54-40ef-82f2-4175faef060f-kube-api-access-k77pn\") pod \"network-check-target-xxs8n\" (UID: \"490a903e-0b54-40ef-82f2-4175faef060f\") " pod="openshift-network-diagnostics/network-check-target-xxs8n"
Jul 14 19:11:27.617291 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:11:27.617174    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8a7994c4-4dcd-4b18-a6f3-580eda35a3d9-original-pull-secret\") pod \"global-pull-secret-syncer-lkbtz\" (UID: \"8a7994c4-4dcd-4b18-a6f3-580eda35a3d9\") " pod="kube-system/global-pull-secret-syncer-lkbtz"
Jul 14 19:11:27.617291 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:11:27.617272    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 14 19:11:27.617291 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:11:27.617275    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 14 19:11:27.617397 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:11:27.617303    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 14 19:11:27.617397 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:11:27.617312    2565 projected.go:196] Error preparing data for projected volume kube-api-access-k77pn for pod openshift-network-diagnostics/network-check-target-xxs8n: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 14 19:11:27.617397 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:11:27.617325    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a7994c4-4dcd-4b18-a6f3-580eda35a3d9-original-pull-secret podName:8a7994c4-4dcd-4b18-a6f3-580eda35a3d9 nodeName:}" failed. No retries permitted until 2026-07-14 19:11:59.61731315 +0000 UTC m=+66.178170020 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8a7994c4-4dcd-4b18-a6f3-580eda35a3d9-original-pull-secret") pod "global-pull-secret-syncer-lkbtz" (UID: "8a7994c4-4dcd-4b18-a6f3-580eda35a3d9") : object "kube-system"/"original-pull-secret" not registered
Jul 14 19:11:27.617397 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:11:27.617347    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/490a903e-0b54-40ef-82f2-4175faef060f-kube-api-access-k77pn podName:490a903e-0b54-40ef-82f2-4175faef060f nodeName:}" failed. No retries permitted until 2026-07-14 19:11:59.617335827 +0000 UTC m=+66.178192716 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-k77pn" (UniqueName: "kubernetes.io/projected/490a903e-0b54-40ef-82f2-4175faef060f-kube-api-access-k77pn") pod "network-check-target-xxs8n" (UID: "490a903e-0b54-40ef-82f2-4175faef060f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 14 19:11:27.962876 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:11:27.962845    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xxs8n"
Jul 14 19:11:27.963000 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:11:27.962969    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xxs8n" podUID="490a903e-0b54-40ef-82f2-4175faef060f"
Jul 14 19:11:28.118264 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:11:28.118234    2565 generic.go:356] "Generic (PLEG): container finished" podID="ef52564d-70d3-4e0d-a5d4-76de0d4cf5ff" containerID="573284872baef6d91e4ec756e59d22098672d826c466f5b1909fce175f76e0f1" exitCode=0
Jul 14 19:11:28.118367 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:11:28.118279    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ql9tj" event={"ID":"ef52564d-70d3-4e0d-a5d4-76de0d4cf5ff","Type":"ContainerDied","Data":"573284872baef6d91e4ec756e59d22098672d826c466f5b1909fce175f76e0f1"}
Jul 14 19:11:28.962495 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:11:28.962465    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hbbrx"
Jul 14 19:11:28.962495 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:11:28.962498    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lkbtz"
Jul 14 19:11:28.962724 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:11:28.962570    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hbbrx" podUID="a2ef2d8f-5f7b-41bd-b98a-2a272dd4090f"
Jul 14 19:11:28.962724 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:11:28.962702    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lkbtz" podUID="8a7994c4-4dcd-4b18-a6f3-580eda35a3d9"
Jul 14 19:11:29.123584 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:11:29.123556    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ql9tj" event={"ID":"ef52564d-70d3-4e0d-a5d4-76de0d4cf5ff","Type":"ContainerStarted","Data":"b77ca363f200c6761fc0041b724160e41ba668267101e59f829255494c7bc1ed"}
Jul 14 19:11:29.149171 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:11:29.149126    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-ql9tj" podStartSLOduration=8.701706512 podStartE2EDuration="36.1491152s" totalImagesPullingTime="27.447408688s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 19:10:53 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:11:29.147870957 +0000 UTC m=+35.708727847" watchObservedRunningTime="2026-07-14 19:11:29.1491152 +0000 UTC m=+35.709972091"
Jul 14 19:11:29.962312 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:11:29.962282    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xxs8n"
Jul 14 19:11:29.962494 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:11:29.962388    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xxs8n" podUID="490a903e-0b54-40ef-82f2-4175faef060f"
Jul 14 19:11:30.961995 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:11:30.961959    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hbbrx"
Jul 14 19:11:30.962392 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:11:30.962069    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hbbrx" podUID="a2ef2d8f-5f7b-41bd-b98a-2a272dd4090f"
Jul 14 19:11:30.962392 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:11:30.962141    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lkbtz"
Jul 14 19:11:30.962392 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:11:30.962240    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lkbtz" podUID="8a7994c4-4dcd-4b18-a6f3-580eda35a3d9"
Jul 14 19:11:31.246653 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:11:31.246593    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-23.ec2.internal" event="NodeReady"
Jul 14 19:11:31.246751 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:11:31.246681    2565 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 14 19:11:31.290535 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:11:31.290511    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-g85df"]
Jul 14 19:11:31.292232 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:11:31.292217    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-g85df"
Jul 14 19:11:31.294958 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:11:31.294941    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-h5x4l\""
Jul 14 19:11:31.295393 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:11:31.295375    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 14 19:11:31.295440 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:11:31.295379    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 14 19:11:31.299763 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:11:31.299743    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-ttnqj"]
Jul 14 19:11:31.301289 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:11:31.301266    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-ttnqj"
Jul 14 19:11:31.303592 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:11:31.303571    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 14 19:11:31.304427 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:11:31.304377    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-cxj8f\""
Jul 14 19:11:31.304427 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:11:31.304405    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 14 19:11:31.304729 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:11:31.304711    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 14 19:11:31.305391 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:11:31.305375    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-g85df"]
Jul 14 19:11:31.313237 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:11:31.313217    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-ttnqj"]
Jul 14 19:11:31.444927 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:11:31.444897    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/648852a8-be96-4782-bfdc-76bdce2ab8b5-config-volume\") pod \"dns-default-g85df\" (UID: \"648852a8-be96-4782-bfdc-76bdce2ab8b5\") " pod="openshift-dns/dns-default-g85df"
Jul 14 19:11:31.445022 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:11:31.444951    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/648852a8-be96-4782-bfdc-76bdce2ab8b5-metrics-tls\") pod \"dns-default-g85df\" (UID: \"648852a8-be96-4782-bfdc-76bdce2ab8b5\") " pod="openshift-dns/dns-default-g85df"
Jul 14 19:11:31.445022 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:11:31.444972    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/648852a8-be96-4782-bfdc-76bdce2ab8b5-tmp-dir\") pod \"dns-default-g85df\" (UID: \"648852a8-be96-4782-bfdc-76bdce2ab8b5\") " pod="openshift-dns/dns-default-g85df"
Jul 14 19:11:31.445022 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:11:31.444999    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-59mgg\" (UniqueName: \"kubernetes.io/projected/49093e63-d7ef-4c83-9c07-a96fd79d02f7-kube-api-access-59mgg\") pod \"ingress-canary-ttnqj\" (UID: \"49093e63-d7ef-4c83-9c07-a96fd79d02f7\") " pod="openshift-ingress-canary/ingress-canary-ttnqj"
Jul 14 19:11:31.445146 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:11:31.445028    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gbhtw\" (UniqueName: \"kubernetes.io/projected/648852a8-be96-4782-bfdc-76bdce2ab8b5-kube-api-access-gbhtw\") pod \"dns-default-g85df\" (UID: \"648852a8-be96-4782-bfdc-76bdce2ab8b5\") " pod="openshift-dns/dns-default-g85df"
Jul 14 19:11:31.445146 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:11:31.445043    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/49093e63-d7ef-4c83-9c07-a96fd79d02f7-cert\") pod \"ingress-canary-ttnqj\" (UID: \"49093e63-d7ef-4c83-9c07-a96fd79d02f7\") " pod="openshift-ingress-canary/ingress-canary-ttnqj"
Jul 14 19:11:31.546248 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:11:31.546201    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/648852a8-be96-4782-bfdc-76bdce2ab8b5-config-volume\") pod \"dns-default-g85df\" (UID: \"648852a8-be96-4782-bfdc-76bdce2ab8b5\") " pod="openshift-dns/dns-default-g85df"
Jul 14 19:11:31.546248 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:11:31.546236    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/648852a8-be96-4782-bfdc-76bdce2ab8b5-metrics-tls\") pod \"dns-default-g85df\" (UID: \"648852a8-be96-4782-bfdc-76bdce2ab8b5\") " pod="openshift-dns/dns-default-g85df"
Jul 14 19:11:31.546248 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:11:31.546255    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/648852a8-be96-4782-bfdc-76bdce2ab8b5-tmp-dir\") pod \"dns-default-g85df\" (UID: \"648852a8-be96-4782-bfdc-76bdce2ab8b5\") " pod="openshift-dns/dns-default-g85df"
Jul 14 19:11:31.546416 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:11:31.546274    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-59mgg\" (UniqueName: \"kubernetes.io/projected/49093e63-d7ef-4c83-9c07-a96fd79d02f7-kube-api-access-59mgg\") pod \"ingress-canary-ttnqj\" (UID: \"49093e63-d7ef-4c83-9c07-a96fd79d02f7\") " pod="openshift-ingress-canary/ingress-canary-ttnqj"
Jul 14 19:11:31.546416 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:11:31.546300    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gbhtw\" (UniqueName: \"kubernetes.io/projected/648852a8-be96-4782-bfdc-76bdce2ab8b5-kube-api-access-gbhtw\") pod \"dns-default-g85df\" (UID: \"648852a8-be96-4782-bfdc-76bdce2ab8b5\") " pod="openshift-dns/dns-default-g85df"
Jul 14 19:11:31.546416 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:11:31.546320    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/49093e63-d7ef-4c83-9c07-a96fd79d02f7-cert\") pod \"ingress-canary-ttnqj\" (UID: \"49093e63-d7ef-4c83-9c07-a96fd79d02f7\") " pod="openshift-ingress-canary/ingress-canary-ttnqj"
Jul 14 19:11:31.546416 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:11:31.546363    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 14 19:11:31.546549 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:11:31.546426    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/648852a8-be96-4782-bfdc-76bdce2ab8b5-metrics-tls podName:648852a8-be96-4782-bfdc-76bdce2ab8b5 nodeName:}" failed. No retries permitted until 2026-07-14 19:11:32.046407533 +0000 UTC m=+38.607264416 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/648852a8-be96-4782-bfdc-76bdce2ab8b5-metrics-tls") pod "dns-default-g85df" (UID: "648852a8-be96-4782-bfdc-76bdce2ab8b5") : secret "dns-default-metrics-tls" not found
Jul 14 19:11:31.546634 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:11:31.546613    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/648852a8-be96-4782-bfdc-76bdce2ab8b5-tmp-dir\") pod \"dns-default-g85df\" (UID: \"648852a8-be96-4782-bfdc-76bdce2ab8b5\") " pod="openshift-dns/dns-default-g85df"
Jul 14 19:11:31.549663 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:11:31.547075    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/648852a8-be96-4782-bfdc-76bdce2ab8b5-config-volume\") pod \"dns-default-g85df\" (UID: \"648852a8-be96-4782-bfdc-76bdce2ab8b5\") " pod="openshift-dns/dns-default-g85df"
Jul 14 19:11:31.553002 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:11:31.552869    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/49093e63-d7ef-4c83-9c07-a96fd79d02f7-cert\") pod \"ingress-canary-ttnqj\" (UID: \"49093e63-d7ef-4c83-9c07-a96fd79d02f7\") " pod="openshift-ingress-canary/ingress-canary-ttnqj"
Jul 14 19:11:31.554724 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:11:31.554708    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-59mgg\" (UniqueName: \"kubernetes.io/projected/49093e63-d7ef-4c83-9c07-a96fd79d02f7-kube-api-access-59mgg\") pod \"ingress-canary-ttnqj\" (UID: \"49093e63-d7ef-4c83-9c07-a96fd79d02f7\") " pod="openshift-ingress-canary/ingress-canary-ttnqj"
Jul 14 19:11:31.554814 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:11:31.554793    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gbhtw\" (UniqueName: \"kubernetes.io/projected/648852a8-be96-4782-bfdc-76bdce2ab8b5-kube-api-access-gbhtw\") pod \"dns-default-g85df\" (UID: \"648852a8-be96-4782-bfdc-76bdce2ab8b5\") " pod="openshift-dns/dns-default-g85df"
Jul 14 19:11:31.609977 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:11:31.609955    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-ttnqj"
Jul 14 19:11:31.746076 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:11:31.746048    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-ttnqj"]
Jul 14 19:11:31.749972 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:11:31.749950    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49093e63_d7ef_4c83_9c07_a96fd79d02f7.slice/crio-702fc08388ce940876267196c89433d8f7a700da6e6033e3fc8a953c1234ae03 WatchSource:0}: Error finding container 702fc08388ce940876267196c89433d8f7a700da6e6033e3fc8a953c1234ae03: Status 404 returned error can't find the container with id 702fc08388ce940876267196c89433d8f7a700da6e6033e3fc8a953c1234ae03
Jul 14 19:11:31.961854 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:11:31.961782    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xxs8n"
Jul 14 19:11:31.964455 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:11:31.964433    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 14 19:11:31.964812 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:11:31.964477    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-jwrqs\""
Jul 14 19:11:31.965374 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:11:31.965356    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 14 19:11:32.049864 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:11:32.049836    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/648852a8-be96-4782-bfdc-76bdce2ab8b5-metrics-tls\") pod \"dns-default-g85df\" (UID: \"648852a8-be96-4782-bfdc-76bdce2ab8b5\") " pod="openshift-dns/dns-default-g85df"
Jul 14 19:11:32.049972 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:11:32.049952    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 14 19:11:32.050029 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:11:32.050001    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/648852a8-be96-4782-bfdc-76bdce2ab8b5-metrics-tls podName:648852a8-be96-4782-bfdc-76bdce2ab8b5 nodeName:}" failed. No retries permitted until 2026-07-14 19:11:33.049987453 +0000 UTC m=+39.610844322 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/648852a8-be96-4782-bfdc-76bdce2ab8b5-metrics-tls") pod "dns-default-g85df" (UID: "648852a8-be96-4782-bfdc-76bdce2ab8b5") : secret "dns-default-metrics-tls" not found
Jul 14 19:11:32.130923 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:11:32.130894    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-ttnqj" event={"ID":"49093e63-d7ef-4c83-9c07-a96fd79d02f7","Type":"ContainerStarted","Data":"702fc08388ce940876267196c89433d8f7a700da6e6033e3fc8a953c1234ae03"}
Jul 14 19:11:32.962543 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:11:32.962513    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lkbtz"
Jul 14 19:11:32.962725 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:11:32.962703    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hbbrx"
Jul 14 19:11:32.965316 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:11:32.965296    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 14 19:11:32.966206 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:11:32.966183    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 14 19:11:32.966296 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:11:32.966187    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-xxpfz\""
Jul 14 19:11:33.056739 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:11:33.056715    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/648852a8-be96-4782-bfdc-76bdce2ab8b5-metrics-tls\") pod \"dns-default-g85df\" (UID: \"648852a8-be96-4782-bfdc-76bdce2ab8b5\") " pod="openshift-dns/dns-default-g85df"
Jul 14 19:11:33.056845 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:11:33.056828    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 14 19:11:33.056904 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:11:33.056893    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/648852a8-be96-4782-bfdc-76bdce2ab8b5-metrics-tls podName:648852a8-be96-4782-bfdc-76bdce2ab8b5 nodeName:}" failed. No retries permitted until 2026-07-14 19:11:35.05688007 +0000 UTC m=+41.617736940 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/648852a8-be96-4782-bfdc-76bdce2ab8b5-metrics-tls") pod "dns-default-g85df" (UID: "648852a8-be96-4782-bfdc-76bdce2ab8b5") : secret "dns-default-metrics-tls" not found
Jul 14 19:11:35.072497 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:11:35.072325    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/648852a8-be96-4782-bfdc-76bdce2ab8b5-metrics-tls\") pod \"dns-default-g85df\" (UID: \"648852a8-be96-4782-bfdc-76bdce2ab8b5\") " pod="openshift-dns/dns-default-g85df"
Jul 14 19:11:35.072497 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:11:35.072484    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 14 19:11:35.072962 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:11:35.072551    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/648852a8-be96-4782-bfdc-76bdce2ab8b5-metrics-tls podName:648852a8-be96-4782-bfdc-76bdce2ab8b5 nodeName:}" failed. No retries permitted until 2026-07-14 19:11:39.072535198 +0000 UTC m=+45.633392068 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/648852a8-be96-4782-bfdc-76bdce2ab8b5-metrics-tls") pod "dns-default-g85df" (UID: "648852a8-be96-4782-bfdc-76bdce2ab8b5") : secret "dns-default-metrics-tls" not found
Jul 14 19:11:35.142345 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:11:35.142317    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-ttnqj" event={"ID":"49093e63-d7ef-4c83-9c07-a96fd79d02f7","Type":"ContainerStarted","Data":"17615fba3758ed401f630a4fd15e46b9ba8bc79f00473f58b75fe4b4d317ff61"}
Jul 14 19:11:35.158521 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:11:35.158482    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-ttnqj" podStartSLOduration=1.406519146 podStartE2EDuration="4.15847022s" totalImagesPullingTime="2.751951074s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 19:11:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:11:35.158068966 +0000 UTC m=+41.718925870" watchObservedRunningTime="2026-07-14 19:11:35.15847022 +0000 UTC m=+41.719327112"
Jul 14 19:11:39.099131 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:11:39.099023    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/648852a8-be96-4782-bfdc-76bdce2ab8b5-metrics-tls\") pod \"dns-default-g85df\" (UID: \"648852a8-be96-4782-bfdc-76bdce2ab8b5\") " pod="openshift-dns/dns-default-g85df"
Jul 14 19:11:39.099131 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:11:39.099119    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 14 19:11:39.099653 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:11:39.099205    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/648852a8-be96-4782-bfdc-76bdce2ab8b5-metrics-tls podName:648852a8-be96-4782-bfdc-76bdce2ab8b5 nodeName:}" failed. No retries permitted until 2026-07-14 19:11:47.099189489 +0000 UTC m=+53.660046377 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/648852a8-be96-4782-bfdc-76bdce2ab8b5-metrics-tls") pod "dns-default-g85df" (UID: "648852a8-be96-4782-bfdc-76bdce2ab8b5") : secret "dns-default-metrics-tls" not found
Jul 14 19:11:47.152110 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:11:47.152069    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/648852a8-be96-4782-bfdc-76bdce2ab8b5-metrics-tls\") pod \"dns-default-g85df\" (UID: \"648852a8-be96-4782-bfdc-76bdce2ab8b5\") " pod="openshift-dns/dns-default-g85df"
Jul 14 19:11:47.152594 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:11:47.152241    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 14 19:11:47.152594 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:11:47.152312    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/648852a8-be96-4782-bfdc-76bdce2ab8b5-metrics-tls podName:648852a8-be96-4782-bfdc-76bdce2ab8b5 nodeName:}" failed. No retries permitted until 2026-07-14 19:12:03.152294712 +0000 UTC m=+69.713151581 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/648852a8-be96-4782-bfdc-76bdce2ab8b5-metrics-tls") pod "dns-default-g85df" (UID: "648852a8-be96-4782-bfdc-76bdce2ab8b5") : secret "dns-default-metrics-tls" not found
Jul 14 19:11:57.123998 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:11:57.123964    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-cqqv8"
Jul 14 19:11:59.530492 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:11:59.530443    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a2ef2d8f-5f7b-41bd-b98a-2a272dd4090f-metrics-certs\") pod \"network-metrics-daemon-hbbrx\" (UID: \"a2ef2d8f-5f7b-41bd-b98a-2a272dd4090f\") " pod="openshift-multus/network-metrics-daemon-hbbrx"
Jul 14 19:11:59.533139 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:11:59.533120    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 14 19:11:59.541139 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:11:59.541125    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 14 19:11:59.541527 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:11:59.541504    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a2ef2d8f-5f7b-41bd-b98a-2a272dd4090f-metrics-certs podName:a2ef2d8f-5f7b-41bd-b98a-2a272dd4090f nodeName:}" failed. No retries permitted until 2026-07-14 19:13:03.541480584 +0000 UTC m=+130.102337782 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a2ef2d8f-5f7b-41bd-b98a-2a272dd4090f-metrics-certs") pod "network-metrics-daemon-hbbrx" (UID: "a2ef2d8f-5f7b-41bd-b98a-2a272dd4090f") : secret "metrics-daemon-secret" not found
Jul 14 19:11:59.630909 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:11:59.630870    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8a7994c4-4dcd-4b18-a6f3-580eda35a3d9-original-pull-secret\") pod \"global-pull-secret-syncer-lkbtz\" (UID: \"8a7994c4-4dcd-4b18-a6f3-580eda35a3d9\") " pod="kube-system/global-pull-secret-syncer-lkbtz"
Jul 14 19:11:59.631016 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:11:59.630968    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k77pn\" (UniqueName: \"kubernetes.io/projected/490a903e-0b54-40ef-82f2-4175faef060f-kube-api-access-k77pn\") pod \"network-check-target-xxs8n\" (UID: \"490a903e-0b54-40ef-82f2-4175faef060f\") " pod="openshift-network-diagnostics/network-check-target-xxs8n"
Jul 14 19:11:59.633912 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:11:59.633895    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 14 19:11:59.633958 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:11:59.633930    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 14 19:11:59.644169 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:11:59.644135    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 14 19:11:59.645706 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:11:59.645684    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8a7994c4-4dcd-4b18-a6f3-580eda35a3d9-original-pull-secret\") pod \"global-pull-secret-syncer-lkbtz\" (UID: \"8a7994c4-4dcd-4b18-a6f3-580eda35a3d9\") " pod="kube-system/global-pull-secret-syncer-lkbtz"
Jul 14 19:11:59.654583 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:11:59.654564    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k77pn\" (UniqueName: \"kubernetes.io/projected/490a903e-0b54-40ef-82f2-4175faef060f-kube-api-access-k77pn\") pod \"network-check-target-xxs8n\" (UID: \"490a903e-0b54-40ef-82f2-4175faef060f\") " pod="openshift-network-diagnostics/network-check-target-xxs8n"
Jul 14 19:11:59.675505 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:11:59.675482    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lkbtz"
Jul 14 19:11:59.795509 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:11:59.795451    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-lkbtz"]
Jul 14 19:11:59.798643 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:11:59.798616    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a7994c4_4dcd_4b18_a6f3_580eda35a3d9.slice/crio-75a13d432cb61d4665a0168c98bde5e0fd747ab269100f176b378c6ba7243d25 WatchSource:0}: Error finding container 75a13d432cb61d4665a0168c98bde5e0fd747ab269100f176b378c6ba7243d25: Status 404 returned error can't find the container with id 75a13d432cb61d4665a0168c98bde5e0fd747ab269100f176b378c6ba7243d25
Jul 14 19:11:59.873628 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:11:59.873605    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-jwrqs\""
Jul 14 19:11:59.881631 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:11:59.881613    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xxs8n"
Jul 14 19:11:59.996889 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:11:59.996864    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-xxs8n"]
Jul 14 19:12:00.000242 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:12:00.000211    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod490a903e_0b54_40ef_82f2_4175faef060f.slice/crio-57a7874742a7cf63862459abffa34d5b8cffa6f96ea98846c4c48a988e172da2 WatchSource:0}: Error finding container 57a7874742a7cf63862459abffa34d5b8cffa6f96ea98846c4c48a988e172da2: Status 404 returned error can't find the container with id 57a7874742a7cf63862459abffa34d5b8cffa6f96ea98846c4c48a988e172da2
Jul 14 19:12:00.198666 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:12:00.198580    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-xxs8n" event={"ID":"490a903e-0b54-40ef-82f2-4175faef060f","Type":"ContainerStarted","Data":"57a7874742a7cf63862459abffa34d5b8cffa6f96ea98846c4c48a988e172da2"}
Jul 14 19:12:00.199598 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:12:00.199576    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-lkbtz" event={"ID":"8a7994c4-4dcd-4b18-a6f3-580eda35a3d9","Type":"ContainerStarted","Data":"75a13d432cb61d4665a0168c98bde5e0fd747ab269100f176b378c6ba7243d25"}
Jul 14 19:12:03.152688 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:12:03.152648    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/648852a8-be96-4782-bfdc-76bdce2ab8b5-metrics-tls\") pod \"dns-default-g85df\" (UID: \"648852a8-be96-4782-bfdc-76bdce2ab8b5\") " pod="openshift-dns/dns-default-g85df"
Jul 14 19:12:03.153267 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:12:03.152830    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 14 19:12:03.153267 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:12:03.152918    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/648852a8-be96-4782-bfdc-76bdce2ab8b5-metrics-tls podName:648852a8-be96-4782-bfdc-76bdce2ab8b5 nodeName:}" failed. No retries permitted until 2026-07-14 19:12:35.152896197 +0000 UTC m=+101.713753086 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/648852a8-be96-4782-bfdc-76bdce2ab8b5-metrics-tls") pod "dns-default-g85df" (UID: "648852a8-be96-4782-bfdc-76bdce2ab8b5") : secret "dns-default-metrics-tls" not found
Jul 14 19:12:05.214579 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:12:05.214538    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-xxs8n" event={"ID":"490a903e-0b54-40ef-82f2-4175faef060f","Type":"ContainerStarted","Data":"86f8d406e447569038b143505946ae2de9c3b3ecb0750fb23aca5c0779994aa6"}
Jul 14 19:12:05.215003 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:12:05.214694    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-xxs8n"
Jul 14 19:12:05.216063 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:12:05.216034    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-lkbtz" event={"ID":"8a7994c4-4dcd-4b18-a6f3-580eda35a3d9","Type":"ContainerStarted","Data":"36706927d803a9534d2c0633545403465717f5fab0a9c1aa669bae6f9e5dace5"}
Jul 14 19:12:05.245985 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:12:05.245949    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-xxs8n" podStartSLOduration=67.600083835 podStartE2EDuration="1m12.245935454s" totalImagesPullingTime="4.645851619s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 19:10:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:12:05.230812085 +0000 UTC m=+71.791669003" watchObservedRunningTime="2026-07-14 19:12:05.245935454 +0000 UTC m=+71.806792348"
Jul 14 19:12:05.246092 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:12:05.246049    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-lkbtz" podStartSLOduration=66.395127401 podStartE2EDuration="1m11.246044085s" totalImagesPullingTime="4.850916684s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 19:10:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:12:05.245743876 +0000 UTC m=+71.806600769" watchObservedRunningTime="2026-07-14 19:12:05.246044085 +0000 UTC m=+71.806900973"
Jul 14 19:12:35.153413 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:12:35.153375    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/648852a8-be96-4782-bfdc-76bdce2ab8b5-metrics-tls\") pod \"dns-default-g85df\" (UID: \"648852a8-be96-4782-bfdc-76bdce2ab8b5\") " pod="openshift-dns/dns-default-g85df"
Jul 14 19:12:35.153781 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:12:35.153516    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 14 19:12:35.153781 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:12:35.153570    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/648852a8-be96-4782-bfdc-76bdce2ab8b5-metrics-tls podName:648852a8-be96-4782-bfdc-76bdce2ab8b5 nodeName:}" failed. No retries permitted until 2026-07-14 19:13:39.153556732 +0000 UTC m=+165.714413601 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/648852a8-be96-4782-bfdc-76bdce2ab8b5-metrics-tls") pod "dns-default-g85df" (UID: "648852a8-be96-4782-bfdc-76bdce2ab8b5") : secret "dns-default-metrics-tls" not found
Jul 14 19:12:36.220621 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:12:36.220591    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-xxs8n"
Jul 14 19:13:03.632042 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:13:03.632001    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a2ef2d8f-5f7b-41bd-b98a-2a272dd4090f-metrics-certs\") pod \"network-metrics-daemon-hbbrx\" (UID: \"a2ef2d8f-5f7b-41bd-b98a-2a272dd4090f\") " pod="openshift-multus/network-metrics-daemon-hbbrx"
Jul 14 19:13:03.632514 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:13:03.632118    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 14 19:13:03.632514 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:13:03.632217    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a2ef2d8f-5f7b-41bd-b98a-2a272dd4090f-metrics-certs podName:a2ef2d8f-5f7b-41bd-b98a-2a272dd4090f nodeName:}" failed. No retries permitted until 2026-07-14 19:15:05.632199304 +0000 UTC m=+252.193056193 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a2ef2d8f-5f7b-41bd-b98a-2a272dd4090f-metrics-certs") pod "network-metrics-daemon-hbbrx" (UID: "a2ef2d8f-5f7b-41bd-b98a-2a272dd4090f") : secret "metrics-daemon-secret" not found
Jul 14 19:13:34.301456 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:13:34.301398    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-g85df" podUID="648852a8-be96-4782-bfdc-76bdce2ab8b5"
Jul 14 19:13:34.419029 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:13:34.418995    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-g85df"
Jul 14 19:13:35.980142 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:13:35.980106    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-hbbrx" podUID="a2ef2d8f-5f7b-41bd-b98a-2a272dd4090f"
Jul 14 19:13:39.171334 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:13:39.171296    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/648852a8-be96-4782-bfdc-76bdce2ab8b5-metrics-tls\") pod \"dns-default-g85df\" (UID: \"648852a8-be96-4782-bfdc-76bdce2ab8b5\") " pod="openshift-dns/dns-default-g85df"
Jul 14 19:13:39.171685 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:13:39.171393    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 14 19:13:39.171685 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:13:39.171443    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/648852a8-be96-4782-bfdc-76bdce2ab8b5-metrics-tls podName:648852a8-be96-4782-bfdc-76bdce2ab8b5 nodeName:}" failed. No retries permitted until 2026-07-14 19:15:41.171430086 +0000 UTC m=+287.732286956 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/648852a8-be96-4782-bfdc-76bdce2ab8b5-metrics-tls") pod "dns-default-g85df" (UID: "648852a8-be96-4782-bfdc-76bdce2ab8b5") : secret "dns-default-metrics-tls" not found
Jul 14 19:13:47.962592 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:13:47.962512    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hbbrx"
Jul 14 19:14:51.475997 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:14:51.475962    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-9qq8x"]
Jul 14 19:14:51.477713 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:14:51.477690    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-9qq8x"
Jul 14 19:14:51.479372 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:14:51.479352    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-h9qkx"]
Jul 14 19:14:51.481167 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:14:51.481132    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-h9qkx"
Jul 14 19:14:51.481849 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:14:51.481829    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-rdntc\""
Jul 14 19:14:51.482527 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:14:51.482508    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-d858f7db9-cnzfq"]
Jul 14 19:14:51.482670 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:14:51.482652    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Jul 14 19:14:51.482740 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:14:51.482656    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Jul 14 19:14:51.484011 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:14:51.483993    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Jul 14 19:14:51.484272 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:14:51.484257    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-d858f7db9-cnzfq"
Jul 14 19:14:51.484781 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:14:51.484764    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Jul 14 19:14:51.484869 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:14:51.484793    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-stgfm\""
Jul 14 19:14:51.487691 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:14:51.487674    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 14 19:14:51.488144 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:14:51.488039    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 14 19:14:51.488428 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:14:51.488409    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-plsql\""
Jul 14 19:14:51.489484 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:14:51.489468    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 14 19:14:51.489598 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:14:51.489496    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Jul 14 19:14:51.493660 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:14:51.493640    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-9qq8x"]
Jul 14 19:14:51.494924 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:14:51.494865    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 14 19:14:51.502463 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:14:51.502442    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-h9qkx"]
Jul 14 19:14:51.507810 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:14:51.507791    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-d858f7db9-cnzfq"]
Jul 14 19:14:51.545119 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:14:51.545094    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/26b54c88-015d-4e69-b66f-20b0c13a9f99-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-h9qkx\" (UID: \"26b54c88-015d-4e69-b66f-20b0c13a9f99\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-h9qkx"
Jul 14 19:14:51.545119 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:14:51.545119    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4c01c8da-c276-4b74-8f64-16bdc3e0237a-installation-pull-secrets\") pod \"image-registry-d858f7db9-cnzfq\" (UID: \"4c01c8da-c276-4b74-8f64-16bdc3e0237a\") " pod="openshift-image-registry/image-registry-d858f7db9-cnzfq"
Jul 14 19:14:51.545259 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:14:51.545139    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4c01c8da-c276-4b74-8f64-16bdc3e0237a-trusted-ca\") pod \"image-registry-d858f7db9-cnzfq\" (UID: \"4c01c8da-c276-4b74-8f64-16bdc3e0237a\") " pod="openshift-image-registry/image-registry-d858f7db9-cnzfq"
Jul 14 19:14:51.545259 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:14:51.545170    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l9tf2\" (UniqueName: \"kubernetes.io/projected/26b54c88-015d-4e69-b66f-20b0c13a9f99-kube-api-access-l9tf2\") pod \"cluster-samples-operator-65db858894-h9qkx\" (UID: \"26b54c88-015d-4e69-b66f-20b0c13a9f99\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-h9qkx"
Jul 14 19:14:51.545259 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:14:51.545195    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4c01c8da-c276-4b74-8f64-16bdc3e0237a-bound-sa-token\") pod \"image-registry-d858f7db9-cnzfq\" (UID: \"4c01c8da-c276-4b74-8f64-16bdc3e0237a\") " pod="openshift-image-registry/image-registry-d858f7db9-cnzfq"
Jul 14 19:14:51.545361 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:14:51.545247    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cns82\" (UniqueName: \"kubernetes.io/projected/1ec54941-8411-4559-97ba-84a7de6529fc-kube-api-access-cns82\") pod \"volume-data-source-validator-78495597f6-9qq8x\" (UID: \"1ec54941-8411-4559-97ba-84a7de6529fc\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-9qq8x"
Jul 14 19:14:51.545361 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:14:51.545277    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4c01c8da-c276-4b74-8f64-16bdc3e0237a-ca-trust-extracted\") pod \"image-registry-d858f7db9-cnzfq\" (UID: \"4c01c8da-c276-4b74-8f64-16bdc3e0237a\") " pod="openshift-image-registry/image-registry-d858f7db9-cnzfq"
Jul 14 19:14:51.545361 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:14:51.545294    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4c01c8da-c276-4b74-8f64-16bdc3e0237a-registry-tls\") pod \"image-registry-d858f7db9-cnzfq\" (UID: \"4c01c8da-c276-4b74-8f64-16bdc3e0237a\") " pod="openshift-image-registry/image-registry-d858f7db9-cnzfq"
Jul 14 19:14:51.545361 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:14:51.545315    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8g4r4\" (UniqueName: \"kubernetes.io/projected/4c01c8da-c276-4b74-8f64-16bdc3e0237a-kube-api-access-8g4r4\") pod \"image-registry-d858f7db9-cnzfq\" (UID: \"4c01c8da-c276-4b74-8f64-16bdc3e0237a\") " pod="openshift-image-registry/image-registry-d858f7db9-cnzfq"
Jul 14 19:14:51.545478 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:14:51.545401    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4c01c8da-c276-4b74-8f64-16bdc3e0237a-registry-certificates\") pod \"image-registry-d858f7db9-cnzfq\" (UID: \"4c01c8da-c276-4b74-8f64-16bdc3e0237a\") " pod="openshift-image-registry/image-registry-d858f7db9-cnzfq"
Jul 14 19:14:51.545478 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:14:51.545440    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4c01c8da-c276-4b74-8f64-16bdc3e0237a-image-registry-private-configuration\") pod \"image-registry-d858f7db9-cnzfq\" (UID: \"4c01c8da-c276-4b74-8f64-16bdc3e0237a\") " pod="openshift-image-registry/image-registry-d858f7db9-cnzfq"
Jul 14 19:14:51.575350 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:14:51.575330    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-9bkzn"]
Jul 14 19:14:51.576885 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:14:51.576872    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cf856758c-9bkzn"
Jul 14 19:14:51.581043 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:14:51.581027    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Jul 14 19:14:51.581110 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:14:51.581073    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Jul 14 19:14:51.581183 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:14:51.581147    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-mq7g2\""
Jul 14 19:14:51.594783 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:14:51.594763    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-9bkzn"]
Jul 14 19:14:51.646048 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:14:51.646023    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4c01c8da-c276-4b74-8f64-16bdc3e0237a-registry-certificates\") pod \"image-registry-d858f7db9-cnzfq\" (UID: \"4c01c8da-c276-4b74-8f64-16bdc3e0237a\") " pod="openshift-image-registry/image-registry-d858f7db9-cnzfq"
Jul 14 19:14:51.646174 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:14:51.646062    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4c01c8da-c276-4b74-8f64-16bdc3e0237a-image-registry-private-configuration\") pod \"image-registry-d858f7db9-cnzfq\" (UID: \"4c01c8da-c276-4b74-8f64-16bdc3e0237a\") " pod="openshift-image-registry/image-registry-d858f7db9-cnzfq"
Jul 14 19:14:51.646174 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:14:51.646082    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/26b54c88-015d-4e69-b66f-20b0c13a9f99-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-h9qkx\" (UID: \"26b54c88-015d-4e69-b66f-20b0c13a9f99\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-h9qkx"
Jul 14 19:14:51.646174 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:14:51.646097    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4c01c8da-c276-4b74-8f64-16bdc3e0237a-installation-pull-secrets\") pod \"image-registry-d858f7db9-cnzfq\" (UID: \"4c01c8da-c276-4b74-8f64-16bdc3e0237a\") " pod="openshift-image-registry/image-registry-d858f7db9-cnzfq"
Jul 14 19:14:51.646174 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:14:51.646123    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4c01c8da-c276-4b74-8f64-16bdc3e0237a-trusted-ca\") pod \"image-registry-d858f7db9-cnzfq\" (UID: \"4c01c8da-c276-4b74-8f64-16bdc3e0237a\") " pod="openshift-image-registry/image-registry-d858f7db9-cnzfq"
Jul 14 19:14:51.646388 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:14:51.646179    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l9tf2\" (UniqueName: \"kubernetes.io/projected/26b54c88-015d-4e69-b66f-20b0c13a9f99-kube-api-access-l9tf2\") pod \"cluster-samples-operator-65db858894-h9qkx\" (UID: \"26b54c88-015d-4e69-b66f-20b0c13a9f99\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-h9qkx"
Jul 14 19:14:51.646388 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:14:51.646203    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4c01c8da-c276-4b74-8f64-16bdc3e0237a-bound-sa-token\") pod \"image-registry-d858f7db9-cnzfq\" (UID: \"4c01c8da-c276-4b74-8f64-16bdc3e0237a\") " pod="openshift-image-registry/image-registry-d858f7db9-cnzfq"
Jul 14 19:14:51.646388 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:14:51.646214    2565 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 14 19:14:51.646388 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:14:51.646232    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/13fae2a1-59f5-4880-8045-12b6ce931d3f-nginx-conf\") pod \"networking-console-plugin-6cf856758c-9bkzn\" (UID: \"13fae2a1-59f5-4880-8045-12b6ce931d3f\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-9bkzn"
Jul 14 19:14:51.646388 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:14:51.646263    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cns82\" (UniqueName: \"kubernetes.io/projected/1ec54941-8411-4559-97ba-84a7de6529fc-kube-api-access-cns82\") pod \"volume-data-source-validator-78495597f6-9qq8x\" (UID: \"1ec54941-8411-4559-97ba-84a7de6529fc\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-9qq8x"
Jul 14 19:14:51.646388 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:14:51.646281    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/26b54c88-015d-4e69-b66f-20b0c13a9f99-samples-operator-tls podName:26b54c88-015d-4e69-b66f-20b0c13a9f99 nodeName:}" failed. No retries permitted until 2026-07-14 19:14:52.146263824 +0000 UTC m=+238.707120699 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/26b54c88-015d-4e69-b66f-20b0c13a9f99-samples-operator-tls") pod "cluster-samples-operator-65db858894-h9qkx" (UID: "26b54c88-015d-4e69-b66f-20b0c13a9f99") : secret "samples-operator-tls" not found
Jul 14 19:14:51.646388 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:14:51.646307    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4c01c8da-c276-4b74-8f64-16bdc3e0237a-ca-trust-extracted\") pod \"image-registry-d858f7db9-cnzfq\" (UID: \"4c01c8da-c276-4b74-8f64-16bdc3e0237a\") " pod="openshift-image-registry/image-registry-d858f7db9-cnzfq"
Jul 14 19:14:51.646388 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:14:51.646335    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4c01c8da-c276-4b74-8f64-16bdc3e0237a-registry-tls\") pod \"image-registry-d858f7db9-cnzfq\" (UID: \"4c01c8da-c276-4b74-8f64-16bdc3e0237a\") " pod="openshift-image-registry/image-registry-d858f7db9-cnzfq"
Jul 14 19:14:51.646388 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:14:51.646356    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8g4r4\" (UniqueName: \"kubernetes.io/projected/4c01c8da-c276-4b74-8f64-16bdc3e0237a-kube-api-access-8g4r4\") pod \"image-registry-d858f7db9-cnzfq\" (UID: \"4c01c8da-c276-4b74-8f64-16bdc3e0237a\") " pod="openshift-image-registry/image-registry-d858f7db9-cnzfq"
Jul 14 19:14:51.646388 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:14:51.646386    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/13fae2a1-59f5-4880-8045-12b6ce931d3f-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-9bkzn\" (UID: \"13fae2a1-59f5-4880-8045-12b6ce931d3f\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-9bkzn"
Jul 14 19:14:51.647030 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:14:51.646551    2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 14 19:14:51.647030 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:14:51.646588    2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-d858f7db9-cnzfq: secret "image-registry-tls" not found
Jul 14 19:14:51.647030 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:14:51.646624    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4c01c8da-c276-4b74-8f64-16bdc3e0237a-registry-certificates\") pod \"image-registry-d858f7db9-cnzfq\" (UID: \"4c01c8da-c276-4b74-8f64-16bdc3e0237a\") " pod="openshift-image-registry/image-registry-d858f7db9-cnzfq"
Jul 14 19:14:51.647030 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:14:51.646702    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4c01c8da-c276-4b74-8f64-16bdc3e0237a-registry-tls podName:4c01c8da-c276-4b74-8f64-16bdc3e0237a nodeName:}" failed. No retries permitted until 2026-07-14 19:14:52.146683379 +0000 UTC m=+238.707540262 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4c01c8da-c276-4b74-8f64-16bdc3e0237a-registry-tls") pod "image-registry-d858f7db9-cnzfq" (UID: "4c01c8da-c276-4b74-8f64-16bdc3e0237a") : secret "image-registry-tls" not found
Jul 14 19:14:51.647030 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:14:51.646945    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4c01c8da-c276-4b74-8f64-16bdc3e0237a-ca-trust-extracted\") pod \"image-registry-d858f7db9-cnzfq\" (UID: \"4c01c8da-c276-4b74-8f64-16bdc3e0237a\") " pod="openshift-image-registry/image-registry-d858f7db9-cnzfq"
Jul 14 19:14:51.647400 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:14:51.647377    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4c01c8da-c276-4b74-8f64-16bdc3e0237a-trusted-ca\") pod \"image-registry-d858f7db9-cnzfq\" (UID: \"4c01c8da-c276-4b74-8f64-16bdc3e0237a\") " pod="openshift-image-registry/image-registry-d858f7db9-cnzfq"
Jul 14 19:14:51.648740 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:14:51.648722    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4c01c8da-c276-4b74-8f64-16bdc3e0237a-installation-pull-secrets\") pod \"image-registry-d858f7db9-cnzfq\" (UID: \"4c01c8da-c276-4b74-8f64-16bdc3e0237a\") " pod="openshift-image-registry/image-registry-d858f7db9-cnzfq"
Jul 14 19:14:51.648815 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:14:51.648753    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4c01c8da-c276-4b74-8f64-16bdc3e0237a-image-registry-private-configuration\") pod \"image-registry-d858f7db9-cnzfq\" (UID: \"4c01c8da-c276-4b74-8f64-16bdc3e0237a\") " pod="openshift-image-registry/image-registry-d858f7db9-cnzfq"
Jul 14 19:14:51.655529 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:14:51.655495    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cns82\" (UniqueName: \"kubernetes.io/projected/1ec54941-8411-4559-97ba-84a7de6529fc-kube-api-access-cns82\") pod \"volume-data-source-validator-78495597f6-9qq8x\" (UID: \"1ec54941-8411-4559-97ba-84a7de6529fc\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-9qq8x"
Jul 14 19:14:51.655624 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:14:51.655601    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4c01c8da-c276-4b74-8f64-16bdc3e0237a-bound-sa-token\") pod \"image-registry-d858f7db9-cnzfq\" (UID: \"4c01c8da-c276-4b74-8f64-16bdc3e0237a\") " pod="openshift-image-registry/image-registry-d858f7db9-cnzfq"
Jul 14 19:14:51.656318 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:14:51.656302    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l9tf2\" (UniqueName: \"kubernetes.io/projected/26b54c88-015d-4e69-b66f-20b0c13a9f99-kube-api-access-l9tf2\") pod \"cluster-samples-operator-65db858894-h9qkx\" (UID: \"26b54c88-015d-4e69-b66f-20b0c13a9f99\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-h9qkx"
Jul 14 19:14:51.656463 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:14:51.656448    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8g4r4\" (UniqueName: \"kubernetes.io/projected/4c01c8da-c276-4b74-8f64-16bdc3e0237a-kube-api-access-8g4r4\") pod \"image-registry-d858f7db9-cnzfq\" (UID: \"4c01c8da-c276-4b74-8f64-16bdc3e0237a\") " pod="openshift-image-registry/image-registry-d858f7db9-cnzfq"
Jul 14 19:14:51.669481 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:14:51.669463    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-7866497494-p5lb5"]
Jul 14 19:14:51.671661 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:14:51.671647    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7866497494-p5lb5"
Jul 14 19:14:51.674092 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:14:51.674074    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Jul 14 19:14:51.674214 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:14:51.674172    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Jul 14 19:14:51.674214 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:14:51.674183    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Jul 14 19:14:51.674417 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:14:51.674401    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-n67pt\""
Jul 14 19:14:51.674502 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:14:51.674418    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Jul 14 19:14:51.680101 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:14:51.680082    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Jul 14 19:14:51.683665 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:14:51.683647    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7866497494-p5lb5"]
Jul 14 19:14:51.747137 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:14:51.747085    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/13fae2a1-59f5-4880-8045-12b6ce931d3f-nginx-conf\") pod \"networking-console-plugin-6cf856758c-9bkzn\" (UID: \"13fae2a1-59f5-4880-8045-12b6ce931d3f\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-9bkzn"
Jul 14 19:14:51.747137 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:14:51.747117    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4ksh7\" (UniqueName: \"kubernetes.io/projected/7ab60b2b-a644-4e35-b8b1-49c676e0f63f-kube-api-access-4ksh7\") pod \"console-operator-7866497494-p5lb5\" (UID: \"7ab60b2b-a644-4e35-b8b1-49c676e0f63f\") " pod="openshift-console-operator/console-operator-7866497494-p5lb5"
Jul 14 19:14:51.747266 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:14:51.747142    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7ab60b2b-a644-4e35-b8b1-49c676e0f63f-config\") pod \"console-operator-7866497494-p5lb5\" (UID: \"7ab60b2b-a644-4e35-b8b1-49c676e0f63f\") " pod="openshift-console-operator/console-operator-7866497494-p5lb5"
Jul 14 19:14:51.747266 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:14:51.747226    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/13fae2a1-59f5-4880-8045-12b6ce931d3f-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-9bkzn\" (UID: \"13fae2a1-59f5-4880-8045-12b6ce931d3f\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-9bkzn"
Jul 14 19:14:51.747328 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:14:51.747301    2565 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 14 19:14:51.747328 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:14:51.747308    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7ab60b2b-a644-4e35-b8b1-49c676e0f63f-serving-cert\") pod \"console-operator-7866497494-p5lb5\" (UID: \"7ab60b2b-a644-4e35-b8b1-49c676e0f63f\") " pod="openshift-console-operator/console-operator-7866497494-p5lb5"
Jul 14 19:14:51.747389 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:14:51.747346    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/13fae2a1-59f5-4880-8045-12b6ce931d3f-networking-console-plugin-cert podName:13fae2a1-59f5-4880-8045-12b6ce931d3f nodeName:}" failed. No retries permitted until 2026-07-14 19:14:52.247333463 +0000 UTC m=+238.808190336 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/13fae2a1-59f5-4880-8045-12b6ce931d3f-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-9bkzn" (UID: "13fae2a1-59f5-4880-8045-12b6ce931d3f") : secret "networking-console-plugin-cert" not found
Jul 14 19:14:51.747437 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:14:51.747415    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7ab60b2b-a644-4e35-b8b1-49c676e0f63f-trusted-ca\") pod \"console-operator-7866497494-p5lb5\" (UID: \"7ab60b2b-a644-4e35-b8b1-49c676e0f63f\") " pod="openshift-console-operator/console-operator-7866497494-p5lb5"
Jul 14 19:14:51.747830 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:14:51.747814    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/13fae2a1-59f5-4880-8045-12b6ce931d3f-nginx-conf\") pod \"networking-console-plugin-6cf856758c-9bkzn\" (UID: \"13fae2a1-59f5-4880-8045-12b6ce931d3f\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-9bkzn"
Jul 14 19:14:51.791577 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:14:51.791558    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-9qq8x"
Jul 14 19:14:51.848292 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:14:51.848261    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7ab60b2b-a644-4e35-b8b1-49c676e0f63f-trusted-ca\") pod \"console-operator-7866497494-p5lb5\" (UID: \"7ab60b2b-a644-4e35-b8b1-49c676e0f63f\") " pod="openshift-console-operator/console-operator-7866497494-p5lb5"
Jul 14 19:14:51.848422 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:14:51.848319    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4ksh7\" (UniqueName: \"kubernetes.io/projected/7ab60b2b-a644-4e35-b8b1-49c676e0f63f-kube-api-access-4ksh7\") pod \"console-operator-7866497494-p5lb5\" (UID: \"7ab60b2b-a644-4e35-b8b1-49c676e0f63f\") " pod="openshift-console-operator/console-operator-7866497494-p5lb5"
Jul 14 19:14:51.848422 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:14:51.848357    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7ab60b2b-a644-4e35-b8b1-49c676e0f63f-config\") pod \"console-operator-7866497494-p5lb5\" (UID: \"7ab60b2b-a644-4e35-b8b1-49c676e0f63f\") " pod="openshift-console-operator/console-operator-7866497494-p5lb5"
Jul 14 19:14:51.848422 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:14:51.848405    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7ab60b2b-a644-4e35-b8b1-49c676e0f63f-serving-cert\") pod \"console-operator-7866497494-p5lb5\" (UID: \"7ab60b2b-a644-4e35-b8b1-49c676e0f63f\") " pod="openshift-console-operator/console-operator-7866497494-p5lb5"
Jul 14 19:14:51.849841 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:14:51.849813    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7ab60b2b-a644-4e35-b8b1-49c676e0f63f-config\") pod \"console-operator-7866497494-p5lb5\" (UID: \"7ab60b2b-a644-4e35-b8b1-49c676e0f63f\") " pod="openshift-console-operator/console-operator-7866497494-p5lb5"
Jul 14 19:14:51.849970 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:14:51.849925    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7ab60b2b-a644-4e35-b8b1-49c676e0f63f-trusted-ca\") pod \"console-operator-7866497494-p5lb5\" (UID: \"7ab60b2b-a644-4e35-b8b1-49c676e0f63f\") " pod="openshift-console-operator/console-operator-7866497494-p5lb5"
Jul 14 19:14:51.851292 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:14:51.851272    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7ab60b2b-a644-4e35-b8b1-49c676e0f63f-serving-cert\") pod \"console-operator-7866497494-p5lb5\" (UID: \"7ab60b2b-a644-4e35-b8b1-49c676e0f63f\") " pod="openshift-console-operator/console-operator-7866497494-p5lb5"
Jul 14 19:14:51.857714 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:14:51.857691    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4ksh7\" (UniqueName: \"kubernetes.io/projected/7ab60b2b-a644-4e35-b8b1-49c676e0f63f-kube-api-access-4ksh7\") pod \"console-operator-7866497494-p5lb5\" (UID: \"7ab60b2b-a644-4e35-b8b1-49c676e0f63f\") " pod="openshift-console-operator/console-operator-7866497494-p5lb5"
Jul 14 19:14:51.911562 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:14:51.911534    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-9qq8x"]
Jul 14 19:14:51.914223 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:14:51.914199    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ec54941_8411_4559_97ba_84a7de6529fc.slice/crio-34fab818e82ed07c29e562c1c854448b94ec8df99ff6ca8e0818b4676735c5b7 WatchSource:0}: Error finding container 34fab818e82ed07c29e562c1c854448b94ec8df99ff6ca8e0818b4676735c5b7: Status 404 returned error can't find the container with id 34fab818e82ed07c29e562c1c854448b94ec8df99ff6ca8e0818b4676735c5b7
Jul 14 19:14:51.980816 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:14:51.980797    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7866497494-p5lb5"
Jul 14 19:14:52.099221 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:14:52.099111    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7866497494-p5lb5"]
Jul 14 19:14:52.101564 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:14:52.101530    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ab60b2b_a644_4e35_b8b1_49c676e0f63f.slice/crio-94dc868137b4658436b7bfc2fe183366c64ef2c14bdd4d0f059d83922d3fe421 WatchSource:0}: Error finding container 94dc868137b4658436b7bfc2fe183366c64ef2c14bdd4d0f059d83922d3fe421: Status 404 returned error can't find the container with id 94dc868137b4658436b7bfc2fe183366c64ef2c14bdd4d0f059d83922d3fe421
Jul 14 19:14:52.151706 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:14:52.151681    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/26b54c88-015d-4e69-b66f-20b0c13a9f99-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-h9qkx\" (UID: \"26b54c88-015d-4e69-b66f-20b0c13a9f99\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-h9qkx"
Jul 14 19:14:52.151805 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:14:52.151719    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4c01c8da-c276-4b74-8f64-16bdc3e0237a-registry-tls\") pod \"image-registry-d858f7db9-cnzfq\" (UID: \"4c01c8da-c276-4b74-8f64-16bdc3e0237a\") " pod="openshift-image-registry/image-registry-d858f7db9-cnzfq"
Jul 14 19:14:52.151844 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:14:52.151815    2565 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 14 19:14:52.151844 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:14:52.151820    2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 14 19:14:52.151844 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:14:52.151837    2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-d858f7db9-cnzfq: secret "image-registry-tls" not found
Jul 14 19:14:52.151928 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:14:52.151871    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/26b54c88-015d-4e69-b66f-20b0c13a9f99-samples-operator-tls podName:26b54c88-015d-4e69-b66f-20b0c13a9f99 nodeName:}" failed. No retries permitted until 2026-07-14 19:14:53.151856571 +0000 UTC m=+239.712713440 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/26b54c88-015d-4e69-b66f-20b0c13a9f99-samples-operator-tls") pod "cluster-samples-operator-65db858894-h9qkx" (UID: "26b54c88-015d-4e69-b66f-20b0c13a9f99") : secret "samples-operator-tls" not found
Jul 14 19:14:52.151928 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:14:52.151884    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4c01c8da-c276-4b74-8f64-16bdc3e0237a-registry-tls podName:4c01c8da-c276-4b74-8f64-16bdc3e0237a nodeName:}" failed. No retries permitted until 2026-07-14 19:14:53.151877615 +0000 UTC m=+239.712734484 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4c01c8da-c276-4b74-8f64-16bdc3e0237a-registry-tls") pod "image-registry-d858f7db9-cnzfq" (UID: "4c01c8da-c276-4b74-8f64-16bdc3e0237a") : secret "image-registry-tls" not found
Jul 14 19:14:52.252859 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:14:52.252818    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/13fae2a1-59f5-4880-8045-12b6ce931d3f-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-9bkzn\" (UID: \"13fae2a1-59f5-4880-8045-12b6ce931d3f\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-9bkzn"
Jul 14 19:14:52.252976 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:14:52.252951    2565 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 14 19:14:52.253031 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:14:52.252999    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/13fae2a1-59f5-4880-8045-12b6ce931d3f-networking-console-plugin-cert podName:13fae2a1-59f5-4880-8045-12b6ce931d3f nodeName:}" failed. No retries permitted until 2026-07-14 19:14:53.252986414 +0000 UTC m=+239.813843283 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/13fae2a1-59f5-4880-8045-12b6ce931d3f-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-9bkzn" (UID: "13fae2a1-59f5-4880-8045-12b6ce931d3f") : secret "networking-console-plugin-cert" not found
Jul 14 19:14:52.606440 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:14:52.606407    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-p5lb5" event={"ID":"7ab60b2b-a644-4e35-b8b1-49c676e0f63f","Type":"ContainerStarted","Data":"94dc868137b4658436b7bfc2fe183366c64ef2c14bdd4d0f059d83922d3fe421"}
Jul 14 19:14:52.607635 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:14:52.607610    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-9qq8x" event={"ID":"1ec54941-8411-4559-97ba-84a7de6529fc","Type":"ContainerStarted","Data":"34fab818e82ed07c29e562c1c854448b94ec8df99ff6ca8e0818b4676735c5b7"}
Jul 14 19:14:53.159982 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:14:53.159949    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4c01c8da-c276-4b74-8f64-16bdc3e0237a-registry-tls\") pod \"image-registry-d858f7db9-cnzfq\" (UID: \"4c01c8da-c276-4b74-8f64-16bdc3e0237a\") " pod="openshift-image-registry/image-registry-d858f7db9-cnzfq"
Jul 14 19:14:53.160093 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:14:53.160052    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/26b54c88-015d-4e69-b66f-20b0c13a9f99-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-h9qkx\" (UID: \"26b54c88-015d-4e69-b66f-20b0c13a9f99\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-h9qkx"
Jul 14 19:14:53.160175 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:14:53.160100    2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 14 19:14:53.160175 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:14:53.160120    2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-d858f7db9-cnzfq: secret "image-registry-tls" not found
Jul 14 19:14:53.160277 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:14:53.160186    2565 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 14 19:14:53.160277 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:14:53.160189    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4c01c8da-c276-4b74-8f64-16bdc3e0237a-registry-tls podName:4c01c8da-c276-4b74-8f64-16bdc3e0237a nodeName:}" failed. No retries permitted until 2026-07-14 19:14:55.160170181 +0000 UTC m=+241.721027065 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4c01c8da-c276-4b74-8f64-16bdc3e0237a-registry-tls") pod "image-registry-d858f7db9-cnzfq" (UID: "4c01c8da-c276-4b74-8f64-16bdc3e0237a") : secret "image-registry-tls" not found
Jul 14 19:14:53.160277 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:14:53.160243    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/26b54c88-015d-4e69-b66f-20b0c13a9f99-samples-operator-tls podName:26b54c88-015d-4e69-b66f-20b0c13a9f99 nodeName:}" failed. No retries permitted until 2026-07-14 19:14:55.160227566 +0000 UTC m=+241.721084440 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/26b54c88-015d-4e69-b66f-20b0c13a9f99-samples-operator-tls") pod "cluster-samples-operator-65db858894-h9qkx" (UID: "26b54c88-015d-4e69-b66f-20b0c13a9f99") : secret "samples-operator-tls" not found
Jul 14 19:14:53.261203 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:14:53.261174    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/13fae2a1-59f5-4880-8045-12b6ce931d3f-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-9bkzn\" (UID: \"13fae2a1-59f5-4880-8045-12b6ce931d3f\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-9bkzn"
Jul 14 19:14:53.261373 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:14:53.261354    2565 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 14 19:14:53.261437 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:14:53.261429    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/13fae2a1-59f5-4880-8045-12b6ce931d3f-networking-console-plugin-cert podName:13fae2a1-59f5-4880-8045-12b6ce931d3f nodeName:}" failed. No retries permitted until 2026-07-14 19:14:55.261407436 +0000 UTC m=+241.822264311 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/13fae2a1-59f5-4880-8045-12b6ce931d3f-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-9bkzn" (UID: "13fae2a1-59f5-4880-8045-12b6ce931d3f") : secret "networking-console-plugin-cert" not found
Jul 14 19:14:53.611984 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:14:53.611943    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-9qq8x" event={"ID":"1ec54941-8411-4559-97ba-84a7de6529fc","Type":"ContainerStarted","Data":"13ec4cec4c1cf41f3728e22bfed3c0b264dd5d422afc5cfedf103b127bda767d"}
Jul 14 19:14:53.638496 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:14:53.638447    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-9qq8x" podStartSLOduration=1.414892552 podStartE2EDuration="2.638428139s" totalImagesPullingTime="1.223535587s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 19:14:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:14:53.637076778 +0000 UTC m=+240.197933680" watchObservedRunningTime="2026-07-14 19:14:53.638428139 +0000 UTC m=+240.199285032"
Jul 14 19:14:54.617729 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:14:54.617697    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-p5lb5_7ab60b2b-a644-4e35-b8b1-49c676e0f63f/console-operator/0.log"
Jul 14 19:14:54.618119 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:14:54.617743    2565 generic.go:356] "Generic (PLEG): container finished" podID="7ab60b2b-a644-4e35-b8b1-49c676e0f63f" containerID="eee1fa42988c521a48e8d40681e194babf2a406e27c4e9758ede12055ce7f523" exitCode=255
Jul 14 19:14:54.618119 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:14:54.617854    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-p5lb5" event={"ID":"7ab60b2b-a644-4e35-b8b1-49c676e0f63f","Type":"ContainerDied","Data":"eee1fa42988c521a48e8d40681e194babf2a406e27c4e9758ede12055ce7f523"}
Jul 14 19:14:54.618119 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:14:54.618078    2565 scope.go:117] "RemoveContainer" containerID="eee1fa42988c521a48e8d40681e194babf2a406e27c4e9758ede12055ce7f523"
Jul 14 19:14:55.174953 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:14:55.174927    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/26b54c88-015d-4e69-b66f-20b0c13a9f99-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-h9qkx\" (UID: \"26b54c88-015d-4e69-b66f-20b0c13a9f99\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-h9qkx"
Jul 14 19:14:55.175105 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:14:55.174970    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4c01c8da-c276-4b74-8f64-16bdc3e0237a-registry-tls\") pod \"image-registry-d858f7db9-cnzfq\" (UID: \"4c01c8da-c276-4b74-8f64-16bdc3e0237a\") " pod="openshift-image-registry/image-registry-d858f7db9-cnzfq"
Jul 14 19:14:55.175105 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:14:55.175085    2565 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 14 19:14:55.175105 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:14:55.175098    2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 14 19:14:55.175227 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:14:55.175110    2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-d858f7db9-cnzfq: secret "image-registry-tls" not found
Jul 14 19:14:55.175227 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:14:55.175147    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/26b54c88-015d-4e69-b66f-20b0c13a9f99-samples-operator-tls podName:26b54c88-015d-4e69-b66f-20b0c13a9f99 nodeName:}" failed. No retries permitted until 2026-07-14 19:14:59.175131654 +0000 UTC m=+245.735988524 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/26b54c88-015d-4e69-b66f-20b0c13a9f99-samples-operator-tls") pod "cluster-samples-operator-65db858894-h9qkx" (UID: "26b54c88-015d-4e69-b66f-20b0c13a9f99") : secret "samples-operator-tls" not found
Jul 14 19:14:55.175227 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:14:55.175178    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4c01c8da-c276-4b74-8f64-16bdc3e0237a-registry-tls podName:4c01c8da-c276-4b74-8f64-16bdc3e0237a nodeName:}" failed. No retries permitted until 2026-07-14 19:14:59.175170737 +0000 UTC m=+245.736027607 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4c01c8da-c276-4b74-8f64-16bdc3e0237a-registry-tls") pod "image-registry-d858f7db9-cnzfq" (UID: "4c01c8da-c276-4b74-8f64-16bdc3e0237a") : secret "image-registry-tls" not found
Jul 14 19:14:55.276192 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:14:55.276164    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/13fae2a1-59f5-4880-8045-12b6ce931d3f-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-9bkzn\" (UID: \"13fae2a1-59f5-4880-8045-12b6ce931d3f\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-9bkzn"
Jul 14 19:14:55.276310 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:14:55.276267    2565 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 14 19:14:55.276349 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:14:55.276314    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/13fae2a1-59f5-4880-8045-12b6ce931d3f-networking-console-plugin-cert podName:13fae2a1-59f5-4880-8045-12b6ce931d3f nodeName:}" failed. No retries permitted until 2026-07-14 19:14:59.276301228 +0000 UTC m=+245.837158098 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/13fae2a1-59f5-4880-8045-12b6ce931d3f-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-9bkzn" (UID: "13fae2a1-59f5-4880-8045-12b6ce931d3f") : secret "networking-console-plugin-cert" not found
Jul 14 19:14:55.626429 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:14:55.626402    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-p5lb5_7ab60b2b-a644-4e35-b8b1-49c676e0f63f/console-operator/1.log"
Jul 14 19:14:55.626856 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:14:55.626834    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-p5lb5_7ab60b2b-a644-4e35-b8b1-49c676e0f63f/console-operator/0.log"
Jul 14 19:14:55.626896 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:14:55.626876    2565 generic.go:356] "Generic (PLEG): container finished" podID="7ab60b2b-a644-4e35-b8b1-49c676e0f63f" containerID="fe0a9b2fc8baa493d8b0f207a01bcd1be931fc344d4d0159bf9c0ba017988397" exitCode=255
Jul 14 19:14:55.626934 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:14:55.626911    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-p5lb5" event={"ID":"7ab60b2b-a644-4e35-b8b1-49c676e0f63f","Type":"ContainerDied","Data":"fe0a9b2fc8baa493d8b0f207a01bcd1be931fc344d4d0159bf9c0ba017988397"}
Jul 14 19:14:55.627017 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:14:55.626988    2565 scope.go:117] "RemoveContainer" containerID="eee1fa42988c521a48e8d40681e194babf2a406e27c4e9758ede12055ce7f523"
Jul 14 19:14:55.627171 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:14:55.627137    2565 scope.go:117] "RemoveContainer" containerID="fe0a9b2fc8baa493d8b0f207a01bcd1be931fc344d4d0159bf9c0ba017988397"
Jul 14 19:14:55.627344 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:14:55.627325    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-p5lb5_openshift-console-operator(7ab60b2b-a644-4e35-b8b1-49c676e0f63f)\"" pod="openshift-console-operator/console-operator-7866497494-p5lb5" podUID="7ab60b2b-a644-4e35-b8b1-49c676e0f63f"
Jul 14 19:14:56.473618 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:14:56.473585    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-kflcd"]
Jul 14 19:14:56.476252 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:14:56.476236    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-kflcd"
Jul 14 19:14:56.483994 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:14:56.483960    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-9hbmm\""
Jul 14 19:14:56.483994 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:14:56.483980    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 14 19:14:56.483994 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:14:56.483963    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 14 19:14:56.484221 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:14:56.484007    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 14 19:14:56.484221 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:14:56.483963    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 14 19:14:56.511986 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:14:56.511967    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-kflcd"]
Jul 14 19:14:56.574227 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:14:56.574202    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-xdsmr"]
Jul 14 19:14:56.576056 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:14:56.576038    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-xdsmr"
Jul 14 19:14:56.578425 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:14:56.578407    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Jul 14 19:14:56.578540 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:14:56.578506    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-jxbqh\""
Jul 14 19:14:56.578596 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:14:56.578543    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Jul 14 19:14:56.586491 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:14:56.586469    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-xdsmr"]
Jul 14 19:14:56.586623 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:14:56.586607    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/44bb8ebf-72e6-435c-8a36-332fbf23a548-data-volume\") pod \"insights-runtime-extractor-kflcd\" (UID: \"44bb8ebf-72e6-435c-8a36-332fbf23a548\") " pod="openshift-insights/insights-runtime-extractor-kflcd"
Jul 14 19:14:56.586707 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:14:56.586690    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/44bb8ebf-72e6-435c-8a36-332fbf23a548-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kflcd\" (UID: \"44bb8ebf-72e6-435c-8a36-332fbf23a548\") " pod="openshift-insights/insights-runtime-extractor-kflcd"
Jul 14 19:14:56.586766 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:14:56.586723    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kwss8\" (UniqueName: \"kubernetes.io/projected/44bb8ebf-72e6-435c-8a36-332fbf23a548-kube-api-access-kwss8\") pod \"insights-runtime-extractor-kflcd\" (UID: \"44bb8ebf-72e6-435c-8a36-332fbf23a548\") " pod="openshift-insights/insights-runtime-extractor-kflcd"
Jul 14 19:14:56.586766 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:14:56.586752    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/44bb8ebf-72e6-435c-8a36-332fbf23a548-crio-socket\") pod \"insights-runtime-extractor-kflcd\" (UID: \"44bb8ebf-72e6-435c-8a36-332fbf23a548\") " pod="openshift-insights/insights-runtime-extractor-kflcd"
Jul 14 19:14:56.586915 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:14:56.586832    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/44bb8ebf-72e6-435c-8a36-332fbf23a548-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kflcd\" (UID: \"44bb8ebf-72e6-435c-8a36-332fbf23a548\") " pod="openshift-insights/insights-runtime-extractor-kflcd"
Jul 14 19:14:56.630989 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:14:56.630965    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-p5lb5_7ab60b2b-a644-4e35-b8b1-49c676e0f63f/console-operator/1.log"
Jul 14 19:14:56.631297 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:14:56.631282    2565 scope.go:117] "RemoveContainer" containerID="fe0a9b2fc8baa493d8b0f207a01bcd1be931fc344d4d0159bf9c0ba017988397"
Jul 14 19:14:56.631443 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:14:56.631425    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-p5lb5_openshift-console-operator(7ab60b2b-a644-4e35-b8b1-49c676e0f63f)\"" pod="openshift-console-operator/console-operator-7866497494-p5lb5" podUID="7ab60b2b-a644-4e35-b8b1-49c676e0f63f"
Jul 14 19:14:56.687213 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:14:56.687193    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/44bb8ebf-72e6-435c-8a36-332fbf23a548-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kflcd\" (UID: \"44bb8ebf-72e6-435c-8a36-332fbf23a548\") " pod="openshift-insights/insights-runtime-extractor-kflcd"
Jul 14 19:14:56.687316 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:14:56.687235    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/44bb8ebf-72e6-435c-8a36-332fbf23a548-data-volume\") pod \"insights-runtime-extractor-kflcd\" (UID: \"44bb8ebf-72e6-435c-8a36-332fbf23a548\") " pod="openshift-insights/insights-runtime-extractor-kflcd"
Jul 14 19:14:56.687316 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:14:56.687258    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-628sb\" (UniqueName: \"kubernetes.io/projected/1d832d81-a2e9-441e-86a4-22f66908a826-kube-api-access-628sb\") pod \"migrator-7f59b54f6c-xdsmr\" (UID: \"1d832d81-a2e9-441e-86a4-22f66908a826\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-xdsmr"
Jul 14 19:14:56.687426 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:14:56.687322    2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 14 19:14:56.687426 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:14:56.687372    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/44bb8ebf-72e6-435c-8a36-332fbf23a548-kube-rbac-proxy-cm podName:44bb8ebf-72e6-435c-8a36-332fbf23a548 nodeName:}" failed. No retries permitted until 2026-07-14 19:14:57.187358328 +0000 UTC m=+243.748215211 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/44bb8ebf-72e6-435c-8a36-332fbf23a548-kube-rbac-proxy-cm") pod "insights-runtime-extractor-kflcd" (UID: "44bb8ebf-72e6-435c-8a36-332fbf23a548") : configmap "kube-rbac-proxy" not found
Jul 14 19:14:56.687528 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:14:56.687426    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/44bb8ebf-72e6-435c-8a36-332fbf23a548-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kflcd\" (UID: \"44bb8ebf-72e6-435c-8a36-332fbf23a548\") " pod="openshift-insights/insights-runtime-extractor-kflcd"
Jul 14 19:14:56.687528 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:14:56.687470    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kwss8\" (UniqueName: \"kubernetes.io/projected/44bb8ebf-72e6-435c-8a36-332fbf23a548-kube-api-access-kwss8\") pod \"insights-runtime-extractor-kflcd\" (UID: \"44bb8ebf-72e6-435c-8a36-332fbf23a548\") " pod="openshift-insights/insights-runtime-extractor-kflcd"
Jul 14 19:14:56.687528 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:14:56.687509    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/44bb8ebf-72e6-435c-8a36-332fbf23a548-crio-socket\") pod \"insights-runtime-extractor-kflcd\" (UID: \"44bb8ebf-72e6-435c-8a36-332fbf23a548\") " pod="openshift-insights/insights-runtime-extractor-kflcd"
Jul 14 19:14:56.687668 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:14:56.687527    2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 14 19:14:56.687668 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:14:56.687583    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/44bb8ebf-72e6-435c-8a36-332fbf23a548-crio-socket\") pod \"insights-runtime-extractor-kflcd\" (UID: \"44bb8ebf-72e6-435c-8a36-332fbf23a548\") " pod="openshift-insights/insights-runtime-extractor-kflcd"
Jul 14 19:14:56.687668 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:14:56.687583    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/44bb8ebf-72e6-435c-8a36-332fbf23a548-data-volume\") pod \"insights-runtime-extractor-kflcd\" (UID: \"44bb8ebf-72e6-435c-8a36-332fbf23a548\") " pod="openshift-insights/insights-runtime-extractor-kflcd"
Jul 14 19:14:56.687668 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:14:56.687586    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/44bb8ebf-72e6-435c-8a36-332fbf23a548-insights-runtime-extractor-tls podName:44bb8ebf-72e6-435c-8a36-332fbf23a548 nodeName:}" failed. No retries permitted until 2026-07-14 19:14:57.187570078 +0000 UTC m=+243.748426948 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/44bb8ebf-72e6-435c-8a36-332fbf23a548-insights-runtime-extractor-tls") pod "insights-runtime-extractor-kflcd" (UID: "44bb8ebf-72e6-435c-8a36-332fbf23a548") : secret "insights-runtime-extractor-tls" not found
Jul 14 19:14:56.695390 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:14:56.695366    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kwss8\" (UniqueName: \"kubernetes.io/projected/44bb8ebf-72e6-435c-8a36-332fbf23a548-kube-api-access-kwss8\") pod \"insights-runtime-extractor-kflcd\" (UID: \"44bb8ebf-72e6-435c-8a36-332fbf23a548\") " pod="openshift-insights/insights-runtime-extractor-kflcd"
Jul 14 19:14:56.788357 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:14:56.788310    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-628sb\" (UniqueName: \"kubernetes.io/projected/1d832d81-a2e9-441e-86a4-22f66908a826-kube-api-access-628sb\") pod \"migrator-7f59b54f6c-xdsmr\" (UID: \"1d832d81-a2e9-441e-86a4-22f66908a826\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-xdsmr"
Jul 14 19:14:56.799959 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:14:56.799932    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-628sb\" (UniqueName: \"kubernetes.io/projected/1d832d81-a2e9-441e-86a4-22f66908a826-kube-api-access-628sb\") pod \"migrator-7f59b54f6c-xdsmr\" (UID: \"1d832d81-a2e9-441e-86a4-22f66908a826\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-xdsmr"
Jul 14 19:14:56.883992 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:14:56.883970    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-xdsmr"
Jul 14 19:14:57.003412 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:14:57.003384    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-xdsmr"]
Jul 14 19:14:57.006529 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:14:57.006503    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d832d81_a2e9_441e_86a4_22f66908a826.slice/crio-93a7e18095ae023afddac4df9284cc017e4b3990bf97dbcb1bd3118c58587d59 WatchSource:0}: Error finding container 93a7e18095ae023afddac4df9284cc017e4b3990bf97dbcb1bd3118c58587d59: Status 404 returned error can't find the container with id 93a7e18095ae023afddac4df9284cc017e4b3990bf97dbcb1bd3118c58587d59
Jul 14 19:14:57.190747 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:14:57.190681    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/44bb8ebf-72e6-435c-8a36-332fbf23a548-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kflcd\" (UID: \"44bb8ebf-72e6-435c-8a36-332fbf23a548\") " pod="openshift-insights/insights-runtime-extractor-kflcd"
Jul 14 19:14:57.190853 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:14:57.190751    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/44bb8ebf-72e6-435c-8a36-332fbf23a548-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kflcd\" (UID: \"44bb8ebf-72e6-435c-8a36-332fbf23a548\") " pod="openshift-insights/insights-runtime-extractor-kflcd"
Jul 14 19:14:57.190853 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:14:57.190816    2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 14 19:14:57.190853 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:14:57.190850    2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 14 19:14:57.190952 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:14:57.190894    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/44bb8ebf-72e6-435c-8a36-332fbf23a548-kube-rbac-proxy-cm podName:44bb8ebf-72e6-435c-8a36-332fbf23a548 nodeName:}" failed. No retries permitted until 2026-07-14 19:14:58.190871985 +0000 UTC m=+244.751728870 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/44bb8ebf-72e6-435c-8a36-332fbf23a548-kube-rbac-proxy-cm") pod "insights-runtime-extractor-kflcd" (UID: "44bb8ebf-72e6-435c-8a36-332fbf23a548") : configmap "kube-rbac-proxy" not found
Jul 14 19:14:57.190952 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:14:57.190908    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/44bb8ebf-72e6-435c-8a36-332fbf23a548-insights-runtime-extractor-tls podName:44bb8ebf-72e6-435c-8a36-332fbf23a548 nodeName:}" failed. No retries permitted until 2026-07-14 19:14:58.190901762 +0000 UTC m=+244.751758632 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/44bb8ebf-72e6-435c-8a36-332fbf23a548-insights-runtime-extractor-tls") pod "insights-runtime-extractor-kflcd" (UID: "44bb8ebf-72e6-435c-8a36-332fbf23a548") : secret "insights-runtime-extractor-tls" not found
Jul 14 19:14:57.635637 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:14:57.635604    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-xdsmr" event={"ID":"1d832d81-a2e9-441e-86a4-22f66908a826","Type":"ContainerStarted","Data":"93a7e18095ae023afddac4df9284cc017e4b3990bf97dbcb1bd3118c58587d59"}
Jul 14 19:14:58.199110 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:14:58.199082    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/44bb8ebf-72e6-435c-8a36-332fbf23a548-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kflcd\" (UID: \"44bb8ebf-72e6-435c-8a36-332fbf23a548\") " pod="openshift-insights/insights-runtime-extractor-kflcd"
Jul 14 19:14:58.199243 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:14:58.199225    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/44bb8ebf-72e6-435c-8a36-332fbf23a548-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kflcd\" (UID: \"44bb8ebf-72e6-435c-8a36-332fbf23a548\") " pod="openshift-insights/insights-runtime-extractor-kflcd"
Jul 14 19:14:58.199305 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:14:58.199275    2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 14 19:14:58.199362 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:14:58.199351    2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 14 19:14:58.199413 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:14:58.199365    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/44bb8ebf-72e6-435c-8a36-332fbf23a548-insights-runtime-extractor-tls podName:44bb8ebf-72e6-435c-8a36-332fbf23a548 nodeName:}" failed. No retries permitted until 2026-07-14 19:15:00.199344239 +0000 UTC m=+246.760201128 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/44bb8ebf-72e6-435c-8a36-332fbf23a548-insights-runtime-extractor-tls") pod "insights-runtime-extractor-kflcd" (UID: "44bb8ebf-72e6-435c-8a36-332fbf23a548") : secret "insights-runtime-extractor-tls" not found
Jul 14 19:14:58.199413 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:14:58.199410    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/44bb8ebf-72e6-435c-8a36-332fbf23a548-kube-rbac-proxy-cm podName:44bb8ebf-72e6-435c-8a36-332fbf23a548 nodeName:}" failed. No retries permitted until 2026-07-14 19:15:00.199393144 +0000 UTC m=+246.760250019 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/44bb8ebf-72e6-435c-8a36-332fbf23a548-kube-rbac-proxy-cm") pod "insights-runtime-extractor-kflcd" (UID: "44bb8ebf-72e6-435c-8a36-332fbf23a548") : configmap "kube-rbac-proxy" not found
Jul 14 19:14:58.230874 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:14:58.230856    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-gx8lp_9d44b622-d76b-4616-af94-e7d9b6f2f67b/dns-node-resolver/0.log"
Jul 14 19:14:58.640169 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:14:58.640124    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-xdsmr" event={"ID":"1d832d81-a2e9-441e-86a4-22f66908a826","Type":"ContainerStarted","Data":"37084bcd8d94b1a34e547e162e2fd04dc8fec674adb20aafc173543a091c3bc3"}
Jul 14 19:14:58.640494 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:14:58.640220    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-xdsmr" event={"ID":"1d832d81-a2e9-441e-86a4-22f66908a826","Type":"ContainerStarted","Data":"1e9905f401018415446e9e31d1eed9ac4f60528a45ea3ad3904de8f3b8e98cdc"}
Jul 14 19:14:58.660439 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:14:58.660387    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-xdsmr" podStartSLOduration=1.509845684 podStartE2EDuration="2.660373759s" totalImagesPullingTime="1.150528075s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 19:14:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:14:58.660291468 +0000 UTC m=+245.221148387" watchObservedRunningTime="2026-07-14 19:14:58.660373759 +0000 UTC m=+245.221230650"
Jul 14 19:14:59.205923 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:14:59.205889    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4c01c8da-c276-4b74-8f64-16bdc3e0237a-registry-tls\") pod \"image-registry-d858f7db9-cnzfq\" (UID: \"4c01c8da-c276-4b74-8f64-16bdc3e0237a\") " pod="openshift-image-registry/image-registry-d858f7db9-cnzfq"
Jul 14 19:14:59.206060 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:14:59.205983    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/26b54c88-015d-4e69-b66f-20b0c13a9f99-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-h9qkx\" (UID: \"26b54c88-015d-4e69-b66f-20b0c13a9f99\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-h9qkx"
Jul 14 19:14:59.206060 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:14:59.206023    2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 14 19:14:59.206060 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:14:59.206039    2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-d858f7db9-cnzfq: secret "image-registry-tls" not found
Jul 14 19:14:59.206174 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:14:59.206077    2565 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 14 19:14:59.206174 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:14:59.206101    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4c01c8da-c276-4b74-8f64-16bdc3e0237a-registry-tls podName:4c01c8da-c276-4b74-8f64-16bdc3e0237a nodeName:}" failed. No retries permitted until 2026-07-14 19:15:07.206083866 +0000 UTC m=+253.766940752 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4c01c8da-c276-4b74-8f64-16bdc3e0237a-registry-tls") pod "image-registry-d858f7db9-cnzfq" (UID: "4c01c8da-c276-4b74-8f64-16bdc3e0237a") : secret "image-registry-tls" not found
Jul 14 19:14:59.206174 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:14:59.206119    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/26b54c88-015d-4e69-b66f-20b0c13a9f99-samples-operator-tls podName:26b54c88-015d-4e69-b66f-20b0c13a9f99 nodeName:}" failed. No retries permitted until 2026-07-14 19:15:07.206106612 +0000 UTC m=+253.766963481 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/26b54c88-015d-4e69-b66f-20b0c13a9f99-samples-operator-tls") pod "cluster-samples-operator-65db858894-h9qkx" (UID: "26b54c88-015d-4e69-b66f-20b0c13a9f99") : secret "samples-operator-tls" not found
Jul 14 19:14:59.306506 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:14:59.306480    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/13fae2a1-59f5-4880-8045-12b6ce931d3f-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-9bkzn\" (UID: \"13fae2a1-59f5-4880-8045-12b6ce931d3f\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-9bkzn"
Jul 14 19:14:59.306601 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:14:59.306575    2565 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 14 19:14:59.306633 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:14:59.306612    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/13fae2a1-59f5-4880-8045-12b6ce931d3f-networking-console-plugin-cert podName:13fae2a1-59f5-4880-8045-12b6ce931d3f nodeName:}" failed. No retries permitted until 2026-07-14 19:15:07.306602777 +0000 UTC m=+253.867459647 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/13fae2a1-59f5-4880-8045-12b6ce931d3f-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-9bkzn" (UID: "13fae2a1-59f5-4880-8045-12b6ce931d3f") : secret "networking-console-plugin-cert" not found
Jul 14 19:14:59.428897 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:14:59.428875    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-kjr5k_06f772af-8888-44a7-9035-bd5ca76ac90e/node-ca/0.log"
Jul 14 19:15:00.213575 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:00.213545    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/44bb8ebf-72e6-435c-8a36-332fbf23a548-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kflcd\" (UID: \"44bb8ebf-72e6-435c-8a36-332fbf23a548\") " pod="openshift-insights/insights-runtime-extractor-kflcd"
Jul 14 19:15:00.213923 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:00.213618    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/44bb8ebf-72e6-435c-8a36-332fbf23a548-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kflcd\" (UID: \"44bb8ebf-72e6-435c-8a36-332fbf23a548\") " pod="openshift-insights/insights-runtime-extractor-kflcd"
Jul 14 19:15:00.213923 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:15:00.213692    2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 14 19:15:00.213923 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:15:00.213706    2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 14 19:15:00.213923 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:15:00.213753    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/44bb8ebf-72e6-435c-8a36-332fbf23a548-insights-runtime-extractor-tls podName:44bb8ebf-72e6-435c-8a36-332fbf23a548 nodeName:}" failed. No retries permitted until 2026-07-14 19:15:04.213741115 +0000 UTC m=+250.774597997 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/44bb8ebf-72e6-435c-8a36-332fbf23a548-insights-runtime-extractor-tls") pod "insights-runtime-extractor-kflcd" (UID: "44bb8ebf-72e6-435c-8a36-332fbf23a548") : secret "insights-runtime-extractor-tls" not found
Jul 14 19:15:00.213923 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:15:00.213768    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/44bb8ebf-72e6-435c-8a36-332fbf23a548-kube-rbac-proxy-cm podName:44bb8ebf-72e6-435c-8a36-332fbf23a548 nodeName:}" failed. No retries permitted until 2026-07-14 19:15:04.213762281 +0000 UTC m=+250.774619151 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/44bb8ebf-72e6-435c-8a36-332fbf23a548-kube-rbac-proxy-cm") pod "insights-runtime-extractor-kflcd" (UID: "44bb8ebf-72e6-435c-8a36-332fbf23a548") : configmap "kube-rbac-proxy" not found
Jul 14 19:15:00.430282 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:00.430257    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-ttnqj_49093e63-d7ef-4c83-9c07-a96fd79d02f7/serve-healthcheck-canary/0.log"
Jul 14 19:15:01.981233 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:01.981212    2565 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-7866497494-p5lb5"
Jul 14 19:15:01.981560 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:01.981254    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-p5lb5"
Jul 14 19:15:01.981560 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:01.981532    2565 scope.go:117] "RemoveContainer" containerID="fe0a9b2fc8baa493d8b0f207a01bcd1be931fc344d4d0159bf9c0ba017988397"
Jul 14 19:15:01.981675 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:15:01.981657    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-p5lb5_openshift-console-operator(7ab60b2b-a644-4e35-b8b1-49c676e0f63f)\"" pod="openshift-console-operator/console-operator-7866497494-p5lb5" podUID="7ab60b2b-a644-4e35-b8b1-49c676e0f63f"
Jul 14 19:15:04.244399 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:04.244356    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/44bb8ebf-72e6-435c-8a36-332fbf23a548-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kflcd\" (UID: \"44bb8ebf-72e6-435c-8a36-332fbf23a548\") " pod="openshift-insights/insights-runtime-extractor-kflcd"
Jul 14 19:15:04.244768 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:04.244466    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/44bb8ebf-72e6-435c-8a36-332fbf23a548-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kflcd\" (UID: \"44bb8ebf-72e6-435c-8a36-332fbf23a548\") " pod="openshift-insights/insights-runtime-extractor-kflcd"
Jul 14 19:15:04.244768 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:15:04.244524    2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 14 19:15:04.244768 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:15:04.244544    2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 14 19:15:04.244928 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:15:04.244906    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/44bb8ebf-72e6-435c-8a36-332fbf23a548-insights-runtime-extractor-tls podName:44bb8ebf-72e6-435c-8a36-332fbf23a548 nodeName:}" failed. No retries permitted until 2026-07-14 19:15:12.24487399 +0000 UTC m=+258.805730865 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/44bb8ebf-72e6-435c-8a36-332fbf23a548-insights-runtime-extractor-tls") pod "insights-runtime-extractor-kflcd" (UID: "44bb8ebf-72e6-435c-8a36-332fbf23a548") : secret "insights-runtime-extractor-tls" not found
Jul 14 19:15:04.244992 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:15:04.244942    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/44bb8ebf-72e6-435c-8a36-332fbf23a548-kube-rbac-proxy-cm podName:44bb8ebf-72e6-435c-8a36-332fbf23a548 nodeName:}" failed. No retries permitted until 2026-07-14 19:15:12.244928093 +0000 UTC m=+258.805784962 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/44bb8ebf-72e6-435c-8a36-332fbf23a548-kube-rbac-proxy-cm") pod "insights-runtime-extractor-kflcd" (UID: "44bb8ebf-72e6-435c-8a36-332fbf23a548") : configmap "kube-rbac-proxy" not found
Jul 14 19:15:05.654863 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:05.654826    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a2ef2d8f-5f7b-41bd-b98a-2a272dd4090f-metrics-certs\") pod \"network-metrics-daemon-hbbrx\" (UID: \"a2ef2d8f-5f7b-41bd-b98a-2a272dd4090f\") " pod="openshift-multus/network-metrics-daemon-hbbrx"
Jul 14 19:15:05.655259 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:15:05.654977    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 14 19:15:05.655259 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:15:05.655038    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a2ef2d8f-5f7b-41bd-b98a-2a272dd4090f-metrics-certs podName:a2ef2d8f-5f7b-41bd-b98a-2a272dd4090f nodeName:}" failed. No retries permitted until 2026-07-14 19:17:07.655023095 +0000 UTC m=+374.215879965 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a2ef2d8f-5f7b-41bd-b98a-2a272dd4090f-metrics-certs") pod "network-metrics-daemon-hbbrx" (UID: "a2ef2d8f-5f7b-41bd-b98a-2a272dd4090f") : secret "metrics-daemon-secret" not found
Jul 14 19:15:07.266560 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:07.266521    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/26b54c88-015d-4e69-b66f-20b0c13a9f99-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-h9qkx\" (UID: \"26b54c88-015d-4e69-b66f-20b0c13a9f99\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-h9qkx"
Jul 14 19:15:07.266907 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:07.266573    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4c01c8da-c276-4b74-8f64-16bdc3e0237a-registry-tls\") pod \"image-registry-d858f7db9-cnzfq\" (UID: \"4c01c8da-c276-4b74-8f64-16bdc3e0237a\") " pod="openshift-image-registry/image-registry-d858f7db9-cnzfq"
Jul 14 19:15:07.268904 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:07.268881    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/26b54c88-015d-4e69-b66f-20b0c13a9f99-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-h9qkx\" (UID: \"26b54c88-015d-4e69-b66f-20b0c13a9f99\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-h9qkx"
Jul 14 19:15:07.268904 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:07.268899    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4c01c8da-c276-4b74-8f64-16bdc3e0237a-registry-tls\") pod \"image-registry-d858f7db9-cnzfq\" (UID: \"4c01c8da-c276-4b74-8f64-16bdc3e0237a\") " pod="openshift-image-registry/image-registry-d858f7db9-cnzfq"
Jul 14 19:15:07.367598 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:07.367577    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/13fae2a1-59f5-4880-8045-12b6ce931d3f-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-9bkzn\" (UID: \"13fae2a1-59f5-4880-8045-12b6ce931d3f\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-9bkzn"
Jul 14 19:15:07.367710 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:15:07.367653    2565 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 14 19:15:07.367710 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:15:07.367707    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/13fae2a1-59f5-4880-8045-12b6ce931d3f-networking-console-plugin-cert podName:13fae2a1-59f5-4880-8045-12b6ce931d3f nodeName:}" failed. No retries permitted until 2026-07-14 19:15:23.367695125 +0000 UTC m=+269.928551994 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/13fae2a1-59f5-4880-8045-12b6ce931d3f-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-9bkzn" (UID: "13fae2a1-59f5-4880-8045-12b6ce931d3f") : secret "networking-console-plugin-cert" not found
Jul 14 19:15:07.401204 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:07.401185    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-stgfm\""
Jul 14 19:15:07.406213 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:07.406200    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-plsql\""
Jul 14 19:15:07.409852 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:07.409838    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-h9qkx"
Jul 14 19:15:07.415233 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:07.415219    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-d858f7db9-cnzfq"
Jul 14 19:15:07.543305 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:07.543238    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-h9qkx"]
Jul 14 19:15:07.558607 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:07.558581    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-d858f7db9-cnzfq"]
Jul 14 19:15:07.564328 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:15:07.564300    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c01c8da_c276_4b74_8f64_16bdc3e0237a.slice/crio-bbfde35b41f860b8c2b0c987a2204660da3bee0b3fb16f814b44b6054f373a38 WatchSource:0}: Error finding container bbfde35b41f860b8c2b0c987a2204660da3bee0b3fb16f814b44b6054f373a38: Status 404 returned error can't find the container with id bbfde35b41f860b8c2b0c987a2204660da3bee0b3fb16f814b44b6054f373a38
Jul 14 19:15:07.666820 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:07.666791    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-h9qkx" event={"ID":"26b54c88-015d-4e69-b66f-20b0c13a9f99","Type":"ContainerStarted","Data":"ef7a61e5e63c1c68351ca162e28e1b76535b8a911864b37f8d945e7397e4ca14"}
Jul 14 19:15:07.668124 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:07.668103    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-d858f7db9-cnzfq" event={"ID":"4c01c8da-c276-4b74-8f64-16bdc3e0237a","Type":"ContainerStarted","Data":"98328cdf1fe31d645e91e00a532acb6cbcc38e22d9da716cab4c9bf95c43a0c4"}
Jul 14 19:15:07.668248 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:07.668139    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-d858f7db9-cnzfq" event={"ID":"4c01c8da-c276-4b74-8f64-16bdc3e0237a","Type":"ContainerStarted","Data":"bbfde35b41f860b8c2b0c987a2204660da3bee0b3fb16f814b44b6054f373a38"}
Jul 14 19:15:07.668307 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:07.668248    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-d858f7db9-cnzfq"
Jul 14 19:15:07.687129 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:07.686558    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-d858f7db9-cnzfq" podStartSLOduration=16.686540073 podStartE2EDuration="16.686540073s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 19:14:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:15:07.686248751 +0000 UTC m=+254.247105642" watchObservedRunningTime="2026-07-14 19:15:07.686540073 +0000 UTC m=+254.247396965"
Jul 14 19:15:09.677125 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:09.677052    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-h9qkx" event={"ID":"26b54c88-015d-4e69-b66f-20b0c13a9f99","Type":"ContainerStarted","Data":"55950f992a9fe94b8ab62fb4677aaf599c8ca4e63f0250363bf58b6e947f0112"}
Jul 14 19:15:09.677125 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:09.677100    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-h9qkx" event={"ID":"26b54c88-015d-4e69-b66f-20b0c13a9f99","Type":"ContainerStarted","Data":"0d5b5af0a7715b952e143971b13352c26b37a1791213d778d0bc30b08ba4adb1"}
Jul 14 19:15:09.694146 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:09.694101    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-h9qkx" podStartSLOduration=17.055354695 podStartE2EDuration="18.694088165s" totalImagesPullingTime="1.63873347s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 19:14:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:15:09.693647439 +0000 UTC m=+256.254504351" watchObservedRunningTime="2026-07-14 19:15:09.694088165 +0000 UTC m=+256.254945055"
Jul 14 19:15:12.303972 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:12.303938    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/44bb8ebf-72e6-435c-8a36-332fbf23a548-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kflcd\" (UID: \"44bb8ebf-72e6-435c-8a36-332fbf23a548\") " pod="openshift-insights/insights-runtime-extractor-kflcd"
Jul 14 19:15:12.304342 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:12.303993    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/44bb8ebf-72e6-435c-8a36-332fbf23a548-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kflcd\" (UID: \"44bb8ebf-72e6-435c-8a36-332fbf23a548\") " pod="openshift-insights/insights-runtime-extractor-kflcd"
Jul 14 19:15:12.304469 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:12.304449    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/44bb8ebf-72e6-435c-8a36-332fbf23a548-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kflcd\" (UID: \"44bb8ebf-72e6-435c-8a36-332fbf23a548\") " pod="openshift-insights/insights-runtime-extractor-kflcd"
Jul 14 19:15:12.306311 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:12.306288    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/44bb8ebf-72e6-435c-8a36-332fbf23a548-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kflcd\" (UID: \"44bb8ebf-72e6-435c-8a36-332fbf23a548\") " pod="openshift-insights/insights-runtime-extractor-kflcd"
Jul 14 19:15:12.384850 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:12.384833    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-kflcd"
Jul 14 19:15:12.504798 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:12.504771    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-kflcd"]
Jul 14 19:15:12.507884 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:15:12.507859    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44bb8ebf_72e6_435c_8a36_332fbf23a548.slice/crio-b59bdfba5cf07797113856643b6c83c83db2c2972fb6a203c76facddd6181702 WatchSource:0}: Error finding container b59bdfba5cf07797113856643b6c83c83db2c2972fb6a203c76facddd6181702: Status 404 returned error can't find the container with id b59bdfba5cf07797113856643b6c83c83db2c2972fb6a203c76facddd6181702
Jul 14 19:15:12.689342 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:12.689273    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-kflcd" event={"ID":"44bb8ebf-72e6-435c-8a36-332fbf23a548","Type":"ContainerStarted","Data":"b59bdfba5cf07797113856643b6c83c83db2c2972fb6a203c76facddd6181702"}
Jul 14 19:15:14.963213 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:14.963109    2565 scope.go:117] "RemoveContainer" containerID="fe0a9b2fc8baa493d8b0f207a01bcd1be931fc344d4d0159bf9c0ba017988397"
Jul 14 19:15:16.706960 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:16.706941    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-p5lb5_7ab60b2b-a644-4e35-b8b1-49c676e0f63f/console-operator/1.log"
Jul 14 19:15:16.707263 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:16.707044    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-p5lb5" event={"ID":"7ab60b2b-a644-4e35-b8b1-49c676e0f63f","Type":"ContainerStarted","Data":"a9c55ab89d80612b3f0686245a8194a0e08c82dd05fb34c990a56752afcd89d7"}
Jul 14 19:15:16.707384 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:16.707369    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-p5lb5"
Jul 14 19:15:16.708610 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:16.708587    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-kflcd" event={"ID":"44bb8ebf-72e6-435c-8a36-332fbf23a548","Type":"ContainerStarted","Data":"bd0351ea44d1e7274459b9192454c2446cd95d4f84a1a1c1b333a1bfdb55447f"}
Jul 14 19:15:16.708680 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:16.708642    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-kflcd" event={"ID":"44bb8ebf-72e6-435c-8a36-332fbf23a548","Type":"ContainerStarted","Data":"9c78ceb709de81c51c22715be7fd16e66095cfb4553169c2305aeec116734abe"}
Jul 14 19:15:16.712103 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:16.712087    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-7866497494-p5lb5"
Jul 14 19:15:16.727613 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:16.727567    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-7866497494-p5lb5" podStartSLOduration=23.896841821 podStartE2EDuration="25.727555078s" totalImagesPullingTime="1.830713257s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 19:14:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:15:16.725919661 +0000 UTC m=+263.286776574" watchObservedRunningTime="2026-07-14 19:15:16.727555078 +0000 UTC m=+263.288411969"
Jul 14 19:15:19.720391 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:19.720359    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-kflcd" event={"ID":"44bb8ebf-72e6-435c-8a36-332fbf23a548","Type":"ContainerStarted","Data":"daadae2f155fe39ce2c48a99e8cec47d916ffd2c82594054fa81bad0b54344b6"}
Jul 14 19:15:19.741954 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:19.741911    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-kflcd" podStartSLOduration=17.175330858 podStartE2EDuration="23.741898494s" totalImagesPullingTime="6.566567636s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 19:14:56 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:15:19.740931619 +0000 UTC m=+266.301788522" watchObservedRunningTime="2026-07-14 19:15:19.741898494 +0000 UTC m=+266.302755384"
Jul 14 19:15:21.697952 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:21.697922    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-d858f7db9-cnzfq"]
Jul 14 19:15:21.741287 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:21.741256    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-68c9cbb497-dbsmm"]
Jul 14 19:15:21.743248 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:21.743232    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-68c9cbb497-dbsmm"
Jul 14 19:15:21.746397 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:21.746375    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 14 19:15:21.746644 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:21.746630    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 14 19:15:21.746945 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:21.746928    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-4wv2j"]
Jul 14 19:15:21.747283 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:21.747267    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-6jc5j\""
Jul 14 19:15:21.748746 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:21.748723    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-4wv2j"
Jul 14 19:15:21.758368 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:15:21.758340    2565 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"prometheus-operator-admission-webhook-tls\" is forbidden: User \"system:node:ip-10-0-129-23.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-monitoring\": no relationship found between node 'ip-10-0-129-23.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" type="*v1.Secret"
Jul 14 19:15:21.758477 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:15:21.758388    2565 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"prometheus-operator-admission-webhook-dockercfg-dwgnx\" is forbidden: User \"system:node:ip-10-0-129-23.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-monitoring\": no relationship found between node 'ip-10-0-129-23.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-dwgnx\"" type="*v1.Secret"
Jul 14 19:15:21.766192 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:21.766170    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-4wv2j"]
Jul 14 19:15:21.767272 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:21.767252    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-68c9cbb497-dbsmm"]
Jul 14 19:15:21.878633 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:21.878605    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pfjh7\" (UniqueName: \"kubernetes.io/projected/bbcea941-8508-4926-89fd-e4df1191df74-kube-api-access-pfjh7\") pod \"downloads-68c9cbb497-dbsmm\" (UID: \"bbcea941-8508-4926-89fd-e4df1191df74\") " pod="openshift-console/downloads-68c9cbb497-dbsmm"
Jul 14 19:15:21.878772 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:21.878639    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/067a3776-b83c-4132-a75e-da5bcef23f4a-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-4wv2j\" (UID: \"067a3776-b83c-4132-a75e-da5bcef23f4a\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-4wv2j"
Jul 14 19:15:21.979637 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:21.979612    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pfjh7\" (UniqueName: \"kubernetes.io/projected/bbcea941-8508-4926-89fd-e4df1191df74-kube-api-access-pfjh7\") pod \"downloads-68c9cbb497-dbsmm\" (UID: \"bbcea941-8508-4926-89fd-e4df1191df74\") " pod="openshift-console/downloads-68c9cbb497-dbsmm"
Jul 14 19:15:21.979751 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:21.979648    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/067a3776-b83c-4132-a75e-da5bcef23f4a-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-4wv2j\" (UID: \"067a3776-b83c-4132-a75e-da5bcef23f4a\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-4wv2j"
Jul 14 19:15:21.991012 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:21.990979    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pfjh7\" (UniqueName: \"kubernetes.io/projected/bbcea941-8508-4926-89fd-e4df1191df74-kube-api-access-pfjh7\") pod \"downloads-68c9cbb497-dbsmm\" (UID: \"bbcea941-8508-4926-89fd-e4df1191df74\") " pod="openshift-console/downloads-68c9cbb497-dbsmm"
Jul 14 19:15:22.056811 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:22.056785    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-68c9cbb497-dbsmm"
Jul 14 19:15:22.178811 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:22.178778    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-68c9cbb497-dbsmm"]
Jul 14 19:15:22.182512 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:15:22.182488    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbbcea941_8508_4926_89fd_e4df1191df74.slice/crio-761e6b02cae8faa8bc590ef6ccc8f4f7ad90c41b32f21da5e5c7511da96d96b0 WatchSource:0}: Error finding container 761e6b02cae8faa8bc590ef6ccc8f4f7ad90c41b32f21da5e5c7511da96d96b0: Status 404 returned error can't find the container with id 761e6b02cae8faa8bc590ef6ccc8f4f7ad90c41b32f21da5e5c7511da96d96b0
Jul 14 19:15:22.730361 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:22.730327    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-68c9cbb497-dbsmm" event={"ID":"bbcea941-8508-4926-89fd-e4df1191df74","Type":"ContainerStarted","Data":"761e6b02cae8faa8bc590ef6ccc8f4f7ad90c41b32f21da5e5c7511da96d96b0"}
Jul 14 19:15:22.799167 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:22.799127    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-dwgnx\""
Jul 14 19:15:22.868169 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:22.868125    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Jul 14 19:15:22.872726 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:22.872700    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/067a3776-b83c-4132-a75e-da5bcef23f4a-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-4wv2j\" (UID: \"067a3776-b83c-4132-a75e-da5bcef23f4a\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-4wv2j"
Jul 14 19:15:22.961018 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:22.960990    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-4wv2j"
Jul 14 19:15:23.096313 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:23.096216    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-4wv2j"]
Jul 14 19:15:23.098836 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:15:23.098797    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod067a3776_b83c_4132_a75e_da5bcef23f4a.slice/crio-e103e415508640c2eb6112a266f5e0a7250e9260a666c0a8eea7610e7f2ac822 WatchSource:0}: Error finding container e103e415508640c2eb6112a266f5e0a7250e9260a666c0a8eea7610e7f2ac822: Status 404 returned error can't find the container with id e103e415508640c2eb6112a266f5e0a7250e9260a666c0a8eea7610e7f2ac822
Jul 14 19:15:23.393248 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:23.393173    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/13fae2a1-59f5-4880-8045-12b6ce931d3f-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-9bkzn\" (UID: \"13fae2a1-59f5-4880-8045-12b6ce931d3f\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-9bkzn"
Jul 14 19:15:23.395911 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:23.395884    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/13fae2a1-59f5-4880-8045-12b6ce931d3f-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-9bkzn\" (UID: \"13fae2a1-59f5-4880-8045-12b6ce931d3f\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-9bkzn"
Jul 14 19:15:23.687018 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:23.686923    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-mq7g2\""
Jul 14 19:15:23.695102 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:23.695057    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cf856758c-9bkzn"
Jul 14 19:15:23.736743 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:23.736704    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-4wv2j" event={"ID":"067a3776-b83c-4132-a75e-da5bcef23f4a","Type":"ContainerStarted","Data":"e103e415508640c2eb6112a266f5e0a7250e9260a666c0a8eea7610e7f2ac822"}
Jul 14 19:15:23.833955 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:23.833906    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-9bkzn"]
Jul 14 19:15:23.837946 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:15:23.837917    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13fae2a1_59f5_4880_8045_12b6ce931d3f.slice/crio-d2475497cf1d660e4ee67f276b4a29165cc8653b78bc29f40a096ade5a7099c2 WatchSource:0}: Error finding container d2475497cf1d660e4ee67f276b4a29165cc8653b78bc29f40a096ade5a7099c2: Status 404 returned error can't find the container with id d2475497cf1d660e4ee67f276b4a29165cc8653b78bc29f40a096ade5a7099c2
Jul 14 19:15:24.740559 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:24.740526    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6cf856758c-9bkzn" event={"ID":"13fae2a1-59f5-4880-8045-12b6ce931d3f","Type":"ContainerStarted","Data":"d2475497cf1d660e4ee67f276b4a29165cc8653b78bc29f40a096ade5a7099c2"}
Jul 14 19:15:24.741906 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:24.741883    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-4wv2j" event={"ID":"067a3776-b83c-4132-a75e-da5bcef23f4a","Type":"ContainerStarted","Data":"999a120d331863cf0d5f06dc6799b587b63a18d83151d9b5e602cff492575558"}
Jul 14 19:15:24.742226 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:24.742208    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-4wv2j"
Jul 14 19:15:24.746252 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:24.746228    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-4wv2j"
Jul 14 19:15:24.759227 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:24.759192    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-4wv2j" podStartSLOduration=2.655650731 podStartE2EDuration="3.759180475s" totalImagesPullingTime="1.103529744s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 19:15:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:15:24.758289323 +0000 UTC m=+271.319146233" watchObservedRunningTime="2026-07-14 19:15:24.759180475 +0000 UTC m=+271.320037344"
Jul 14 19:15:25.458904 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:25.458881    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-b8jsk"]
Jul 14 19:15:25.463087 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:25.463046    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-64785b6675-b8jsk"
Jul 14 19:15:25.466992 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:25.466958    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 14 19:15:25.466992 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:25.466961    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 14 19:15:25.467226 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:25.467023    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Jul 14 19:15:25.467226 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:25.467060    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Jul 14 19:15:25.467226 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:25.466961    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 14 19:15:25.467357 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:25.467343    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-jx6bd\""
Jul 14 19:15:25.471341 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:25.471322    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-b8jsk"]
Jul 14 19:15:25.609664 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:25.609635    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f722f05c-64a7-4bb3-ab0b-24d6c56c3e5a-metrics-client-ca\") pod \"prometheus-operator-64785b6675-b8jsk\" (UID: \"f722f05c-64a7-4bb3-ab0b-24d6c56c3e5a\") " pod="openshift-monitoring/prometheus-operator-64785b6675-b8jsk"
Jul 14 19:15:25.609802 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:25.609673    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/f722f05c-64a7-4bb3-ab0b-24d6c56c3e5a-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-b8jsk\" (UID: \"f722f05c-64a7-4bb3-ab0b-24d6c56c3e5a\") " pod="openshift-monitoring/prometheus-operator-64785b6675-b8jsk"
Jul 14 19:15:25.609802 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:25.609755    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f722f05c-64a7-4bb3-ab0b-24d6c56c3e5a-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-b8jsk\" (UID: \"f722f05c-64a7-4bb3-ab0b-24d6c56c3e5a\") " pod="openshift-monitoring/prometheus-operator-64785b6675-b8jsk"
Jul 14 19:15:25.609899 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:25.609824    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b65q4\" (UniqueName: \"kubernetes.io/projected/f722f05c-64a7-4bb3-ab0b-24d6c56c3e5a-kube-api-access-b65q4\") pod \"prometheus-operator-64785b6675-b8jsk\" (UID: \"f722f05c-64a7-4bb3-ab0b-24d6c56c3e5a\") " pod="openshift-monitoring/prometheus-operator-64785b6675-b8jsk"
Jul 14 19:15:25.711078 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:25.711010    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f722f05c-64a7-4bb3-ab0b-24d6c56c3e5a-metrics-client-ca\") pod \"prometheus-operator-64785b6675-b8jsk\" (UID: \"f722f05c-64a7-4bb3-ab0b-24d6c56c3e5a\") " pod="openshift-monitoring/prometheus-operator-64785b6675-b8jsk"
Jul 14 19:15:25.711078 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:25.711052    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/f722f05c-64a7-4bb3-ab0b-24d6c56c3e5a-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-b8jsk\" (UID: \"f722f05c-64a7-4bb3-ab0b-24d6c56c3e5a\") " pod="openshift-monitoring/prometheus-operator-64785b6675-b8jsk"
Jul 14 19:15:25.711282 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:25.711096    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f722f05c-64a7-4bb3-ab0b-24d6c56c3e5a-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-b8jsk\" (UID: \"f722f05c-64a7-4bb3-ab0b-24d6c56c3e5a\") " pod="openshift-monitoring/prometheus-operator-64785b6675-b8jsk"
Jul 14 19:15:25.711282 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:25.711129    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b65q4\" (UniqueName: \"kubernetes.io/projected/f722f05c-64a7-4bb3-ab0b-24d6c56c3e5a-kube-api-access-b65q4\") pod \"prometheus-operator-64785b6675-b8jsk\" (UID: \"f722f05c-64a7-4bb3-ab0b-24d6c56c3e5a\") " pod="openshift-monitoring/prometheus-operator-64785b6675-b8jsk"
Jul 14 19:15:25.712140 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:25.712111    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f722f05c-64a7-4bb3-ab0b-24d6c56c3e5a-metrics-client-ca\") pod \"prometheus-operator-64785b6675-b8jsk\" (UID: \"f722f05c-64a7-4bb3-ab0b-24d6c56c3e5a\") " pod="openshift-monitoring/prometheus-operator-64785b6675-b8jsk"
Jul 14 19:15:25.713873 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:25.713843    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f722f05c-64a7-4bb3-ab0b-24d6c56c3e5a-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-b8jsk\" (UID: \"f722f05c-64a7-4bb3-ab0b-24d6c56c3e5a\") " pod="openshift-monitoring/prometheus-operator-64785b6675-b8jsk"
Jul 14 19:15:25.713969 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:25.713842    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/f722f05c-64a7-4bb3-ab0b-24d6c56c3e5a-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-b8jsk\" (UID: \"f722f05c-64a7-4bb3-ab0b-24d6c56c3e5a\") " pod="openshift-monitoring/prometheus-operator-64785b6675-b8jsk"
Jul 14 19:15:25.720067 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:25.720045    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b65q4\" (UniqueName: \"kubernetes.io/projected/f722f05c-64a7-4bb3-ab0b-24d6c56c3e5a-kube-api-access-b65q4\") pod \"prometheus-operator-64785b6675-b8jsk\" (UID: \"f722f05c-64a7-4bb3-ab0b-24d6c56c3e5a\") " pod="openshift-monitoring/prometheus-operator-64785b6675-b8jsk"
Jul 14 19:15:25.747483 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:25.747450    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6cf856758c-9bkzn" event={"ID":"13fae2a1-59f5-4880-8045-12b6ce931d3f","Type":"ContainerStarted","Data":"49ddc30b47b04fb7685c0143c227b1b4410b4423ab7e41ed4fd4249a643eec17"}
Jul 14 19:15:25.763020 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:25.762975    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6cf856758c-9bkzn" podStartSLOduration=33.167806321 podStartE2EDuration="34.762958883s" totalImagesPullingTime="1.595152562s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 19:14:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:15:25.762672041 +0000 UTC m=+272.323528929" watchObservedRunningTime="2026-07-14 19:15:25.762958883 +0000 UTC m=+272.323815775"
Jul 14 19:15:25.784993 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:25.784973    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-64785b6675-b8jsk"
Jul 14 19:15:25.925947 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:25.925919    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-b8jsk"]
Jul 14 19:15:25.929019 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:15:25.928994    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf722f05c_64a7_4bb3_ab0b_24d6c56c3e5a.slice/crio-f9651a2d13f36ea0799c39d9efa76e9b80b0fe2ccecaa4a684dd837e5ee71d50 WatchSource:0}: Error finding container f9651a2d13f36ea0799c39d9efa76e9b80b0fe2ccecaa4a684dd837e5ee71d50: Status 404 returned error can't find the container with id f9651a2d13f36ea0799c39d9efa76e9b80b0fe2ccecaa4a684dd837e5ee71d50
Jul 14 19:15:26.752142 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:26.752103    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-b8jsk" event={"ID":"f722f05c-64a7-4bb3-ab0b-24d6c56c3e5a","Type":"ContainerStarted","Data":"f9651a2d13f36ea0799c39d9efa76e9b80b0fe2ccecaa4a684dd837e5ee71d50"}
Jul 14 19:15:31.636382 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:31.636350    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-848497c6b9-89ks6"]
Jul 14 19:15:31.667700 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:31.667639    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-848497c6b9-89ks6"]
Jul 14 19:15:31.667817 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:31.667749    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-848497c6b9-89ks6"
Jul 14 19:15:31.670581 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:31.670562    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 14 19:15:31.670698 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:31.670610    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 14 19:15:31.670854 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:31.670834    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 14 19:15:31.671064 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:31.671020    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 14 19:15:31.671747 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:31.671708    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-s9s5l\""
Jul 14 19:15:31.671747 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:31.671735    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 14 19:15:31.680048 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:31.680029    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 14 19:15:31.702282 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:31.702260    2565 patch_prober.go:28] interesting pod/image-registry-d858f7db9-cnzfq container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 14 19:15:31.702374 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:31.702302    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-d858f7db9-cnzfq" podUID="4c01c8da-c276-4b74-8f64-16bdc3e0237a" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 14 19:15:31.759796 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:31.759755    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/45d99327-6ee9-4fa6-ba50-07cfe6b6c15f-console-oauth-config\") pod \"console-848497c6b9-89ks6\" (UID: \"45d99327-6ee9-4fa6-ba50-07cfe6b6c15f\") " pod="openshift-console/console-848497c6b9-89ks6"
Jul 14 19:15:31.759921 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:31.759801    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/45d99327-6ee9-4fa6-ba50-07cfe6b6c15f-console-config\") pod \"console-848497c6b9-89ks6\" (UID: \"45d99327-6ee9-4fa6-ba50-07cfe6b6c15f\") " pod="openshift-console/console-848497c6b9-89ks6"
Jul 14 19:15:31.759921 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:31.759859    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/45d99327-6ee9-4fa6-ba50-07cfe6b6c15f-trusted-ca-bundle\") pod \"console-848497c6b9-89ks6\" (UID: \"45d99327-6ee9-4fa6-ba50-07cfe6b6c15f\") " pod="openshift-console/console-848497c6b9-89ks6"
Jul 14 19:15:31.759921 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:31.759892    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/45d99327-6ee9-4fa6-ba50-07cfe6b6c15f-oauth-serving-cert\") pod \"console-848497c6b9-89ks6\" (UID: \"45d99327-6ee9-4fa6-ba50-07cfe6b6c15f\") " pod="openshift-console/console-848497c6b9-89ks6"
Jul 14 19:15:31.760197 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:31.759939    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jbk8s\" (UniqueName: \"kubernetes.io/projected/45d99327-6ee9-4fa6-ba50-07cfe6b6c15f-kube-api-access-jbk8s\") pod \"console-848497c6b9-89ks6\" (UID: \"45d99327-6ee9-4fa6-ba50-07cfe6b6c15f\") " pod="openshift-console/console-848497c6b9-89ks6"
Jul 14 19:15:31.760197 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:31.759967    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/45d99327-6ee9-4fa6-ba50-07cfe6b6c15f-service-ca\") pod \"console-848497c6b9-89ks6\" (UID: \"45d99327-6ee9-4fa6-ba50-07cfe6b6c15f\") " pod="openshift-console/console-848497c6b9-89ks6"
Jul 14 19:15:31.760197 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:31.760012    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/45d99327-6ee9-4fa6-ba50-07cfe6b6c15f-console-serving-cert\") pod \"console-848497c6b9-89ks6\" (UID: \"45d99327-6ee9-4fa6-ba50-07cfe6b6c15f\") " pod="openshift-console/console-848497c6b9-89ks6"
Jul 14 19:15:31.773026 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:31.772998    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-b8jsk" event={"ID":"f722f05c-64a7-4bb3-ab0b-24d6c56c3e5a","Type":"ContainerStarted","Data":"a6132f50a11a46f1f065bdd12457d1c214f89d0841ddb232326a89c84fbc3572"}
Jul 14 19:15:31.861216 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:31.861184    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/45d99327-6ee9-4fa6-ba50-07cfe6b6c15f-oauth-serving-cert\") pod \"console-848497c6b9-89ks6\" (UID: \"45d99327-6ee9-4fa6-ba50-07cfe6b6c15f\") " pod="openshift-console/console-848497c6b9-89ks6"
Jul 14 19:15:31.861374 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:31.861236    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jbk8s\" (UniqueName: \"kubernetes.io/projected/45d99327-6ee9-4fa6-ba50-07cfe6b6c15f-kube-api-access-jbk8s\") pod \"console-848497c6b9-89ks6\" (UID: \"45d99327-6ee9-4fa6-ba50-07cfe6b6c15f\") " pod="openshift-console/console-848497c6b9-89ks6"
Jul 14 19:15:31.861374 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:31.861254    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/45d99327-6ee9-4fa6-ba50-07cfe6b6c15f-service-ca\") pod \"console-848497c6b9-89ks6\" (UID: \"45d99327-6ee9-4fa6-ba50-07cfe6b6c15f\") " pod="openshift-console/console-848497c6b9-89ks6"
Jul 14 19:15:31.861374 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:31.861282    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/45d99327-6ee9-4fa6-ba50-07cfe6b6c15f-console-serving-cert\") pod \"console-848497c6b9-89ks6\" (UID: \"45d99327-6ee9-4fa6-ba50-07cfe6b6c15f\") " pod="openshift-console/console-848497c6b9-89ks6"
Jul 14 19:15:31.861374 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:31.861312    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/45d99327-6ee9-4fa6-ba50-07cfe6b6c15f-console-oauth-config\") pod \"console-848497c6b9-89ks6\" (UID: \"45d99327-6ee9-4fa6-ba50-07cfe6b6c15f\") " pod="openshift-console/console-848497c6b9-89ks6"
Jul 14 19:15:31.861374 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:31.861330    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/45d99327-6ee9-4fa6-ba50-07cfe6b6c15f-console-config\") pod \"console-848497c6b9-89ks6\" (UID: \"45d99327-6ee9-4fa6-ba50-07cfe6b6c15f\") " pod="openshift-console/console-848497c6b9-89ks6"
Jul 14 19:15:31.861374 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:31.861363    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/45d99327-6ee9-4fa6-ba50-07cfe6b6c15f-trusted-ca-bundle\") pod \"console-848497c6b9-89ks6\" (UID: \"45d99327-6ee9-4fa6-ba50-07cfe6b6c15f\") " pod="openshift-console/console-848497c6b9-89ks6"
Jul 14 19:15:31.862181 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:31.862089    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/45d99327-6ee9-4fa6-ba50-07cfe6b6c15f-service-ca\") pod \"console-848497c6b9-89ks6\" (UID: \"45d99327-6ee9-4fa6-ba50-07cfe6b6c15f\") " pod="openshift-console/console-848497c6b9-89ks6"
Jul 14 19:15:31.862455 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:31.862267    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/45d99327-6ee9-4fa6-ba50-07cfe6b6c15f-trusted-ca-bundle\") pod \"console-848497c6b9-89ks6\" (UID: \"45d99327-6ee9-4fa6-ba50-07cfe6b6c15f\") " pod="openshift-console/console-848497c6b9-89ks6"
Jul 14 19:15:31.862671 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:31.862598    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/45d99327-6ee9-4fa6-ba50-07cfe6b6c15f-oauth-serving-cert\") pod \"console-848497c6b9-89ks6\" (UID: \"45d99327-6ee9-4fa6-ba50-07cfe6b6c15f\") " pod="openshift-console/console-848497c6b9-89ks6"
Jul 14 19:15:31.862775 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:31.862689    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/45d99327-6ee9-4fa6-ba50-07cfe6b6c15f-console-config\") pod \"console-848497c6b9-89ks6\" (UID: \"45d99327-6ee9-4fa6-ba50-07cfe6b6c15f\") " pod="openshift-console/console-848497c6b9-89ks6"
Jul 14 19:15:31.864626 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:31.864570    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/45d99327-6ee9-4fa6-ba50-07cfe6b6c15f-console-serving-cert\") pod \"console-848497c6b9-89ks6\" (UID: \"45d99327-6ee9-4fa6-ba50-07cfe6b6c15f\") " pod="openshift-console/console-848497c6b9-89ks6"
Jul 14 19:15:31.865699 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:31.865676    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/45d99327-6ee9-4fa6-ba50-07cfe6b6c15f-console-oauth-config\") pod \"console-848497c6b9-89ks6\" (UID: \"45d99327-6ee9-4fa6-ba50-07cfe6b6c15f\") " pod="openshift-console/console-848497c6b9-89ks6"
Jul 14 19:15:31.870273 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:31.870254    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jbk8s\" (UniqueName: \"kubernetes.io/projected/45d99327-6ee9-4fa6-ba50-07cfe6b6c15f-kube-api-access-jbk8s\") pod \"console-848497c6b9-89ks6\" (UID: \"45d99327-6ee9-4fa6-ba50-07cfe6b6c15f\") " pod="openshift-console/console-848497c6b9-89ks6"
Jul 14 19:15:31.982667 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:31.982635    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-848497c6b9-89ks6"
Jul 14 19:15:32.141481 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:32.141448    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-848497c6b9-89ks6"]
Jul 14 19:15:32.144987 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:15:32.144957    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45d99327_6ee9_4fa6_ba50_07cfe6b6c15f.slice/crio-95fa2b44908bcb60919384eba2dab7991c6121fd86152b600f20219235c5f6b2 WatchSource:0}: Error finding container 95fa2b44908bcb60919384eba2dab7991c6121fd86152b600f20219235c5f6b2: Status 404 returned error can't find the container with id 95fa2b44908bcb60919384eba2dab7991c6121fd86152b600f20219235c5f6b2
Jul 14 19:15:32.780358 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:32.780305    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-b8jsk" event={"ID":"f722f05c-64a7-4bb3-ab0b-24d6c56c3e5a","Type":"ContainerStarted","Data":"4940ea153b0ea7b64da181814da4ce3f219b41c6fb5815af5bc6fe9e2e712497"}
Jul 14 19:15:32.781873 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:32.781832    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-848497c6b9-89ks6" event={"ID":"45d99327-6ee9-4fa6-ba50-07cfe6b6c15f","Type":"ContainerStarted","Data":"95fa2b44908bcb60919384eba2dab7991c6121fd86152b600f20219235c5f6b2"}
Jul 14 19:15:32.797566 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:32.797512    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-64785b6675-b8jsk" podStartSLOduration=2.198110058 podStartE2EDuration="7.797496926s" totalImagesPullingTime="5.599386868s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 19:15:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:15:32.796950156 +0000 UTC m=+279.357807048" watchObservedRunningTime="2026-07-14 19:15:32.797496926 +0000 UTC m=+279.358353817"
Jul 14 19:15:34.961092 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:34.961058    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-lpsw7"]
Jul 14 19:15:34.979889 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:34.979864    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-lpsw7"
Jul 14 19:15:34.983209 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:34.983187    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-vnvln\""
Jul 14 19:15:34.984214 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:34.984194    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 14 19:15:34.984342 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:34.984241    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 14 19:15:34.984342 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:34.984253    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 14 19:15:35.087776 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:35.087744    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/86cc3494-b30a-4c30-9000-bf048d51f7e2-node-exporter-wtmp\") pod \"node-exporter-lpsw7\" (UID: \"86cc3494-b30a-4c30-9000-bf048d51f7e2\") " pod="openshift-monitoring/node-exporter-lpsw7"
Jul 14 19:15:35.087902 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:35.087785    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/86cc3494-b30a-4c30-9000-bf048d51f7e2-node-exporter-accelerators-collector-config\") pod \"node-exporter-lpsw7\" (UID: \"86cc3494-b30a-4c30-9000-bf048d51f7e2\") " pod="openshift-monitoring/node-exporter-lpsw7"
Jul 14 19:15:35.087902 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:35.087803    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/86cc3494-b30a-4c30-9000-bf048d51f7e2-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-lpsw7\" (UID: \"86cc3494-b30a-4c30-9000-bf048d51f7e2\") " pod="openshift-monitoring/node-exporter-lpsw7"
Jul 14 19:15:35.087992 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:35.087893    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/86cc3494-b30a-4c30-9000-bf048d51f7e2-metrics-client-ca\") pod \"node-exporter-lpsw7\" (UID: \"86cc3494-b30a-4c30-9000-bf048d51f7e2\") " pod="openshift-monitoring/node-exporter-lpsw7"
Jul 14 19:15:35.087992 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:35.087925    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/86cc3494-b30a-4c30-9000-bf048d51f7e2-node-exporter-tls\") pod \"node-exporter-lpsw7\" (UID: \"86cc3494-b30a-4c30-9000-bf048d51f7e2\") " pod="openshift-monitoring/node-exporter-lpsw7"
Jul 14 19:15:35.087992 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:35.087942    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dqzpm\" (UniqueName: \"kubernetes.io/projected/86cc3494-b30a-4c30-9000-bf048d51f7e2-kube-api-access-dqzpm\") pod \"node-exporter-lpsw7\" (UID: \"86cc3494-b30a-4c30-9000-bf048d51f7e2\") " pod="openshift-monitoring/node-exporter-lpsw7"
Jul 14 19:15:35.087992 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:35.087966    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/86cc3494-b30a-4c30-9000-bf048d51f7e2-node-exporter-textfile\") pod \"node-exporter-lpsw7\" (UID: \"86cc3494-b30a-4c30-9000-bf048d51f7e2\") " pod="openshift-monitoring/node-exporter-lpsw7"
Jul 14 19:15:35.088175 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:35.088026    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/86cc3494-b30a-4c30-9000-bf048d51f7e2-root\") pod \"node-exporter-lpsw7\" (UID: \"86cc3494-b30a-4c30-9000-bf048d51f7e2\") " pod="openshift-monitoring/node-exporter-lpsw7"
Jul 14 19:15:35.088175 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:35.088060    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/86cc3494-b30a-4c30-9000-bf048d51f7e2-sys\") pod \"node-exporter-lpsw7\" (UID: \"86cc3494-b30a-4c30-9000-bf048d51f7e2\") " pod="openshift-monitoring/node-exporter-lpsw7"
Jul 14 19:15:35.188439 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:35.188410    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/86cc3494-b30a-4c30-9000-bf048d51f7e2-metrics-client-ca\") pod \"node-exporter-lpsw7\" (UID: \"86cc3494-b30a-4c30-9000-bf048d51f7e2\") " pod="openshift-monitoring/node-exporter-lpsw7"
Jul 14 19:15:35.188610 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:35.188451    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/86cc3494-b30a-4c30-9000-bf048d51f7e2-node-exporter-tls\") pod \"node-exporter-lpsw7\" (UID: \"86cc3494-b30a-4c30-9000-bf048d51f7e2\") " pod="openshift-monitoring/node-exporter-lpsw7"
Jul 14 19:15:35.188610 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:35.188480    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dqzpm\" (UniqueName: \"kubernetes.io/projected/86cc3494-b30a-4c30-9000-bf048d51f7e2-kube-api-access-dqzpm\") pod \"node-exporter-lpsw7\" (UID: \"86cc3494-b30a-4c30-9000-bf048d51f7e2\") " pod="openshift-monitoring/node-exporter-lpsw7"
Jul 14 19:15:35.188610 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:35.188508    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/86cc3494-b30a-4c30-9000-bf048d51f7e2-node-exporter-textfile\") pod \"node-exporter-lpsw7\" (UID: \"86cc3494-b30a-4c30-9000-bf048d51f7e2\") " pod="openshift-monitoring/node-exporter-lpsw7"
Jul 14 19:15:35.188610 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:35.188546    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/86cc3494-b30a-4c30-9000-bf048d51f7e2-root\") pod \"node-exporter-lpsw7\" (UID: \"86cc3494-b30a-4c30-9000-bf048d51f7e2\") " pod="openshift-monitoring/node-exporter-lpsw7"
Jul 14 19:15:35.188610 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:35.188579    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/86cc3494-b30a-4c30-9000-bf048d51f7e2-sys\") pod \"node-exporter-lpsw7\" (UID: \"86cc3494-b30a-4c30-9000-bf048d51f7e2\") " pod="openshift-monitoring/node-exporter-lpsw7"
Jul 14 19:15:35.188610 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:15:35.188581    2565 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 14 19:15:35.188889 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:35.188620    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/86cc3494-b30a-4c30-9000-bf048d51f7e2-node-exporter-wtmp\") pod \"node-exporter-lpsw7\" (UID: \"86cc3494-b30a-4c30-9000-bf048d51f7e2\") " pod="openshift-monitoring/node-exporter-lpsw7"
Jul 14 19:15:35.188889 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:35.188660    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/86cc3494-b30a-4c30-9000-bf048d51f7e2-node-exporter-accelerators-collector-config\") pod \"node-exporter-lpsw7\" (UID: \"86cc3494-b30a-4c30-9000-bf048d51f7e2\") " pod="openshift-monitoring/node-exporter-lpsw7"
Jul 14 19:15:35.188889 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:15:35.188672    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/86cc3494-b30a-4c30-9000-bf048d51f7e2-node-exporter-tls podName:86cc3494-b30a-4c30-9000-bf048d51f7e2 nodeName:}" failed. No retries permitted until 2026-07-14 19:15:35.688652561 +0000 UTC m=+282.249509444 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/86cc3494-b30a-4c30-9000-bf048d51f7e2-node-exporter-tls") pod "node-exporter-lpsw7" (UID: "86cc3494-b30a-4c30-9000-bf048d51f7e2") : secret "node-exporter-tls" not found
Jul 14 19:15:35.188889 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:35.188708    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/86cc3494-b30a-4c30-9000-bf048d51f7e2-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-lpsw7\" (UID: \"86cc3494-b30a-4c30-9000-bf048d51f7e2\") " pod="openshift-monitoring/node-exporter-lpsw7"
Jul 14 19:15:35.188889 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:35.188706    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/86cc3494-b30a-4c30-9000-bf048d51f7e2-root\") pod \"node-exporter-lpsw7\" (UID: \"86cc3494-b30a-4c30-9000-bf048d51f7e2\") " pod="openshift-monitoring/node-exporter-lpsw7"
Jul 14 19:15:35.188889 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:35.188749    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/86cc3494-b30a-4c30-9000-bf048d51f7e2-sys\") pod \"node-exporter-lpsw7\" (UID: \"86cc3494-b30a-4c30-9000-bf048d51f7e2\") " pod="openshift-monitoring/node-exporter-lpsw7"
Jul 14 19:15:35.188889 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:35.188883    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/86cc3494-b30a-4c30-9000-bf048d51f7e2-node-exporter-wtmp\") pod \"node-exporter-lpsw7\" (UID: \"86cc3494-b30a-4c30-9000-bf048d51f7e2\") " pod="openshift-monitoring/node-exporter-lpsw7"
Jul 14 19:15:35.189220 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:35.189096    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/86cc3494-b30a-4c30-9000-bf048d51f7e2-metrics-client-ca\") pod \"node-exporter-lpsw7\" (UID: \"86cc3494-b30a-4c30-9000-bf048d51f7e2\") " pod="openshift-monitoring/node-exporter-lpsw7"
Jul 14 19:15:35.189220 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:35.189096    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/86cc3494-b30a-4c30-9000-bf048d51f7e2-node-exporter-accelerators-collector-config\") pod \"node-exporter-lpsw7\" (UID: \"86cc3494-b30a-4c30-9000-bf048d51f7e2\") " pod="openshift-monitoring/node-exporter-lpsw7"
Jul 14 19:15:35.189305 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:35.189279    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/86cc3494-b30a-4c30-9000-bf048d51f7e2-node-exporter-textfile\") pod \"node-exporter-lpsw7\" (UID: \"86cc3494-b30a-4c30-9000-bf048d51f7e2\") " pod="openshift-monitoring/node-exporter-lpsw7"
Jul 14 19:15:35.191376 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:35.191342    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/86cc3494-b30a-4c30-9000-bf048d51f7e2-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-lpsw7\" (UID: \"86cc3494-b30a-4c30-9000-bf048d51f7e2\") " pod="openshift-monitoring/node-exporter-lpsw7"
Jul 14 19:15:35.198664 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:35.198647    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dqzpm\" (UniqueName: \"kubernetes.io/projected/86cc3494-b30a-4c30-9000-bf048d51f7e2-kube-api-access-dqzpm\") pod \"node-exporter-lpsw7\" (UID: \"86cc3494-b30a-4c30-9000-bf048d51f7e2\") " pod="openshift-monitoring/node-exporter-lpsw7"
Jul 14 19:15:35.692936 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:35.692899    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/86cc3494-b30a-4c30-9000-bf048d51f7e2-node-exporter-tls\") pod \"node-exporter-lpsw7\" (UID: \"86cc3494-b30a-4c30-9000-bf048d51f7e2\") " pod="openshift-monitoring/node-exporter-lpsw7"
Jul 14 19:15:35.693096 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:15:35.693053    2565 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 14 19:15:35.693138 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:15:35.693121    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/86cc3494-b30a-4c30-9000-bf048d51f7e2-node-exporter-tls podName:86cc3494-b30a-4c30-9000-bf048d51f7e2 nodeName:}" failed. No retries permitted until 2026-07-14 19:15:36.693104789 +0000 UTC m=+283.253961680 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/86cc3494-b30a-4c30-9000-bf048d51f7e2-node-exporter-tls") pod "node-exporter-lpsw7" (UID: "86cc3494-b30a-4c30-9000-bf048d51f7e2") : secret "node-exporter-tls" not found
Jul 14 19:15:36.701229 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:36.701189    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/86cc3494-b30a-4c30-9000-bf048d51f7e2-node-exporter-tls\") pod \"node-exporter-lpsw7\" (UID: \"86cc3494-b30a-4c30-9000-bf048d51f7e2\") " pod="openshift-monitoring/node-exporter-lpsw7"
Jul 14 19:15:36.703646 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:36.703623    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/86cc3494-b30a-4c30-9000-bf048d51f7e2-node-exporter-tls\") pod \"node-exporter-lpsw7\" (UID: \"86cc3494-b30a-4c30-9000-bf048d51f7e2\") " pod="openshift-monitoring/node-exporter-lpsw7"
Jul 14 19:15:36.790816 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:36.790789    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-lpsw7"
Jul 14 19:15:37.419914 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:15:37.419873    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-g85df" podUID="648852a8-be96-4782-bfdc-76bdce2ab8b5"
Jul 14 19:15:37.800162 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:37.800116    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-g85df"
Jul 14 19:15:37.908520 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:37.908488    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-696bc7564-826gk"]
Jul 14 19:15:37.911555 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:37.911532    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-696bc7564-826gk"
Jul 14 19:15:37.914490 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:37.914455    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Jul 14 19:15:37.914490 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:37.914480    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Jul 14 19:15:37.915038 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:37.914977    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Jul 14 19:15:37.915038 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:37.914988    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Jul 14 19:15:37.915213 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:37.914988    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-6f87pfndj0nme\""
Jul 14 19:15:37.915213 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:37.914991    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-rjt6x\""
Jul 14 19:15:37.915385 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:37.915367    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Jul 14 19:15:37.925261 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:37.925238    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-696bc7564-826gk"]
Jul 14 19:15:38.012507 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:38.012477    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/cf930f53-bb6b-43f3-8a01-7d5797b0d75f-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-696bc7564-826gk\" (UID: \"cf930f53-bb6b-43f3-8a01-7d5797b0d75f\") " pod="openshift-monitoring/thanos-querier-696bc7564-826gk"
Jul 14 19:15:38.012666 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:38.012516    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/cf930f53-bb6b-43f3-8a01-7d5797b0d75f-secret-thanos-querier-tls\") pod \"thanos-querier-696bc7564-826gk\" (UID: \"cf930f53-bb6b-43f3-8a01-7d5797b0d75f\") " pod="openshift-monitoring/thanos-querier-696bc7564-826gk"
Jul 14 19:15:38.012666 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:38.012542    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/cf930f53-bb6b-43f3-8a01-7d5797b0d75f-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-696bc7564-826gk\" (UID: \"cf930f53-bb6b-43f3-8a01-7d5797b0d75f\") " pod="openshift-monitoring/thanos-querier-696bc7564-826gk"
Jul 14 19:15:38.012666 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:38.012636    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cf930f53-bb6b-43f3-8a01-7d5797b0d75f-metrics-client-ca\") pod \"thanos-querier-696bc7564-826gk\" (UID: \"cf930f53-bb6b-43f3-8a01-7d5797b0d75f\") " pod="openshift-monitoring/thanos-querier-696bc7564-826gk"
Jul 14 19:15:38.012814 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:38.012682    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/cf930f53-bb6b-43f3-8a01-7d5797b0d75f-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-696bc7564-826gk\" (UID: \"cf930f53-bb6b-43f3-8a01-7d5797b0d75f\") " pod="openshift-monitoring/thanos-querier-696bc7564-826gk"
Jul 14 19:15:38.012814 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:38.012748    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/cf930f53-bb6b-43f3-8a01-7d5797b0d75f-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-696bc7564-826gk\" (UID: \"cf930f53-bb6b-43f3-8a01-7d5797b0d75f\") " pod="openshift-monitoring/thanos-querier-696bc7564-826gk"
Jul 14 19:15:38.012814 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:38.012789    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/cf930f53-bb6b-43f3-8a01-7d5797b0d75f-secret-grpc-tls\") pod \"thanos-querier-696bc7564-826gk\" (UID: \"cf930f53-bb6b-43f3-8a01-7d5797b0d75f\") " pod="openshift-monitoring/thanos-querier-696bc7564-826gk"
Jul 14 19:15:38.012931 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:38.012830    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gkgbf\" (UniqueName: \"kubernetes.io/projected/cf930f53-bb6b-43f3-8a01-7d5797b0d75f-kube-api-access-gkgbf\") pod \"thanos-querier-696bc7564-826gk\" (UID: \"cf930f53-bb6b-43f3-8a01-7d5797b0d75f\") " pod="openshift-monitoring/thanos-querier-696bc7564-826gk"
Jul 14 19:15:38.113768 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:38.113699    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/cf930f53-bb6b-43f3-8a01-7d5797b0d75f-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-696bc7564-826gk\" (UID: \"cf930f53-bb6b-43f3-8a01-7d5797b0d75f\") " pod="openshift-monitoring/thanos-querier-696bc7564-826gk"
Jul 14 19:15:38.113919 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:38.113766    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cf930f53-bb6b-43f3-8a01-7d5797b0d75f-metrics-client-ca\") pod \"thanos-querier-696bc7564-826gk\" (UID: \"cf930f53-bb6b-43f3-8a01-7d5797b0d75f\") " pod="openshift-monitoring/thanos-querier-696bc7564-826gk"
Jul 14 19:15:38.113919 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:38.113800    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/cf930f53-bb6b-43f3-8a01-7d5797b0d75f-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-696bc7564-826gk\" (UID: \"cf930f53-bb6b-43f3-8a01-7d5797b0d75f\") " pod="openshift-monitoring/thanos-querier-696bc7564-826gk"
Jul 14 19:15:38.113919 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:38.113828    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/cf930f53-bb6b-43f3-8a01-7d5797b0d75f-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-696bc7564-826gk\" (UID: \"cf930f53-bb6b-43f3-8a01-7d5797b0d75f\") " pod="openshift-monitoring/thanos-querier-696bc7564-826gk"
Jul 14 19:15:38.113919 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:38.113855    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/cf930f53-bb6b-43f3-8a01-7d5797b0d75f-secret-grpc-tls\") pod \"thanos-querier-696bc7564-826gk\" (UID: \"cf930f53-bb6b-43f3-8a01-7d5797b0d75f\") " pod="openshift-monitoring/thanos-querier-696bc7564-826gk"
Jul 14 19:15:38.113919 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:38.113886    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gkgbf\" (UniqueName: \"kubernetes.io/projected/cf930f53-bb6b-43f3-8a01-7d5797b0d75f-kube-api-access-gkgbf\") pod \"thanos-querier-696bc7564-826gk\" (UID: \"cf930f53-bb6b-43f3-8a01-7d5797b0d75f\") " pod="openshift-monitoring/thanos-querier-696bc7564-826gk"
Jul 14 19:15:38.113919 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:38.113918    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/cf930f53-bb6b-43f3-8a01-7d5797b0d75f-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-696bc7564-826gk\" (UID: \"cf930f53-bb6b-43f3-8a01-7d5797b0d75f\") " pod="openshift-monitoring/thanos-querier-696bc7564-826gk"
Jul 14 19:15:38.114207 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:38.113946    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/cf930f53-bb6b-43f3-8a01-7d5797b0d75f-secret-thanos-querier-tls\") pod \"thanos-querier-696bc7564-826gk\" (UID: \"cf930f53-bb6b-43f3-8a01-7d5797b0d75f\") " pod="openshift-monitoring/thanos-querier-696bc7564-826gk"
Jul 14 19:15:38.114887 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:38.114831    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cf930f53-bb6b-43f3-8a01-7d5797b0d75f-metrics-client-ca\") pod \"thanos-querier-696bc7564-826gk\" (UID: \"cf930f53-bb6b-43f3-8a01-7d5797b0d75f\") " pod="openshift-monitoring/thanos-querier-696bc7564-826gk"
Jul 14 19:15:38.116774 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:38.116748    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/cf930f53-bb6b-43f3-8a01-7d5797b0d75f-secret-thanos-querier-tls\") pod \"thanos-querier-696bc7564-826gk\" (UID: \"cf930f53-bb6b-43f3-8a01-7d5797b0d75f\") " pod="openshift-monitoring/thanos-querier-696bc7564-826gk"
Jul 14 19:15:38.117132 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:38.117109    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/cf930f53-bb6b-43f3-8a01-7d5797b0d75f-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-696bc7564-826gk\" (UID: \"cf930f53-bb6b-43f3-8a01-7d5797b0d75f\") " pod="openshift-monitoring/thanos-querier-696bc7564-826gk"
Jul 14 19:15:38.117283 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:38.117110    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/cf930f53-bb6b-43f3-8a01-7d5797b0d75f-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-696bc7564-826gk\" (UID: \"cf930f53-bb6b-43f3-8a01-7d5797b0d75f\") " pod="openshift-monitoring/thanos-querier-696bc7564-826gk"
Jul 14 19:15:38.117382 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:38.117343    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/cf930f53-bb6b-43f3-8a01-7d5797b0d75f-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-696bc7564-826gk\" (UID: \"cf930f53-bb6b-43f3-8a01-7d5797b0d75f\") " pod="openshift-monitoring/thanos-querier-696bc7564-826gk"
Jul 14 19:15:38.117787 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:38.117760    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/cf930f53-bb6b-43f3-8a01-7d5797b0d75f-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-696bc7564-826gk\" (UID: \"cf930f53-bb6b-43f3-8a01-7d5797b0d75f\") " pod="openshift-monitoring/thanos-querier-696bc7564-826gk"
Jul 14 19:15:38.118042 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:38.118024    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/cf930f53-bb6b-43f3-8a01-7d5797b0d75f-secret-grpc-tls\") pod \"thanos-querier-696bc7564-826gk\" (UID: \"cf930f53-bb6b-43f3-8a01-7d5797b0d75f\") " pod="openshift-monitoring/thanos-querier-696bc7564-826gk"
Jul 14 19:15:38.123012 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:38.122993    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gkgbf\" (UniqueName: \"kubernetes.io/projected/cf930f53-bb6b-43f3-8a01-7d5797b0d75f-kube-api-access-gkgbf\") pod \"thanos-querier-696bc7564-826gk\" (UID: \"cf930f53-bb6b-43f3-8a01-7d5797b0d75f\") " pod="openshift-monitoring/thanos-querier-696bc7564-826gk"
Jul 14 19:15:38.223404 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:38.223375    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-696bc7564-826gk"
Jul 14 19:15:39.305644 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:39.305611    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-68dcbc58c-w8rtn"]
Jul 14 19:15:39.308382 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:39.308362    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-68dcbc58c-w8rtn"
Jul 14 19:15:39.312485 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:39.312258    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-mgmsg\""
Jul 14 19:15:39.312485 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:39.312321    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-3lsuptfsvcqn3\""
Jul 14 19:15:39.312485 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:39.312258    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Jul 14 19:15:39.312485 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:39.312374    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Jul 14 19:15:39.312485 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:39.312256    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 14 19:15:39.312485 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:39.312324    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Jul 14 19:15:39.316669 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:39.316646    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-68dcbc58c-w8rtn"]
Jul 14 19:15:39.425013 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:39.424972    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c98f66f6-6388-4a8c-b7b8-b7056790025c-client-ca-bundle\") pod \"metrics-server-68dcbc58c-w8rtn\" (UID: \"c98f66f6-6388-4a8c-b7b8-b7056790025c\") " pod="openshift-monitoring/metrics-server-68dcbc58c-w8rtn"
Jul 14 19:15:39.425013 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:39.425018    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c98f66f6-6388-4a8c-b7b8-b7056790025c-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-68dcbc58c-w8rtn\" (UID: \"c98f66f6-6388-4a8c-b7b8-b7056790025c\") " pod="openshift-monitoring/metrics-server-68dcbc58c-w8rtn"
Jul 14 19:15:39.425295 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:39.425141    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/c98f66f6-6388-4a8c-b7b8-b7056790025c-audit-log\") pod \"metrics-server-68dcbc58c-w8rtn\" (UID: \"c98f66f6-6388-4a8c-b7b8-b7056790025c\") " pod="openshift-monitoring/metrics-server-68dcbc58c-w8rtn"
Jul 14 19:15:39.425295 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:39.425199    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hkp4h\" (UniqueName: \"kubernetes.io/projected/c98f66f6-6388-4a8c-b7b8-b7056790025c-kube-api-access-hkp4h\") pod \"metrics-server-68dcbc58c-w8rtn\" (UID: \"c98f66f6-6388-4a8c-b7b8-b7056790025c\") " pod="openshift-monitoring/metrics-server-68dcbc58c-w8rtn"
Jul 14 19:15:39.425295 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:39.425238    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/c98f66f6-6388-4a8c-b7b8-b7056790025c-secret-metrics-server-client-certs\") pod \"metrics-server-68dcbc58c-w8rtn\" (UID: \"c98f66f6-6388-4a8c-b7b8-b7056790025c\") " pod="openshift-monitoring/metrics-server-68dcbc58c-w8rtn"
Jul 14 19:15:39.425470 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:39.425295    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/c98f66f6-6388-4a8c-b7b8-b7056790025c-secret-metrics-server-tls\") pod \"metrics-server-68dcbc58c-w8rtn\" (UID: \"c98f66f6-6388-4a8c-b7b8-b7056790025c\") " pod="openshift-monitoring/metrics-server-68dcbc58c-w8rtn"
Jul 14 19:15:39.425470 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:39.425322    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/c98f66f6-6388-4a8c-b7b8-b7056790025c-metrics-server-audit-profiles\") pod \"metrics-server-68dcbc58c-w8rtn\" (UID: \"c98f66f6-6388-4a8c-b7b8-b7056790025c\") " pod="openshift-monitoring/metrics-server-68dcbc58c-w8rtn"
Jul 14 19:15:39.526006 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:39.525974    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/c98f66f6-6388-4a8c-b7b8-b7056790025c-audit-log\") pod \"metrics-server-68dcbc58c-w8rtn\" (UID: \"c98f66f6-6388-4a8c-b7b8-b7056790025c\") " pod="openshift-monitoring/metrics-server-68dcbc58c-w8rtn"
Jul 14 19:15:39.526213 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:39.526014    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hkp4h\" (UniqueName: \"kubernetes.io/projected/c98f66f6-6388-4a8c-b7b8-b7056790025c-kube-api-access-hkp4h\") pod \"metrics-server-68dcbc58c-w8rtn\" (UID: \"c98f66f6-6388-4a8c-b7b8-b7056790025c\") " pod="openshift-monitoring/metrics-server-68dcbc58c-w8rtn"
Jul 14 19:15:39.526213 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:39.526042    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/c98f66f6-6388-4a8c-b7b8-b7056790025c-secret-metrics-server-client-certs\") pod \"metrics-server-68dcbc58c-w8rtn\" (UID: \"c98f66f6-6388-4a8c-b7b8-b7056790025c\") " pod="openshift-monitoring/metrics-server-68dcbc58c-w8rtn"
Jul 14 19:15:39.526213 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:39.526074    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/c98f66f6-6388-4a8c-b7b8-b7056790025c-secret-metrics-server-tls\") pod \"metrics-server-68dcbc58c-w8rtn\" (UID: \"c98f66f6-6388-4a8c-b7b8-b7056790025c\") " pod="openshift-monitoring/metrics-server-68dcbc58c-w8rtn"
Jul 14 19:15:39.526213 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:39.526098    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/c98f66f6-6388-4a8c-b7b8-b7056790025c-metrics-server-audit-profiles\") pod \"metrics-server-68dcbc58c-w8rtn\" (UID: \"c98f66f6-6388-4a8c-b7b8-b7056790025c\") " pod="openshift-monitoring/metrics-server-68dcbc58c-w8rtn"
Jul 14 19:15:39.526213 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:39.526202    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c98f66f6-6388-4a8c-b7b8-b7056790025c-client-ca-bundle\") pod \"metrics-server-68dcbc58c-w8rtn\" (UID: \"c98f66f6-6388-4a8c-b7b8-b7056790025c\") " pod="openshift-monitoring/metrics-server-68dcbc58c-w8rtn"
Jul 14 19:15:39.526480 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:39.526239    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c98f66f6-6388-4a8c-b7b8-b7056790025c-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-68dcbc58c-w8rtn\" (UID: \"c98f66f6-6388-4a8c-b7b8-b7056790025c\") " pod="openshift-monitoring/metrics-server-68dcbc58c-w8rtn"
Jul 14 19:15:39.526480 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:39.526404    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/c98f66f6-6388-4a8c-b7b8-b7056790025c-audit-log\") pod \"metrics-server-68dcbc58c-w8rtn\" (UID: \"c98f66f6-6388-4a8c-b7b8-b7056790025c\") " pod="openshift-monitoring/metrics-server-68dcbc58c-w8rtn"
Jul 14 19:15:39.527274 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:39.526946    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c98f66f6-6388-4a8c-b7b8-b7056790025c-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-68dcbc58c-w8rtn\" (UID: \"c98f66f6-6388-4a8c-b7b8-b7056790025c\") " pod="openshift-monitoring/metrics-server-68dcbc58c-w8rtn"
Jul 14 19:15:39.527414 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:39.527386    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/c98f66f6-6388-4a8c-b7b8-b7056790025c-metrics-server-audit-profiles\") pod \"metrics-server-68dcbc58c-w8rtn\" (UID: \"c98f66f6-6388-4a8c-b7b8-b7056790025c\") " pod="openshift-monitoring/metrics-server-68dcbc58c-w8rtn"
Jul 14 19:15:39.529957 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:39.529905    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c98f66f6-6388-4a8c-b7b8-b7056790025c-client-ca-bundle\") pod \"metrics-server-68dcbc58c-w8rtn\" (UID: \"c98f66f6-6388-4a8c-b7b8-b7056790025c\") " pod="openshift-monitoring/metrics-server-68dcbc58c-w8rtn"
Jul 14 19:15:39.530232 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:39.530210    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/c98f66f6-6388-4a8c-b7b8-b7056790025c-secret-metrics-server-client-certs\") pod \"metrics-server-68dcbc58c-w8rtn\" (UID: \"c98f66f6-6388-4a8c-b7b8-b7056790025c\") " pod="openshift-monitoring/metrics-server-68dcbc58c-w8rtn"
Jul 14 19:15:39.530974 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:39.530933    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/c98f66f6-6388-4a8c-b7b8-b7056790025c-secret-metrics-server-tls\") pod \"metrics-server-68dcbc58c-w8rtn\" (UID: \"c98f66f6-6388-4a8c-b7b8-b7056790025c\") " pod="openshift-monitoring/metrics-server-68dcbc58c-w8rtn"
Jul 14 19:15:39.535725 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:39.535692    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hkp4h\" (UniqueName: \"kubernetes.io/projected/c98f66f6-6388-4a8c-b7b8-b7056790025c-kube-api-access-hkp4h\") pod \"metrics-server-68dcbc58c-w8rtn\" (UID: \"c98f66f6-6388-4a8c-b7b8-b7056790025c\") " pod="openshift-monitoring/metrics-server-68dcbc58c-w8rtn"
Jul 14 19:15:39.601675 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:39.600943    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-9cwr4"]
Jul 14 19:15:39.606837 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:39.606811    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-9cwr4"
Jul 14 19:15:39.609892 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:39.609861    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Jul 14 19:15:39.609892 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:39.609861    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-xmpvn\""
Jul 14 19:15:39.616087 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:39.615793    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-9cwr4"]
Jul 14 19:15:39.621235 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:39.621215    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-68dcbc58c-w8rtn"
Jul 14 19:15:39.641499 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:39.641471    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7888dbdddd-2j6wh"]
Jul 14 19:15:39.643697 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:39.643673    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7888dbdddd-2j6wh"
Jul 14 19:15:39.657893 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:39.657872    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7888dbdddd-2j6wh"]
Jul 14 19:15:39.728113 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:39.728079    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z522s\" (UniqueName: \"kubernetes.io/projected/02b13352-bd43-4303-8b23-52eb0caed47d-kube-api-access-z522s\") pod \"monitoring-plugin-5f68df7f58-9cwr4\" (UID: \"02b13352-bd43-4303-8b23-52eb0caed47d\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-9cwr4"
Jul 14 19:15:39.728323 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:39.728131    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/02b13352-bd43-4303-8b23-52eb0caed47d-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-9cwr4\" (UID: \"02b13352-bd43-4303-8b23-52eb0caed47d\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-9cwr4"
Jul 14 19:15:39.829321 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:39.829287    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8e51690e-5691-4a29-a66e-1db42499954c-console-config\") pod \"console-7888dbdddd-2j6wh\" (UID: \"8e51690e-5691-4a29-a66e-1db42499954c\") " pod="openshift-console/console-7888dbdddd-2j6wh"
Jul 14 19:15:39.829491 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:39.829331    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8e51690e-5691-4a29-a66e-1db42499954c-service-ca\") pod \"console-7888dbdddd-2j6wh\" (UID: \"8e51690e-5691-4a29-a66e-1db42499954c\") " pod="openshift-console/console-7888dbdddd-2j6wh"
Jul 14 19:15:39.829491 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:39.829380    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z522s\" (UniqueName: \"kubernetes.io/projected/02b13352-bd43-4303-8b23-52eb0caed47d-kube-api-access-z522s\") pod \"monitoring-plugin-5f68df7f58-9cwr4\" (UID: \"02b13352-bd43-4303-8b23-52eb0caed47d\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-9cwr4"
Jul 14 19:15:39.829491 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:39.829419    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/02b13352-bd43-4303-8b23-52eb0caed47d-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-9cwr4\" (UID: \"02b13352-bd43-4303-8b23-52eb0caed47d\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-9cwr4"
Jul 14 19:15:39.829491 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:39.829442    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8e51690e-5691-4a29-a66e-1db42499954c-console-oauth-config\") pod \"console-7888dbdddd-2j6wh\" (UID: \"8e51690e-5691-4a29-a66e-1db42499954c\") " pod="openshift-console/console-7888dbdddd-2j6wh"
Jul 14 19:15:39.829693 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:39.829500    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8e51690e-5691-4a29-a66e-1db42499954c-trusted-ca-bundle\") pod \"console-7888dbdddd-2j6wh\" (UID: \"8e51690e-5691-4a29-a66e-1db42499954c\") " pod="openshift-console/console-7888dbdddd-2j6wh"
Jul 14 19:15:39.829693 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:39.829528    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8e51690e-5691-4a29-a66e-1db42499954c-console-serving-cert\") pod \"console-7888dbdddd-2j6wh\" (UID: \"8e51690e-5691-4a29-a66e-1db42499954c\") " pod="openshift-console/console-7888dbdddd-2j6wh"
Jul 14 19:15:39.829693 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:39.829552    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f4jvf\" (UniqueName: \"kubernetes.io/projected/8e51690e-5691-4a29-a66e-1db42499954c-kube-api-access-f4jvf\") pod \"console-7888dbdddd-2j6wh\" (UID: \"8e51690e-5691-4a29-a66e-1db42499954c\") " pod="openshift-console/console-7888dbdddd-2j6wh"
Jul 14 19:15:39.829693 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:39.829667    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8e51690e-5691-4a29-a66e-1db42499954c-oauth-serving-cert\") pod \"console-7888dbdddd-2j6wh\" (UID: \"8e51690e-5691-4a29-a66e-1db42499954c\") " pod="openshift-console/console-7888dbdddd-2j6wh"
Jul 14 19:15:39.832491 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:39.832460    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/02b13352-bd43-4303-8b23-52eb0caed47d-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-9cwr4\" (UID: \"02b13352-bd43-4303-8b23-52eb0caed47d\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-9cwr4"
Jul 14 19:15:39.839093 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:39.839066    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z522s\" (UniqueName: \"kubernetes.io/projected/02b13352-bd43-4303-8b23-52eb0caed47d-kube-api-access-z522s\") pod \"monitoring-plugin-5f68df7f58-9cwr4\" (UID: \"02b13352-bd43-4303-8b23-52eb0caed47d\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-9cwr4"
Jul 14 19:15:39.919045 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:39.918976    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-9cwr4"
Jul 14 19:15:39.930506 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:39.930480    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8e51690e-5691-4a29-a66e-1db42499954c-trusted-ca-bundle\") pod \"console-7888dbdddd-2j6wh\" (UID: \"8e51690e-5691-4a29-a66e-1db42499954c\") " pod="openshift-console/console-7888dbdddd-2j6wh"
Jul 14 19:15:39.930601 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:39.930519    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8e51690e-5691-4a29-a66e-1db42499954c-console-serving-cert\") pod \"console-7888dbdddd-2j6wh\" (UID: \"8e51690e-5691-4a29-a66e-1db42499954c\") " pod="openshift-console/console-7888dbdddd-2j6wh"
Jul 14 19:15:39.930601 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:39.930543    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f4jvf\" (UniqueName: \"kubernetes.io/projected/8e51690e-5691-4a29-a66e-1db42499954c-kube-api-access-f4jvf\") pod \"console-7888dbdddd-2j6wh\" (UID: \"8e51690e-5691-4a29-a66e-1db42499954c\") " pod="openshift-console/console-7888dbdddd-2j6wh"
Jul 14 19:15:39.930722 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:39.930641    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8e51690e-5691-4a29-a66e-1db42499954c-oauth-serving-cert\") pod \"console-7888dbdddd-2j6wh\" (UID: \"8e51690e-5691-4a29-a66e-1db42499954c\") " pod="openshift-console/console-7888dbdddd-2j6wh"
Jul 14 19:15:39.930722 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:39.930712    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8e51690e-5691-4a29-a66e-1db42499954c-console-config\") pod \"console-7888dbdddd-2j6wh\" (UID: \"8e51690e-5691-4a29-a66e-1db42499954c\") " pod="openshift-console/console-7888dbdddd-2j6wh"
Jul 14 19:15:39.930837 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:39.930742    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8e51690e-5691-4a29-a66e-1db42499954c-service-ca\") pod \"console-7888dbdddd-2j6wh\" (UID: \"8e51690e-5691-4a29-a66e-1db42499954c\") " pod="openshift-console/console-7888dbdddd-2j6wh"
Jul 14 19:15:39.930837 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:39.930795    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8e51690e-5691-4a29-a66e-1db42499954c-console-oauth-config\") pod \"console-7888dbdddd-2j6wh\" (UID: \"8e51690e-5691-4a29-a66e-1db42499954c\") " pod="openshift-console/console-7888dbdddd-2j6wh"
Jul 14 19:15:39.931546 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:39.931419    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8e51690e-5691-4a29-a66e-1db42499954c-oauth-serving-cert\") pod \"console-7888dbdddd-2j6wh\" (UID: \"8e51690e-5691-4a29-a66e-1db42499954c\") " pod="openshift-console/console-7888dbdddd-2j6wh"
Jul 14 19:15:39.931546 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:39.931498    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8e51690e-5691-4a29-a66e-1db42499954c-trusted-ca-bundle\") pod \"console-7888dbdddd-2j6wh\" (UID: \"8e51690e-5691-4a29-a66e-1db42499954c\") " pod="openshift-console/console-7888dbdddd-2j6wh"
Jul 14 19:15:39.931546 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:39.931535    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8e51690e-5691-4a29-a66e-1db42499954c-console-config\") pod \"console-7888dbdddd-2j6wh\" (UID: \"8e51690e-5691-4a29-a66e-1db42499954c\") " pod="openshift-console/console-7888dbdddd-2j6wh"
Jul 14 19:15:39.931912 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:39.931576    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8e51690e-5691-4a29-a66e-1db42499954c-service-ca\") pod \"console-7888dbdddd-2j6wh\" (UID: \"8e51690e-5691-4a29-a66e-1db42499954c\") " pod="openshift-console/console-7888dbdddd-2j6wh"
Jul 14 19:15:39.933694 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:39.933670    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8e51690e-5691-4a29-a66e-1db42499954c-console-serving-cert\") pod \"console-7888dbdddd-2j6wh\" (UID: \"8e51690e-5691-4a29-a66e-1db42499954c\") " pod="openshift-console/console-7888dbdddd-2j6wh"
Jul 14 19:15:39.933790 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:39.933706    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8e51690e-5691-4a29-a66e-1db42499954c-console-oauth-config\") pod \"console-7888dbdddd-2j6wh\" (UID: \"8e51690e-5691-4a29-a66e-1db42499954c\") " pod="openshift-console/console-7888dbdddd-2j6wh"
Jul 14 19:15:39.941006 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:39.940984    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f4jvf\" (UniqueName: \"kubernetes.io/projected/8e51690e-5691-4a29-a66e-1db42499954c-kube-api-access-f4jvf\") pod \"console-7888dbdddd-2j6wh\" (UID: \"8e51690e-5691-4a29-a66e-1db42499954c\") " pod="openshift-console/console-7888dbdddd-2j6wh"
Jul 14 19:15:39.953892 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:39.953712    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7888dbdddd-2j6wh"
Jul 14 19:15:41.241827 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:41.241788    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/648852a8-be96-4782-bfdc-76bdce2ab8b5-metrics-tls\") pod \"dns-default-g85df\" (UID: \"648852a8-be96-4782-bfdc-76bdce2ab8b5\") " pod="openshift-dns/dns-default-g85df"
Jul 14 19:15:41.244511 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:41.244487    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/648852a8-be96-4782-bfdc-76bdce2ab8b5-metrics-tls\") pod \"dns-default-g85df\" (UID: \"648852a8-be96-4782-bfdc-76bdce2ab8b5\") " pod="openshift-dns/dns-default-g85df"
Jul 14 19:15:41.403093 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:41.403039    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-h5x4l\""
Jul 14 19:15:41.411557 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:41.411521    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-g85df"
Jul 14 19:15:41.706759 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:41.706737    2565 patch_prober.go:28] interesting pod/image-registry-d858f7db9-cnzfq container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 14 19:15:41.706840 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:41.706787    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-d858f7db9-cnzfq" podUID="4c01c8da-c276-4b74-8f64-16bdc3e0237a" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 14 19:15:41.787356 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:41.787225    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7888dbdddd-2j6wh"]
Jul 14 19:15:41.792887 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:15:41.792835    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e51690e_5691_4a29_a66e_1db42499954c.slice/crio-fe393de77f664ef4334f4abe33d7ffe5c15b08c4bcc97941d8b02d1ea743faa7 WatchSource:0}: Error finding container fe393de77f664ef4334f4abe33d7ffe5c15b08c4bcc97941d8b02d1ea743faa7: Status 404 returned error can't find the container with id fe393de77f664ef4334f4abe33d7ffe5c15b08c4bcc97941d8b02d1ea743faa7
Jul 14 19:15:41.805963 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:41.805935    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-696bc7564-826gk"]
Jul 14 19:15:41.809211 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:15:41.809183    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf930f53_bb6b_43f3_8a01_7d5797b0d75f.slice/crio-ce2611f2f8c601926e7a7c1a846522ed1f6cea4e01868ddff1ec24feafd61f45 WatchSource:0}: Error finding container ce2611f2f8c601926e7a7c1a846522ed1f6cea4e01868ddff1ec24feafd61f45: Status 404 returned error can't find the container with id ce2611f2f8c601926e7a7c1a846522ed1f6cea4e01868ddff1ec24feafd61f45
Jul 14 19:15:41.820198 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:41.820136    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-lpsw7" event={"ID":"86cc3494-b30a-4c30-9000-bf048d51f7e2","Type":"ContainerStarted","Data":"56a88fce40cfb6d49b6eff92019b28c30fcfa0e51fb8e9a371c33c1f707d4ac0"}
Jul 14 19:15:41.822004 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:41.821978    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-848497c6b9-89ks6" event={"ID":"45d99327-6ee9-4fa6-ba50-07cfe6b6c15f","Type":"ContainerStarted","Data":"545ba6a05b9f266ac3714ec845bd13e219d6d1ff7f0fdcd1840ae8e8d5dc8e95"}
Jul 14 19:15:41.824441 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:41.824410    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-68c9cbb497-dbsmm" event={"ID":"bbcea941-8508-4926-89fd-e4df1191df74","Type":"ContainerStarted","Data":"7d9543c3ce9607cca7a5d9d8cdcd565018a75ad0203bb805a0abdd0c144b6a11"}
Jul 14 19:15:41.824667 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:41.824646    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-68c9cbb497-dbsmm"
Jul 14 19:15:41.825931 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:41.825908    2565 patch_prober.go:28] interesting pod/downloads-68c9cbb497-dbsmm container/download-server namespace/openshift-console: Readiness probe status=failure output="Get \"http://10.134.0.15:8080/\": dial tcp 10.134.0.15:8080: connect: connection refused" start-of-body=
Jul 14 19:15:41.826008 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:41.825953    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/downloads-68c9cbb497-dbsmm" podUID="bbcea941-8508-4926-89fd-e4df1191df74" containerName="download-server" probeResult="failure" output="Get \"http://10.134.0.15:8080/\": dial tcp 10.134.0.15:8080: connect: connection refused"
Jul 14 19:15:41.826360 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:41.826075    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-696bc7564-826gk" event={"ID":"cf930f53-bb6b-43f3-8a01-7d5797b0d75f","Type":"ContainerStarted","Data":"ce2611f2f8c601926e7a7c1a846522ed1f6cea4e01868ddff1ec24feafd61f45"}
Jul 14 19:15:41.827853 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:41.827820    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7888dbdddd-2j6wh" event={"ID":"8e51690e-5691-4a29-a66e-1db42499954c","Type":"ContainerStarted","Data":"fe393de77f664ef4334f4abe33d7ffe5c15b08c4bcc97941d8b02d1ea743faa7"}
Jul 14 19:15:41.841198 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:41.841104    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-848497c6b9-89ks6" podStartSLOduration=1.387714251 podStartE2EDuration="10.841091375s" totalImagesPullingTime="9.453377124s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 19:15:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:15:41.839913406 +0000 UTC m=+288.400770308" watchObservedRunningTime="2026-07-14 19:15:41.841091375 +0000 UTC m=+288.401948265"
Jul 14 19:15:41.857517 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:41.857478    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-68c9cbb497-dbsmm" podStartSLOduration=1.4092289359999999 podStartE2EDuration="20.857464303s" totalImagesPullingTime="19.448235367s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 19:15:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:15:41.856040051 +0000 UTC m=+288.416896966" watchObservedRunningTime="2026-07-14 19:15:41.857464303 +0000 UTC m=+288.418321193"
Jul 14 19:15:41.983523 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:41.983488    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-848497c6b9-89ks6"
Jul 14 19:15:41.983692 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:41.983570    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-848497c6b9-89ks6"
Jul 14 19:15:41.984739 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:41.984708    2565 patch_prober.go:28] interesting pod/console-848497c6b9-89ks6 container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.18:8443/health\": dial tcp 10.134.0.18:8443: connect: connection refused" start-of-body=
Jul 14 19:15:41.984851 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:41.984763    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-848497c6b9-89ks6" podUID="45d99327-6ee9-4fa6-ba50-07cfe6b6c15f" containerName="console" probeResult="failure" output="Get \"https://10.134.0.18:8443/health\": dial tcp 10.134.0.18:8443: connect: connection refused"
Jul 14 19:15:42.062429 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:42.062318    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-9cwr4"]
Jul 14 19:15:42.066261 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:15:42.066226    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02b13352_bd43_4303_8b23_52eb0caed47d.slice/crio-aae14227b391dea0dfb4ae38e8589d2762e626789266dd005c08d1221d516ede WatchSource:0}: Error finding container aae14227b391dea0dfb4ae38e8589d2762e626789266dd005c08d1221d516ede: Status 404 returned error can't find the container with id aae14227b391dea0dfb4ae38e8589d2762e626789266dd005c08d1221d516ede
Jul 14 19:15:42.068910 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:42.068880    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-g85df"]
Jul 14 19:15:42.071823 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:15:42.071797    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod648852a8_be96_4782_bfdc_76bdce2ab8b5.slice/crio-2dfb0523acbea95009c241988f32f4465c88772d729023374d44f64d8d7ab141 WatchSource:0}: Error finding container 2dfb0523acbea95009c241988f32f4465c88772d729023374d44f64d8d7ab141: Status 404 returned error can't find the container with id 2dfb0523acbea95009c241988f32f4465c88772d729023374d44f64d8d7ab141
Jul 14 19:15:42.092592 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:42.092565    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-68dcbc58c-w8rtn"]
Jul 14 19:15:42.094373 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:15:42.094349    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc98f66f6_6388_4a8c_b7b8_b7056790025c.slice/crio-46c90a0b7fd78f67937d2546aad4e990ad42d582dccea801f667bfe43c047bc7 WatchSource:0}: Error finding container 46c90a0b7fd78f67937d2546aad4e990ad42d582dccea801f667bfe43c047bc7: Status 404 returned error can't find the container with id 46c90a0b7fd78f67937d2546aad4e990ad42d582dccea801f667bfe43c047bc7
Jul 14 19:15:42.838080 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:42.837247    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7888dbdddd-2j6wh" event={"ID":"8e51690e-5691-4a29-a66e-1db42499954c","Type":"ContainerStarted","Data":"dda04f3a3afe2f3edf663705e52e8640c40455112f57ad8627731444c9ecc958"}
Jul 14 19:15:42.841891 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:42.841071    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-68dcbc58c-w8rtn" event={"ID":"c98f66f6-6388-4a8c-b7b8-b7056790025c","Type":"ContainerStarted","Data":"46c90a0b7fd78f67937d2546aad4e990ad42d582dccea801f667bfe43c047bc7"}
Jul 14 19:15:42.843639 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:42.843608    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-g85df" event={"ID":"648852a8-be96-4782-bfdc-76bdce2ab8b5","Type":"ContainerStarted","Data":"2dfb0523acbea95009c241988f32f4465c88772d729023374d44f64d8d7ab141"}
Jul 14 19:15:42.845972 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:42.845940    2565 generic.go:356] "Generic (PLEG): container finished" podID="86cc3494-b30a-4c30-9000-bf048d51f7e2" containerID="aa3ea6afff80c745f870ceca4ad8d5233c8d3c31ccc54d46de2b8e928a1a1807" exitCode=0
Jul 14 19:15:42.846273 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:42.846208    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-lpsw7" event={"ID":"86cc3494-b30a-4c30-9000-bf048d51f7e2","Type":"ContainerDied","Data":"aa3ea6afff80c745f870ceca4ad8d5233c8d3c31ccc54d46de2b8e928a1a1807"}
Jul 14 19:15:42.851951 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:42.851042    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-9cwr4" event={"ID":"02b13352-bd43-4303-8b23-52eb0caed47d","Type":"ContainerStarted","Data":"aae14227b391dea0dfb4ae38e8589d2762e626789266dd005c08d1221d516ede"}
Jul 14 19:15:42.855397 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:42.855347    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7888dbdddd-2j6wh" podStartSLOduration=3.855329555 podStartE2EDuration="3.855329555s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 19:15:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:15:42.854717434 +0000 UTC m=+289.415574349" watchObservedRunningTime="2026-07-14 19:15:42.855329555 +0000 UTC m=+289.416186448"
Jul 14 19:15:42.861430 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:42.861409    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-68c9cbb497-dbsmm"
Jul 14 19:15:43.861772 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:43.860787    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-lpsw7" event={"ID":"86cc3494-b30a-4c30-9000-bf048d51f7e2","Type":"ContainerStarted","Data":"fb6339ce7f94b4f47019931103a4c5b2a9810ec6372363f740164eb9dfbc6d9a"}
Jul 14 19:15:43.861772 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:43.860880    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-lpsw7" event={"ID":"86cc3494-b30a-4c30-9000-bf048d51f7e2","Type":"ContainerStarted","Data":"70434e3e1705537412046344e2356a965cf9c16fd6a0a30c659c45c3999ac9eb"}
Jul 14 19:15:43.883471 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:43.883364    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-lpsw7" podStartSLOduration=8.860383886 podStartE2EDuration="9.883344855s" totalImagesPullingTime="934.894364ms" totalInitContainerRuntime="88.066605ms" isStatefulPod=true podCreationTimestamp="2026-07-14 19:15:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:15:43.882443103 +0000 UTC m=+290.443300010" watchObservedRunningTime="2026-07-14 19:15:43.883344855 +0000 UTC m=+290.444201747"
Jul 14 19:15:46.717710 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:46.717659    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-d858f7db9-cnzfq" podUID="4c01c8da-c276-4b74-8f64-16bdc3e0237a" containerName="registry" containerID="cri-o://98328cdf1fe31d645e91e00a532acb6cbcc38e22d9da716cab4c9bf95c43a0c4" gracePeriod=30
Jul 14 19:15:46.880993 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:46.880953    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-g85df" event={"ID":"648852a8-be96-4782-bfdc-76bdce2ab8b5","Type":"ContainerStarted","Data":"e5343204c017b5f99db467f69543699c2bcbd2ac8012e67e32da28319505c91e"}
Jul 14 19:15:46.881144 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:46.881022    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-g85df" event={"ID":"648852a8-be96-4782-bfdc-76bdce2ab8b5","Type":"ContainerStarted","Data":"a521fa6dc3351538eca15abd508e0501316cb1cfd0b25a9c9fb0373abac8224c"}
Jul 14 19:15:46.881236 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:46.881146    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-g85df"
Jul 14 19:15:46.889920 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:46.889816    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-9cwr4" event={"ID":"02b13352-bd43-4303-8b23-52eb0caed47d","Type":"ContainerStarted","Data":"4ff270ae8ae4bd50ccce9727fd0d9cc5ee8a89fd6c35f2cd1b354c672698bcfd"}
Jul 14 19:15:46.893185 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:46.890375    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-9cwr4"
Jul 14 19:15:46.903650 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:46.900415    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-9cwr4"
Jul 14 19:15:46.903650 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:46.901702    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-68dcbc58c-w8rtn" event={"ID":"c98f66f6-6388-4a8c-b7b8-b7056790025c","Type":"ContainerStarted","Data":"e0d3bf652fba23b2747567acbc4de14d386a3523b2fdc972cc42cc7597cffc8b"}
Jul 14 19:15:46.904175 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:46.904071    2565 generic.go:356] "Generic (PLEG): container finished" podID="4c01c8da-c276-4b74-8f64-16bdc3e0237a" containerID="98328cdf1fe31d645e91e00a532acb6cbcc38e22d9da716cab4c9bf95c43a0c4" exitCode=0
Jul 14 19:15:46.904175 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:46.904118    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-d858f7db9-cnzfq" event={"ID":"4c01c8da-c276-4b74-8f64-16bdc3e0237a","Type":"ContainerDied","Data":"98328cdf1fe31d645e91e00a532acb6cbcc38e22d9da716cab4c9bf95c43a0c4"}
Jul 14 19:15:46.905890 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:46.905841    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-g85df" podStartSLOduration=252.220694663 podStartE2EDuration="4m15.905828448s" totalImagesPullingTime="3.685133785s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 19:11:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:15:46.904612501 +0000 UTC m=+293.465469416" watchObservedRunningTime="2026-07-14 19:15:46.905828448 +0000 UTC m=+293.466685379"
Jul 14 19:15:46.920633 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:46.920589    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-9cwr4" podStartSLOduration=4.236791251 podStartE2EDuration="7.920571831s" totalImagesPullingTime="3.68378058s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 19:15:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:15:46.919454859 +0000 UTC m=+293.480311750" watchObservedRunningTime="2026-07-14 19:15:46.920571831 +0000 UTC m=+293.481428724"
Jul 14 19:15:46.938960 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:46.938691    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-68dcbc58c-w8rtn" podStartSLOduration=4.282148408 podStartE2EDuration="7.938674923s" totalImagesPullingTime="3.656526515s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 19:15:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:15:46.938207833 +0000 UTC m=+293.499064754" watchObservedRunningTime="2026-07-14 19:15:46.938674923 +0000 UTC m=+293.499531816"
Jul 14 19:15:47.622968 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:47.622939    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-d858f7db9-cnzfq"
Jul 14 19:15:47.713002 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:47.712973    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8g4r4\" (UniqueName: \"kubernetes.io/projected/4c01c8da-c276-4b74-8f64-16bdc3e0237a-kube-api-access-8g4r4\") pod \"4c01c8da-c276-4b74-8f64-16bdc3e0237a\" (UID: \"4c01c8da-c276-4b74-8f64-16bdc3e0237a\") "
Jul 14 19:15:47.713182 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:47.713043    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4c01c8da-c276-4b74-8f64-16bdc3e0237a-ca-trust-extracted\") pod \"4c01c8da-c276-4b74-8f64-16bdc3e0237a\" (UID: \"4c01c8da-c276-4b74-8f64-16bdc3e0237a\") "
Jul 14 19:15:47.713182 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:47.713079    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4c01c8da-c276-4b74-8f64-16bdc3e0237a-trusted-ca\") pod \"4c01c8da-c276-4b74-8f64-16bdc3e0237a\" (UID: \"4c01c8da-c276-4b74-8f64-16bdc3e0237a\") "
Jul 14 19:15:47.713182 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:47.713111    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4c01c8da-c276-4b74-8f64-16bdc3e0237a-bound-sa-token\") pod \"4c01c8da-c276-4b74-8f64-16bdc3e0237a\" (UID: \"4c01c8da-c276-4b74-8f64-16bdc3e0237a\") "
Jul 14 19:15:47.713182 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:47.713130    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4c01c8da-c276-4b74-8f64-16bdc3e0237a-registry-tls\") pod \"4c01c8da-c276-4b74-8f64-16bdc3e0237a\" (UID: \"4c01c8da-c276-4b74-8f64-16bdc3e0237a\") "
Jul 14 19:15:47.713182 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:47.713169    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4c01c8da-c276-4b74-8f64-16bdc3e0237a-registry-certificates\") pod \"4c01c8da-c276-4b74-8f64-16bdc3e0237a\" (UID: \"4c01c8da-c276-4b74-8f64-16bdc3e0237a\") "
Jul 14 19:15:47.713456 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:47.713201    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4c01c8da-c276-4b74-8f64-16bdc3e0237a-installation-pull-secrets\") pod \"4c01c8da-c276-4b74-8f64-16bdc3e0237a\" (UID: \"4c01c8da-c276-4b74-8f64-16bdc3e0237a\") "
Jul 14 19:15:47.713456 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:47.713234    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4c01c8da-c276-4b74-8f64-16bdc3e0237a-image-registry-private-configuration\") pod \"4c01c8da-c276-4b74-8f64-16bdc3e0237a\" (UID: \"4c01c8da-c276-4b74-8f64-16bdc3e0237a\") "
Jul 14 19:15:47.713561 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:47.713528    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4c01c8da-c276-4b74-8f64-16bdc3e0237a-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "4c01c8da-c276-4b74-8f64-16bdc3e0237a" (UID: "4c01c8da-c276-4b74-8f64-16bdc3e0237a"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 19:15:47.716100 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:47.713945    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4c01c8da-c276-4b74-8f64-16bdc3e0237a-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "4c01c8da-c276-4b74-8f64-16bdc3e0237a" (UID: "4c01c8da-c276-4b74-8f64-16bdc3e0237a"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 19:15:47.716308 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:47.716277    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4c01c8da-c276-4b74-8f64-16bdc3e0237a-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "4c01c8da-c276-4b74-8f64-16bdc3e0237a" (UID: "4c01c8da-c276-4b74-8f64-16bdc3e0237a"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 19:15:47.717030 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:47.716978    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4c01c8da-c276-4b74-8f64-16bdc3e0237a-kube-api-access-8g4r4" (OuterVolumeSpecName: "kube-api-access-8g4r4") pod "4c01c8da-c276-4b74-8f64-16bdc3e0237a" (UID: "4c01c8da-c276-4b74-8f64-16bdc3e0237a"). InnerVolumeSpecName "kube-api-access-8g4r4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 19:15:47.717030 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:47.716986    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4c01c8da-c276-4b74-8f64-16bdc3e0237a-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "4c01c8da-c276-4b74-8f64-16bdc3e0237a" (UID: "4c01c8da-c276-4b74-8f64-16bdc3e0237a"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 19:15:47.717030 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:47.716978    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4c01c8da-c276-4b74-8f64-16bdc3e0237a-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "4c01c8da-c276-4b74-8f64-16bdc3e0237a" (UID: "4c01c8da-c276-4b74-8f64-16bdc3e0237a"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 19:15:47.717030 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:47.717018    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4c01c8da-c276-4b74-8f64-16bdc3e0237a-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "4c01c8da-c276-4b74-8f64-16bdc3e0237a" (UID: "4c01c8da-c276-4b74-8f64-16bdc3e0237a"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 19:15:47.724031 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:47.724001    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4c01c8da-c276-4b74-8f64-16bdc3e0237a-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "4c01c8da-c276-4b74-8f64-16bdc3e0237a" (UID: "4c01c8da-c276-4b74-8f64-16bdc3e0237a"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 19:15:47.814747 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:47.814714    2565 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4c01c8da-c276-4b74-8f64-16bdc3e0237a-ca-trust-extracted\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Jul 14 19:15:47.814854 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:47.814750    2565 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4c01c8da-c276-4b74-8f64-16bdc3e0237a-trusted-ca\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Jul 14 19:15:47.814854 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:47.814765    2565 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4c01c8da-c276-4b74-8f64-16bdc3e0237a-bound-sa-token\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Jul 14 19:15:47.814854 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:47.814775    2565 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4c01c8da-c276-4b74-8f64-16bdc3e0237a-registry-tls\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Jul 14 19:15:47.814854 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:47.814783    2565 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4c01c8da-c276-4b74-8f64-16bdc3e0237a-registry-certificates\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Jul 14 19:15:47.814854 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:47.814798    2565 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4c01c8da-c276-4b74-8f64-16bdc3e0237a-installation-pull-secrets\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Jul 14 19:15:47.814854 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:47.814820    2565 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4c01c8da-c276-4b74-8f64-16bdc3e0237a-image-registry-private-configuration\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Jul 14 19:15:47.814854 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:47.814830    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8g4r4\" (UniqueName: \"kubernetes.io/projected/4c01c8da-c276-4b74-8f64-16bdc3e0237a-kube-api-access-8g4r4\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Jul 14 19:15:47.910792 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:47.910723    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-d858f7db9-cnzfq" event={"ID":"4c01c8da-c276-4b74-8f64-16bdc3e0237a","Type":"ContainerDied","Data":"bbfde35b41f860b8c2b0c987a2204660da3bee0b3fb16f814b44b6054f373a38"}
Jul 14 19:15:47.910792 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:47.910752    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-d858f7db9-cnzfq"
Jul 14 19:15:47.910943 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:47.910794    2565 scope.go:117] "RemoveContainer" containerID="98328cdf1fe31d645e91e00a532acb6cbcc38e22d9da716cab4c9bf95c43a0c4"
Jul 14 19:15:47.933863 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:47.933840    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-d858f7db9-cnzfq"]
Jul 14 19:15:47.937339 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:47.937319    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-d858f7db9-cnzfq"]
Jul 14 19:15:47.968115 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:47.968091    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4c01c8da-c276-4b74-8f64-16bdc3e0237a" path="/var/lib/kubelet/pods/4c01c8da-c276-4b74-8f64-16bdc3e0237a/volumes"
Jul 14 19:15:48.921188 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:48.920649    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-696bc7564-826gk" event={"ID":"cf930f53-bb6b-43f3-8a01-7d5797b0d75f","Type":"ContainerStarted","Data":"573780f7b62d8c9bbdfef5954377dee9e0de7b36bd77780ad4818bfd0f86bba0"}
Jul 14 19:15:48.921188 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:48.920745    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-696bc7564-826gk" event={"ID":"cf930f53-bb6b-43f3-8a01-7d5797b0d75f","Type":"ContainerStarted","Data":"e076813c45d416d251dea1da109d310bc38945867c34aeafe1725546b87417a3"}
Jul 14 19:15:48.921188 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:48.920786    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-696bc7564-826gk" event={"ID":"cf930f53-bb6b-43f3-8a01-7d5797b0d75f","Type":"ContainerStarted","Data":"7c61f381f44444b0a3d1eb069967d1b2186194e19632668d61e161da8188b1e2"}
Jul 14 19:15:49.929266 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:49.929093    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-696bc7564-826gk" event={"ID":"cf930f53-bb6b-43f3-8a01-7d5797b0d75f","Type":"ContainerStarted","Data":"ba88a01b48bf225e15e4f944fc2e53dc1771bbacf2cb19308179fdf30f4cb0f9"}
Jul 14 19:15:49.929266 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:49.929209    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-696bc7564-826gk" event={"ID":"cf930f53-bb6b-43f3-8a01-7d5797b0d75f","Type":"ContainerStarted","Data":"f7bc5bbc9cf9f4b4605937494cdaaf468056fefc5e5cb8e318390b18d1abe2d8"}
Jul 14 19:15:49.954435 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:49.954408    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7888dbdddd-2j6wh"
Jul 14 19:15:49.954541 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:49.954463    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7888dbdddd-2j6wh"
Jul 14 19:15:49.959959 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:49.959933    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7888dbdddd-2j6wh"
Jul 14 19:15:50.940049 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:50.940012    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-696bc7564-826gk" event={"ID":"cf930f53-bb6b-43f3-8a01-7d5797b0d75f","Type":"ContainerStarted","Data":"565b66d59c5f4a35a37f9afbccfd8a0e53c23b60296fbe0e4178312e5acfd685"}
Jul 14 19:15:50.940479 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:50.940358    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-696bc7564-826gk"
Jul 14 19:15:50.943760 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:50.943740    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7888dbdddd-2j6wh"
Jul 14 19:15:50.962988 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:15:50.962962    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-hbbrx" podUID="a2ef2d8f-5f7b-41bd-b98a-2a272dd4090f"
Jul 14 19:15:50.964942 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:50.964906    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-696bc7564-826gk" podStartSLOduration=6.479521766 podStartE2EDuration="13.964892918s" totalImagesPullingTime="7.485371152s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 19:15:37 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:15:50.96309016 +0000 UTC m=+297.523947049" watchObservedRunningTime="2026-07-14 19:15:50.964892918 +0000 UTC m=+297.525749809"
Jul 14 19:15:51.010245 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:51.010210    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-848497c6b9-89ks6"]
Jul 14 19:15:53.782691 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:53.782666    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-p5lb5_7ab60b2b-a644-4e35-b8b1-49c676e0f63f/console-operator/1.log"
Jul 14 19:15:53.783529 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:53.783510    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-p5lb5_7ab60b2b-a644-4e35-b8b1-49c676e0f63f/console-operator/1.log"
Jul 14 19:15:53.786222 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:53.786191    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cqqv8_7a447cf6-9373-4497-8028-97d590f38262/ovn-acl-logging/0.log"
Jul 14 19:15:53.787450 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:53.787435    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cqqv8_7a447cf6-9373-4497-8028-97d590f38262/ovn-acl-logging/0.log"
Jul 14 19:15:53.798286 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:53.798267    2565 kubelet.go:1648] "Image garbage collection succeeded"
Jul 14 19:15:56.912599 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:56.912571    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-g85df"
Jul 14 19:15:56.957079 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:56.950465    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-696bc7564-826gk"
Jul 14 19:15:59.621790 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:59.621757    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-68dcbc58c-w8rtn"
Jul 14 19:15:59.622273 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:15:59.621824    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-68dcbc58c-w8rtn"
Jul 14 19:16:01.962953 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:16:01.962873    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hbbrx"
Jul 14 19:16:02.207595 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:16:02.207560    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-ttnqj_49093e63-d7ef-4c83-9c07-a96fd79d02f7/serve-healthcheck-canary/0.log"
Jul 14 19:16:16.031101 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:16:16.031065    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-848497c6b9-89ks6" podUID="45d99327-6ee9-4fa6-ba50-07cfe6b6c15f" containerName="console" containerID="cri-o://545ba6a05b9f266ac3714ec845bd13e219d6d1ff7f0fdcd1840ae8e8d5dc8e95" gracePeriod=15
Jul 14 19:16:16.310095 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:16:16.309961    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-848497c6b9-89ks6"
Jul 14 19:16:16.430237 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:16:16.430208    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/45d99327-6ee9-4fa6-ba50-07cfe6b6c15f-console-oauth-config\") pod \"45d99327-6ee9-4fa6-ba50-07cfe6b6c15f\" (UID: \"45d99327-6ee9-4fa6-ba50-07cfe6b6c15f\") "
Jul 14 19:16:16.430411 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:16:16.430253    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/45d99327-6ee9-4fa6-ba50-07cfe6b6c15f-oauth-serving-cert\") pod \"45d99327-6ee9-4fa6-ba50-07cfe6b6c15f\" (UID: \"45d99327-6ee9-4fa6-ba50-07cfe6b6c15f\") "
Jul 14 19:16:16.430411 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:16:16.430272    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/45d99327-6ee9-4fa6-ba50-07cfe6b6c15f-console-serving-cert\") pod \"45d99327-6ee9-4fa6-ba50-07cfe6b6c15f\" (UID: \"45d99327-6ee9-4fa6-ba50-07cfe6b6c15f\") "
Jul 14 19:16:16.430411 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:16:16.430301    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jbk8s\" (UniqueName: \"kubernetes.io/projected/45d99327-6ee9-4fa6-ba50-07cfe6b6c15f-kube-api-access-jbk8s\") pod \"45d99327-6ee9-4fa6-ba50-07cfe6b6c15f\" (UID: \"45d99327-6ee9-4fa6-ba50-07cfe6b6c15f\") "
Jul 14 19:16:16.430411 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:16:16.430328    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/45d99327-6ee9-4fa6-ba50-07cfe6b6c15f-trusted-ca-bundle\") pod \"45d99327-6ee9-4fa6-ba50-07cfe6b6c15f\" (UID: \"45d99327-6ee9-4fa6-ba50-07cfe6b6c15f\") "
Jul 14 19:16:16.430411 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:16:16.430363    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/45d99327-6ee9-4fa6-ba50-07cfe6b6c15f-service-ca\") pod \"45d99327-6ee9-4fa6-ba50-07cfe6b6c15f\" (UID: \"45d99327-6ee9-4fa6-ba50-07cfe6b6c15f\") "
Jul 14 19:16:16.430411 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:16:16.430394    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/45d99327-6ee9-4fa6-ba50-07cfe6b6c15f-console-config\") pod \"45d99327-6ee9-4fa6-ba50-07cfe6b6c15f\" (UID: \"45d99327-6ee9-4fa6-ba50-07cfe6b6c15f\") "
Jul 14 19:16:16.430799 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:16:16.430772    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/45d99327-6ee9-4fa6-ba50-07cfe6b6c15f-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "45d99327-6ee9-4fa6-ba50-07cfe6b6c15f" (UID: "45d99327-6ee9-4fa6-ba50-07cfe6b6c15f"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 19:16:16.430871 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:16:16.430801    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/45d99327-6ee9-4fa6-ba50-07cfe6b6c15f-service-ca" (OuterVolumeSpecName: "service-ca") pod "45d99327-6ee9-4fa6-ba50-07cfe6b6c15f" (UID: "45d99327-6ee9-4fa6-ba50-07cfe6b6c15f"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 19:16:16.430871 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:16:16.430809    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/45d99327-6ee9-4fa6-ba50-07cfe6b6c15f-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "45d99327-6ee9-4fa6-ba50-07cfe6b6c15f" (UID: "45d99327-6ee9-4fa6-ba50-07cfe6b6c15f"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 19:16:16.430871 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:16:16.430865    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/45d99327-6ee9-4fa6-ba50-07cfe6b6c15f-console-config" (OuterVolumeSpecName: "console-config") pod "45d99327-6ee9-4fa6-ba50-07cfe6b6c15f" (UID: "45d99327-6ee9-4fa6-ba50-07cfe6b6c15f"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 19:16:16.432621 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:16:16.432595    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/45d99327-6ee9-4fa6-ba50-07cfe6b6c15f-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "45d99327-6ee9-4fa6-ba50-07cfe6b6c15f" (UID: "45d99327-6ee9-4fa6-ba50-07cfe6b6c15f"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 19:16:16.432721 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:16:16.432650    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/45d99327-6ee9-4fa6-ba50-07cfe6b6c15f-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "45d99327-6ee9-4fa6-ba50-07cfe6b6c15f" (UID: "45d99327-6ee9-4fa6-ba50-07cfe6b6c15f"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 19:16:16.432721 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:16:16.432660    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/45d99327-6ee9-4fa6-ba50-07cfe6b6c15f-kube-api-access-jbk8s" (OuterVolumeSpecName: "kube-api-access-jbk8s") pod "45d99327-6ee9-4fa6-ba50-07cfe6b6c15f" (UID: "45d99327-6ee9-4fa6-ba50-07cfe6b6c15f"). InnerVolumeSpecName "kube-api-access-jbk8s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 19:16:16.531213 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:16:16.531180    2565 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/45d99327-6ee9-4fa6-ba50-07cfe6b6c15f-service-ca\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Jul 14 19:16:16.531213 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:16:16.531205    2565 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/45d99327-6ee9-4fa6-ba50-07cfe6b6c15f-console-config\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Jul 14 19:16:16.531213 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:16:16.531214    2565 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/45d99327-6ee9-4fa6-ba50-07cfe6b6c15f-console-oauth-config\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Jul 14 19:16:16.531413 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:16:16.531224    2565 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/45d99327-6ee9-4fa6-ba50-07cfe6b6c15f-oauth-serving-cert\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Jul 14 19:16:16.531413 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:16:16.531233    2565 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/45d99327-6ee9-4fa6-ba50-07cfe6b6c15f-console-serving-cert\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Jul 14 19:16:16.531413 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:16:16.531241    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jbk8s\" (UniqueName: \"kubernetes.io/projected/45d99327-6ee9-4fa6-ba50-07cfe6b6c15f-kube-api-access-jbk8s\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Jul 14 19:16:16.531413 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:16:16.531250    2565 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/45d99327-6ee9-4fa6-ba50-07cfe6b6c15f-trusted-ca-bundle\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Jul 14 19:16:17.045482 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:16:17.045445    2565 generic.go:356] "Generic (PLEG): container finished" podID="45d99327-6ee9-4fa6-ba50-07cfe6b6c15f" containerID="545ba6a05b9f266ac3714ec845bd13e219d6d1ff7f0fdcd1840ae8e8d5dc8e95" exitCode=0
Jul 14 19:16:17.045883 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:16:17.045493    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-848497c6b9-89ks6"
Jul 14 19:16:17.045883 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:16:17.045505    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-848497c6b9-89ks6" event={"ID":"45d99327-6ee9-4fa6-ba50-07cfe6b6c15f","Type":"ContainerDied","Data":"545ba6a05b9f266ac3714ec845bd13e219d6d1ff7f0fdcd1840ae8e8d5dc8e95"}
Jul 14 19:16:17.045883 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:16:17.045554    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-848497c6b9-89ks6" event={"ID":"45d99327-6ee9-4fa6-ba50-07cfe6b6c15f","Type":"ContainerDied","Data":"95fa2b44908bcb60919384eba2dab7991c6121fd86152b600f20219235c5f6b2"}
Jul 14 19:16:17.045883 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:16:17.045581    2565 scope.go:117] "RemoveContainer" containerID="545ba6a05b9f266ac3714ec845bd13e219d6d1ff7f0fdcd1840ae8e8d5dc8e95"
Jul 14 19:16:17.053880 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:16:17.053866    2565 scope.go:117] "RemoveContainer" containerID="545ba6a05b9f266ac3714ec845bd13e219d6d1ff7f0fdcd1840ae8e8d5dc8e95"
Jul 14 19:16:17.054144 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:16:17.054128    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"545ba6a05b9f266ac3714ec845bd13e219d6d1ff7f0fdcd1840ae8e8d5dc8e95\": container with ID starting with 545ba6a05b9f266ac3714ec845bd13e219d6d1ff7f0fdcd1840ae8e8d5dc8e95 not found: ID does not exist" containerID="545ba6a05b9f266ac3714ec845bd13e219d6d1ff7f0fdcd1840ae8e8d5dc8e95"
Jul 14 19:16:17.054205 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:16:17.054172    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"545ba6a05b9f266ac3714ec845bd13e219d6d1ff7f0fdcd1840ae8e8d5dc8e95"} err="failed to get container status \"545ba6a05b9f266ac3714ec845bd13e219d6d1ff7f0fdcd1840ae8e8d5dc8e95\": rpc error: code = NotFound desc = could not find container \"545ba6a05b9f266ac3714ec845bd13e219d6d1ff7f0fdcd1840ae8e8d5dc8e95\": container with ID starting with 545ba6a05b9f266ac3714ec845bd13e219d6d1ff7f0fdcd1840ae8e8d5dc8e95 not found: ID does not exist"
Jul 14 19:16:17.067399 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:16:17.067376    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-848497c6b9-89ks6"]
Jul 14 19:16:17.070258 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:16:17.070241    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-848497c6b9-89ks6"]
Jul 14 19:16:17.967462 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:16:17.967429    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="45d99327-6ee9-4fa6-ba50-07cfe6b6c15f" path="/var/lib/kubelet/pods/45d99327-6ee9-4fa6-ba50-07cfe6b6c15f/volumes"
Jul 14 19:16:19.627092 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:16:19.627057    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-68dcbc58c-w8rtn"
Jul 14 19:16:19.630784 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:16:19.630757    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-68dcbc58c-w8rtn"
Jul 14 19:16:56.787606 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:16:56.787567    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 14 19:16:56.788105 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:16:56.788005    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4c01c8da-c276-4b74-8f64-16bdc3e0237a" containerName="registry"
Jul 14 19:16:56.788105 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:16:56.788023    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="4c01c8da-c276-4b74-8f64-16bdc3e0237a" containerName="registry"
Jul 14 19:16:56.788105 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:16:56.788036    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="45d99327-6ee9-4fa6-ba50-07cfe6b6c15f" containerName="console"
Jul 14 19:16:56.788105 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:16:56.788044    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="45d99327-6ee9-4fa6-ba50-07cfe6b6c15f" containerName="console"
Jul 14 19:16:56.788359 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:16:56.788122    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="45d99327-6ee9-4fa6-ba50-07cfe6b6c15f" containerName="console"
Jul 14 19:16:56.788359 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:16:56.788140    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="4c01c8da-c276-4b74-8f64-16bdc3e0237a" containerName="registry"
Jul 14 19:16:56.791412 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:16:56.791389    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 14 19:16:56.795425 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:16:56.795400    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 14 19:16:56.795551 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:16:56.795431    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 14 19:16:56.795551 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:16:56.795457    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 14 19:16:56.795551 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:16:56.795404    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 14 19:16:56.795551 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:16:56.795401    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 14 19:16:56.795551 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:16:56.795400    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 14 19:16:56.795871 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:16:56.795582    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 14 19:16:56.795871 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:16:56.795648    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 14 19:16:56.796343 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:16:56.796326    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-94brn\""
Jul 14 19:16:56.799780 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:16:56.799760    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 14 19:16:56.804722 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:16:56.804701    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 14 19:16:56.837937 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:16:56.837908    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/7d74bf17-154e-4367-8adc-2dd1505a99d5-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"7d74bf17-154e-4367-8adc-2dd1505a99d5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 19:16:56.838075 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:16:56.837946    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7d74bf17-154e-4367-8adc-2dd1505a99d5-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"7d74bf17-154e-4367-8adc-2dd1505a99d5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 19:16:56.838075 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:16:56.837963    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fg9vd\" (UniqueName: \"kubernetes.io/projected/7d74bf17-154e-4367-8adc-2dd1505a99d5-kube-api-access-fg9vd\") pod \"alertmanager-main-0\" (UID: \"7d74bf17-154e-4367-8adc-2dd1505a99d5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 19:16:56.838075 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:16:56.837982    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7d74bf17-154e-4367-8adc-2dd1505a99d5-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"7d74bf17-154e-4367-8adc-2dd1505a99d5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 19:16:56.838075 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:16:56.838067    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/7d74bf17-154e-4367-8adc-2dd1505a99d5-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"7d74bf17-154e-4367-8adc-2dd1505a99d5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 19:16:56.838242 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:16:56.838098    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7d74bf17-154e-4367-8adc-2dd1505a99d5-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"7d74bf17-154e-4367-8adc-2dd1505a99d5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 19:16:56.838242 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:16:56.838146    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/7d74bf17-154e-4367-8adc-2dd1505a99d5-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"7d74bf17-154e-4367-8adc-2dd1505a99d5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 19:16:56.838242 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:16:56.838187    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7d74bf17-154e-4367-8adc-2dd1505a99d5-web-config\") pod \"alertmanager-main-0\" (UID: \"7d74bf17-154e-4367-8adc-2dd1505a99d5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 19:16:56.838242 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:16:56.838209    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7d74bf17-154e-4367-8adc-2dd1505a99d5-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"7d74bf17-154e-4367-8adc-2dd1505a99d5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 19:16:56.838242 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:16:56.838240    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/7d74bf17-154e-4367-8adc-2dd1505a99d5-config-volume\") pod \"alertmanager-main-0\" (UID: \"7d74bf17-154e-4367-8adc-2dd1505a99d5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 19:16:56.838392 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:16:56.838255    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7d74bf17-154e-4367-8adc-2dd1505a99d5-tls-assets\") pod \"alertmanager-main-0\" (UID: \"7d74bf17-154e-4367-8adc-2dd1505a99d5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 19:16:56.838392 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:16:56.838274    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7d74bf17-154e-4367-8adc-2dd1505a99d5-config-out\") pod \"alertmanager-main-0\" (UID: \"7d74bf17-154e-4367-8adc-2dd1505a99d5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 19:16:56.838392 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:16:56.838332    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7d74bf17-154e-4367-8adc-2dd1505a99d5-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"7d74bf17-154e-4367-8adc-2dd1505a99d5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 19:16:56.939517 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:16:56.939486    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7d74bf17-154e-4367-8adc-2dd1505a99d5-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"7d74bf17-154e-4367-8adc-2dd1505a99d5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 19:16:56.939517 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:16:56.939522    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/7d74bf17-154e-4367-8adc-2dd1505a99d5-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"7d74bf17-154e-4367-8adc-2dd1505a99d5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 19:16:56.939702 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:16:56.939551    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7d74bf17-154e-4367-8adc-2dd1505a99d5-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"7d74bf17-154e-4367-8adc-2dd1505a99d5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 19:16:56.939702 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:16:56.939566    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fg9vd\" (UniqueName: \"kubernetes.io/projected/7d74bf17-154e-4367-8adc-2dd1505a99d5-kube-api-access-fg9vd\") pod \"alertmanager-main-0\" (UID: \"7d74bf17-154e-4367-8adc-2dd1505a99d5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 19:16:56.939702 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:16:56.939589    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7d74bf17-154e-4367-8adc-2dd1505a99d5-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"7d74bf17-154e-4367-8adc-2dd1505a99d5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 19:16:56.939838 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:16:56.939752    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/7d74bf17-154e-4367-8adc-2dd1505a99d5-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"7d74bf17-154e-4367-8adc-2dd1505a99d5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 19:16:56.939838 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:16:56.939795    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7d74bf17-154e-4367-8adc-2dd1505a99d5-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"7d74bf17-154e-4367-8adc-2dd1505a99d5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 19:16:56.939940 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:16:56.939837    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/7d74bf17-154e-4367-8adc-2dd1505a99d5-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"7d74bf17-154e-4367-8adc-2dd1505a99d5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 19:16:56.939940 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:16:56.939868    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7d74bf17-154e-4367-8adc-2dd1505a99d5-web-config\") pod \"alertmanager-main-0\" (UID: \"7d74bf17-154e-4367-8adc-2dd1505a99d5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 19:16:56.939940 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:16:56.939907    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7d74bf17-154e-4367-8adc-2dd1505a99d5-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"7d74bf17-154e-4367-8adc-2dd1505a99d5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 19:16:56.940087 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:16:56.939940    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/7d74bf17-154e-4367-8adc-2dd1505a99d5-config-volume\") pod \"alertmanager-main-0\" (UID: \"7d74bf17-154e-4367-8adc-2dd1505a99d5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 19:16:56.940087 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:16:56.939970    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7d74bf17-154e-4367-8adc-2dd1505a99d5-tls-assets\") pod \"alertmanager-main-0\" (UID: \"7d74bf17-154e-4367-8adc-2dd1505a99d5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 19:16:56.940087 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:16:56.940005    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7d74bf17-154e-4367-8adc-2dd1505a99d5-config-out\") pod \"alertmanager-main-0\" (UID: \"7d74bf17-154e-4367-8adc-2dd1505a99d5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 19:16:56.940285 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:16:56.940127    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/7d74bf17-154e-4367-8adc-2dd1505a99d5-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"7d74bf17-154e-4367-8adc-2dd1505a99d5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 19:16:56.940805 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:16:56.940781    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7d74bf17-154e-4367-8adc-2dd1505a99d5-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"7d74bf17-154e-4367-8adc-2dd1505a99d5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 19:16:56.941144 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:16:56.941052    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7d74bf17-154e-4367-8adc-2dd1505a99d5-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"7d74bf17-154e-4367-8adc-2dd1505a99d5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 19:16:56.942789 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:16:56.942754    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7d74bf17-154e-4367-8adc-2dd1505a99d5-config-out\") pod \"alertmanager-main-0\" (UID: \"7d74bf17-154e-4367-8adc-2dd1505a99d5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 19:16:56.942789 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:16:56.942776    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7d74bf17-154e-4367-8adc-2dd1505a99d5-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"7d74bf17-154e-4367-8adc-2dd1505a99d5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 19:16:56.942938 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:16:56.942892    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7d74bf17-154e-4367-8adc-2dd1505a99d5-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"7d74bf17-154e-4367-8adc-2dd1505a99d5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 19:16:56.943100 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:16:56.943078    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7d74bf17-154e-4367-8adc-2dd1505a99d5-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"7d74bf17-154e-4367-8adc-2dd1505a99d5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 19:16:56.943510 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:16:56.943493    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/7d74bf17-154e-4367-8adc-2dd1505a99d5-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"7d74bf17-154e-4367-8adc-2dd1505a99d5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 19:16:56.943668 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:16:56.943644    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/7d74bf17-154e-4367-8adc-2dd1505a99d5-config-volume\") pod \"alertmanager-main-0\" (UID: \"7d74bf17-154e-4367-8adc-2dd1505a99d5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 19:16:56.944174 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:16:56.944137    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7d74bf17-154e-4367-8adc-2dd1505a99d5-web-config\") pod \"alertmanager-main-0\" (UID: \"7d74bf17-154e-4367-8adc-2dd1505a99d5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 19:16:56.944392 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:16:56.944370    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/7d74bf17-154e-4367-8adc-2dd1505a99d5-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"7d74bf17-154e-4367-8adc-2dd1505a99d5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 19:16:56.945207 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:16:56.945186    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7d74bf17-154e-4367-8adc-2dd1505a99d5-tls-assets\") pod \"alertmanager-main-0\" (UID: \"7d74bf17-154e-4367-8adc-2dd1505a99d5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 19:16:56.949197 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:16:56.949134    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fg9vd\" (UniqueName: \"kubernetes.io/projected/7d74bf17-154e-4367-8adc-2dd1505a99d5-kube-api-access-fg9vd\") pod \"alertmanager-main-0\" (UID: \"7d74bf17-154e-4367-8adc-2dd1505a99d5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 19:16:57.102206 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:16:57.102121    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 14 19:16:57.249550 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:16:57.249517    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 14 19:16:57.252733 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:16:57.252696    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d74bf17_154e_4367_8adc_2dd1505a99d5.slice/crio-584fb2ef724ebeb7620e5a775ae7cf904d2926f67d26d2087abb4e2b93c88510 WatchSource:0}: Error finding container 584fb2ef724ebeb7620e5a775ae7cf904d2926f67d26d2087abb4e2b93c88510: Status 404 returned error can't find the container with id 584fb2ef724ebeb7620e5a775ae7cf904d2926f67d26d2087abb4e2b93c88510
Jul 14 19:16:57.254778 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:16:57.254761    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 14 19:16:58.201516 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:16:58.201484    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7d74bf17-154e-4367-8adc-2dd1505a99d5","Type":"ContainerStarted","Data":"584fb2ef724ebeb7620e5a775ae7cf904d2926f67d26d2087abb4e2b93c88510"}
Jul 14 19:17:02.218004 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:17:02.217912    2565 generic.go:356] "Generic (PLEG): container finished" podID="7d74bf17-154e-4367-8adc-2dd1505a99d5" containerID="fc65a43e6df97f33d6b5f7e32acda49d22fc5f76613dbedb0c2137d5884823c3" exitCode=0
Jul 14 19:17:02.218004 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:17:02.217970    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7d74bf17-154e-4367-8adc-2dd1505a99d5","Type":"ContainerDied","Data":"fc65a43e6df97f33d6b5f7e32acda49d22fc5f76613dbedb0c2137d5884823c3"}
Jul 14 19:17:04.592377 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:17:04.592344    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5cbf99bc46-796m7"]
Jul 14 19:17:04.595070 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:17:04.595045    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5cbf99bc46-796m7"
Jul 14 19:17:04.608909 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:17:04.608884    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5cbf99bc46-796m7"]
Jul 14 19:17:04.703329 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:17:04.703235    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-djhvf\" (UniqueName: \"kubernetes.io/projected/282816e8-8771-4495-a204-3c174f6ac510-kube-api-access-djhvf\") pod \"console-5cbf99bc46-796m7\" (UID: \"282816e8-8771-4495-a204-3c174f6ac510\") " pod="openshift-console/console-5cbf99bc46-796m7"
Jul 14 19:17:04.703329 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:17:04.703296    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/282816e8-8771-4495-a204-3c174f6ac510-oauth-serving-cert\") pod \"console-5cbf99bc46-796m7\" (UID: \"282816e8-8771-4495-a204-3c174f6ac510\") " pod="openshift-console/console-5cbf99bc46-796m7"
Jul 14 19:17:04.703517 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:17:04.703377    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/282816e8-8771-4495-a204-3c174f6ac510-service-ca\") pod \"console-5cbf99bc46-796m7\" (UID: \"282816e8-8771-4495-a204-3c174f6ac510\") " pod="openshift-console/console-5cbf99bc46-796m7"
Jul 14 19:17:04.703517 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:17:04.703404    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/282816e8-8771-4495-a204-3c174f6ac510-trusted-ca-bundle\") pod \"console-5cbf99bc46-796m7\" (UID: \"282816e8-8771-4495-a204-3c174f6ac510\") " pod="openshift-console/console-5cbf99bc46-796m7"
Jul 14 19:17:04.703517 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:17:04.703434    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/282816e8-8771-4495-a204-3c174f6ac510-console-serving-cert\") pod \"console-5cbf99bc46-796m7\" (UID: \"282816e8-8771-4495-a204-3c174f6ac510\") " pod="openshift-console/console-5cbf99bc46-796m7"
Jul 14 19:17:04.703517 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:17:04.703506    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/282816e8-8771-4495-a204-3c174f6ac510-console-config\") pod \"console-5cbf99bc46-796m7\" (UID: \"282816e8-8771-4495-a204-3c174f6ac510\") " pod="openshift-console/console-5cbf99bc46-796m7"
Jul 14 19:17:04.703724 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:17:04.703550    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/282816e8-8771-4495-a204-3c174f6ac510-console-oauth-config\") pod \"console-5cbf99bc46-796m7\" (UID: \"282816e8-8771-4495-a204-3c174f6ac510\") " pod="openshift-console/console-5cbf99bc46-796m7"
Jul 14 19:17:04.804041 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:17:04.804006    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-djhvf\" (UniqueName: \"kubernetes.io/projected/282816e8-8771-4495-a204-3c174f6ac510-kube-api-access-djhvf\") pod \"console-5cbf99bc46-796m7\" (UID: \"282816e8-8771-4495-a204-3c174f6ac510\") " pod="openshift-console/console-5cbf99bc46-796m7"
Jul 14 19:17:04.804257 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:17:04.804058    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/282816e8-8771-4495-a204-3c174f6ac510-oauth-serving-cert\") pod \"console-5cbf99bc46-796m7\" (UID: \"282816e8-8771-4495-a204-3c174f6ac510\") " pod="openshift-console/console-5cbf99bc46-796m7"
Jul 14 19:17:04.804257 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:17:04.804089    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/282816e8-8771-4495-a204-3c174f6ac510-service-ca\") pod \"console-5cbf99bc46-796m7\" (UID: \"282816e8-8771-4495-a204-3c174f6ac510\") " pod="openshift-console/console-5cbf99bc46-796m7"
Jul 14 19:17:04.804257 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:17:04.804105    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/282816e8-8771-4495-a204-3c174f6ac510-trusted-ca-bundle\") pod \"console-5cbf99bc46-796m7\" (UID: \"282816e8-8771-4495-a204-3c174f6ac510\") " pod="openshift-console/console-5cbf99bc46-796m7"
Jul 14 19:17:04.804257 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:17:04.804128    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/282816e8-8771-4495-a204-3c174f6ac510-console-serving-cert\") pod \"console-5cbf99bc46-796m7\" (UID: \"282816e8-8771-4495-a204-3c174f6ac510\") " pod="openshift-console/console-5cbf99bc46-796m7"
Jul 14 19:17:04.804257 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:17:04.804148    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/282816e8-8771-4495-a204-3c174f6ac510-console-config\") pod \"console-5cbf99bc46-796m7\" (UID: \"282816e8-8771-4495-a204-3c174f6ac510\") " pod="openshift-console/console-5cbf99bc46-796m7"
Jul 14 19:17:04.804257 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:17:04.804214    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/282816e8-8771-4495-a204-3c174f6ac510-console-oauth-config\") pod \"console-5cbf99bc46-796m7\" (UID: \"282816e8-8771-4495-a204-3c174f6ac510\") " pod="openshift-console/console-5cbf99bc46-796m7"
Jul 14 19:17:04.805012 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:17:04.804937    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/282816e8-8771-4495-a204-3c174f6ac510-service-ca\") pod \"console-5cbf99bc46-796m7\" (UID: \"282816e8-8771-4495-a204-3c174f6ac510\") " pod="openshift-console/console-5cbf99bc46-796m7"
Jul 14 19:17:04.805012 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:17:04.804960    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/282816e8-8771-4495-a204-3c174f6ac510-oauth-serving-cert\") pod \"console-5cbf99bc46-796m7\" (UID: \"282816e8-8771-4495-a204-3c174f6ac510\") " pod="openshift-console/console-5cbf99bc46-796m7"
Jul 14 19:17:04.805012 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:17:04.805002    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/282816e8-8771-4495-a204-3c174f6ac510-console-config\") pod \"console-5cbf99bc46-796m7\" (UID: \"282816e8-8771-4495-a204-3c174f6ac510\") " pod="openshift-console/console-5cbf99bc46-796m7"
Jul 14 19:17:04.805012 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:17:04.805039    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/282816e8-8771-4495-a204-3c174f6ac510-trusted-ca-bundle\") pod \"console-5cbf99bc46-796m7\" (UID: \"282816e8-8771-4495-a204-3c174f6ac510\") " pod="openshift-console/console-5cbf99bc46-796m7"
Jul 14 19:17:04.806813 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:17:04.806792    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/282816e8-8771-4495-a204-3c174f6ac510-console-serving-cert\") pod \"console-5cbf99bc46-796m7\" (UID: \"282816e8-8771-4495-a204-3c174f6ac510\") " pod="openshift-console/console-5cbf99bc46-796m7"
Jul 14 19:17:04.806901 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:17:04.806833    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/282816e8-8771-4495-a204-3c174f6ac510-console-oauth-config\") pod \"console-5cbf99bc46-796m7\" (UID: \"282816e8-8771-4495-a204-3c174f6ac510\") " pod="openshift-console/console-5cbf99bc46-796m7"
Jul 14 19:17:04.822083 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:17:04.822064    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-djhvf\" (UniqueName: \"kubernetes.io/projected/282816e8-8771-4495-a204-3c174f6ac510-kube-api-access-djhvf\") pod \"console-5cbf99bc46-796m7\" (UID: \"282816e8-8771-4495-a204-3c174f6ac510\") " pod="openshift-console/console-5cbf99bc46-796m7"
Jul 14 19:17:04.904822 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:17:04.904794    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5cbf99bc46-796m7"
Jul 14 19:17:05.046403 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:17:05.046367    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5cbf99bc46-796m7"]
Jul 14 19:17:05.049406 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:17:05.049382    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod282816e8_8771_4495_a204_3c174f6ac510.slice/crio-79ebab5a61cdebff8829c1a64e9c689e2f1062e14b4e80984e125321c7b34cbc WatchSource:0}: Error finding container 79ebab5a61cdebff8829c1a64e9c689e2f1062e14b4e80984e125321c7b34cbc: Status 404 returned error can't find the container with id 79ebab5a61cdebff8829c1a64e9c689e2f1062e14b4e80984e125321c7b34cbc
Jul 14 19:17:05.231308 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:17:05.231270    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5cbf99bc46-796m7" event={"ID":"282816e8-8771-4495-a204-3c174f6ac510","Type":"ContainerStarted","Data":"2db894f5734a814a282f6d088893b7c0908714e339091d6012f0379940ed6c6a"}
Jul 14 19:17:05.231437 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:17:05.231329    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5cbf99bc46-796m7" event={"ID":"282816e8-8771-4495-a204-3c174f6ac510","Type":"ContainerStarted","Data":"79ebab5a61cdebff8829c1a64e9c689e2f1062e14b4e80984e125321c7b34cbc"}
Jul 14 19:17:05.234678 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:17:05.234652    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7d74bf17-154e-4367-8adc-2dd1505a99d5","Type":"ContainerStarted","Data":"4ec8858e384df1c7702b1b40c1234894fc3432998f37eb3dcf92570c1f5f6e79"}
Jul 14 19:17:05.234783 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:17:05.234713    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7d74bf17-154e-4367-8adc-2dd1505a99d5","Type":"ContainerStarted","Data":"fc5da61b4a239a2bff9afd7a819471b2c9cd1b4131c5e8b2c2f4e442f300c556"}
Jul 14 19:17:05.234783 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:17:05.234747    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7d74bf17-154e-4367-8adc-2dd1505a99d5","Type":"ContainerStarted","Data":"f53a42b112c74eb724d3af2a1322db9016021ae171aa58b062d1ca7516d844ef"}
Jul 14 19:17:05.234854 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:17:05.234772    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7d74bf17-154e-4367-8adc-2dd1505a99d5","Type":"ContainerStarted","Data":"d4724a7410264e2abad3a61f68b42464a56d43446fe805f4e210d4b833749d3e"}
Jul 14 19:17:05.234854 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:17:05.234806    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7d74bf17-154e-4367-8adc-2dd1505a99d5","Type":"ContainerStarted","Data":"564a67b72f528ba5cd2c7676eb154dbd3a74258874ee0dfd0cb47ec8c34025c3"}
Jul 14 19:17:05.234910 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:17:05.234841    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7d74bf17-154e-4367-8adc-2dd1505a99d5","Type":"ContainerStarted","Data":"5503ee36cbb8c96770b793a3a302dc912cea00ecb0f1d3f71ffa6c650b42b82f"}
Jul 14 19:17:05.252162 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:17:05.252117    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5cbf99bc46-796m7" podStartSLOduration=1.25210278 podStartE2EDuration="1.25210278s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 19:17:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:17:05.250790896 +0000 UTC m=+371.811647800" watchObservedRunningTime="2026-07-14 19:17:05.25210278 +0000 UTC m=+371.812959741"
Jul 14 19:17:05.278682 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:17:05.278637    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.7746785149999997 podStartE2EDuration="9.278624536s" totalImagesPullingTime="6.487759825s" totalInitContainerRuntime="16.186196ms" isStatefulPod=false podCreationTimestamp="2026-07-14 19:16:56 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:17:05.276464136 +0000 UTC m=+371.837321051" watchObservedRunningTime="2026-07-14 19:17:05.278624536 +0000 UTC m=+371.839481426"
Jul 14 19:17:07.728046 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:17:07.728011    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a2ef2d8f-5f7b-41bd-b98a-2a272dd4090f-metrics-certs\") pod \"network-metrics-daemon-hbbrx\" (UID: \"a2ef2d8f-5f7b-41bd-b98a-2a272dd4090f\") " pod="openshift-multus/network-metrics-daemon-hbbrx"
Jul 14 19:17:07.730437 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:17:07.730417    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a2ef2d8f-5f7b-41bd-b98a-2a272dd4090f-metrics-certs\") pod \"network-metrics-daemon-hbbrx\" (UID: \"a2ef2d8f-5f7b-41bd-b98a-2a272dd4090f\") " pod="openshift-multus/network-metrics-daemon-hbbrx"
Jul 14 19:17:07.966167 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:17:07.966118    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-xxpfz\""
Jul 14 19:17:07.974146 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:17:07.974118    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hbbrx"
Jul 14 19:17:08.100438 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:17:08.100414    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-hbbrx"]
Jul 14 19:17:08.103144 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:17:08.103120    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda2ef2d8f_5f7b_41bd_b98a_2a272dd4090f.slice/crio-1775594bf001abdc6907589d95d1eaf88b061b30c195da35d12d5d7818bdd535 WatchSource:0}: Error finding container 1775594bf001abdc6907589d95d1eaf88b061b30c195da35d12d5d7818bdd535: Status 404 returned error can't find the container with id 1775594bf001abdc6907589d95d1eaf88b061b30c195da35d12d5d7818bdd535
Jul 14 19:17:08.248005 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:17:08.247913    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-hbbrx" event={"ID":"a2ef2d8f-5f7b-41bd-b98a-2a272dd4090f","Type":"ContainerStarted","Data":"1775594bf001abdc6907589d95d1eaf88b061b30c195da35d12d5d7818bdd535"}
Jul 14 19:17:12.266811 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:17:12.266776    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-hbbrx" event={"ID":"a2ef2d8f-5f7b-41bd-b98a-2a272dd4090f","Type":"ContainerStarted","Data":"8bc8a1f21a2195650d14995ec6e653011ca9ab0a37fa95da67ec6f9db88fc66a"}
Jul 14 19:17:13.272199 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:17:13.272147    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-hbbrx" event={"ID":"a2ef2d8f-5f7b-41bd-b98a-2a272dd4090f","Type":"ContainerStarted","Data":"ef8649abff796e66f653d0d9e475579f9cbeb98b3c47a092a13559a1411064f4"}
Jul 14 19:17:13.293250 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:17:13.293205    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-hbbrx" podStartSLOduration=376.283576726 podStartE2EDuration="6m20.293190914s" totalImagesPullingTime="4.009614188s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 19:10:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:17:13.291446224 +0000 UTC m=+379.852303115" watchObservedRunningTime="2026-07-14 19:17:13.293190914 +0000 UTC m=+379.854047805"
Jul 14 19:17:14.904965 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:17:14.904930    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5cbf99bc46-796m7"
Jul 14 19:17:14.905426 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:17:14.905008    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5cbf99bc46-796m7"
Jul 14 19:17:14.909912 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:17:14.909888    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5cbf99bc46-796m7"
Jul 14 19:17:15.283289 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:17:15.283258    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5cbf99bc46-796m7"
Jul 14 19:17:15.339508 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:17:15.339472    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7888dbdddd-2j6wh"]
Jul 14 19:17:40.361706 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:17:40.361661    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7888dbdddd-2j6wh" podUID="8e51690e-5691-4a29-a66e-1db42499954c" containerName="console" containerID="cri-o://dda04f3a3afe2f3edf663705e52e8640c40455112f57ad8627731444c9ecc958" gracePeriod=15
Jul 14 19:17:40.619217 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:17:40.619167    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7888dbdddd-2j6wh"
Jul 14 19:17:40.782854 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:17:40.782824    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8e51690e-5691-4a29-a66e-1db42499954c-console-oauth-config\") pod \"8e51690e-5691-4a29-a66e-1db42499954c\" (UID: \"8e51690e-5691-4a29-a66e-1db42499954c\") "
Jul 14 19:17:40.782977 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:17:40.782886    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8e51690e-5691-4a29-a66e-1db42499954c-service-ca\") pod \"8e51690e-5691-4a29-a66e-1db42499954c\" (UID: \"8e51690e-5691-4a29-a66e-1db42499954c\") "
Jul 14 19:17:40.782977 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:17:40.782908    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f4jvf\" (UniqueName: \"kubernetes.io/projected/8e51690e-5691-4a29-a66e-1db42499954c-kube-api-access-f4jvf\") pod \"8e51690e-5691-4a29-a66e-1db42499954c\" (UID: \"8e51690e-5691-4a29-a66e-1db42499954c\") "
Jul 14 19:17:40.782977 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:17:40.782932    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8e51690e-5691-4a29-a66e-1db42499954c-console-serving-cert\") pod \"8e51690e-5691-4a29-a66e-1db42499954c\" (UID: \"8e51690e-5691-4a29-a66e-1db42499954c\") "
Jul 14 19:17:40.782977 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:17:40.782954    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8e51690e-5691-4a29-a66e-1db42499954c-oauth-serving-cert\") pod \"8e51690e-5691-4a29-a66e-1db42499954c\" (UID: \"8e51690e-5691-4a29-a66e-1db42499954c\") "
Jul 14 19:17:40.782977 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:17:40.782975    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8e51690e-5691-4a29-a66e-1db42499954c-console-config\") pod \"8e51690e-5691-4a29-a66e-1db42499954c\" (UID: \"8e51690e-5691-4a29-a66e-1db42499954c\") "
Jul 14 19:17:40.783252 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:17:40.782991    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8e51690e-5691-4a29-a66e-1db42499954c-trusted-ca-bundle\") pod \"8e51690e-5691-4a29-a66e-1db42499954c\" (UID: \"8e51690e-5691-4a29-a66e-1db42499954c\") "
Jul 14 19:17:40.783451 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:17:40.783415    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8e51690e-5691-4a29-a66e-1db42499954c-service-ca" (OuterVolumeSpecName: "service-ca") pod "8e51690e-5691-4a29-a66e-1db42499954c" (UID: "8e51690e-5691-4a29-a66e-1db42499954c"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 19:17:40.783566 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:17:40.783423    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8e51690e-5691-4a29-a66e-1db42499954c-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "8e51690e-5691-4a29-a66e-1db42499954c" (UID: "8e51690e-5691-4a29-a66e-1db42499954c"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 19:17:40.783566 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:17:40.783482    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8e51690e-5691-4a29-a66e-1db42499954c-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "8e51690e-5691-4a29-a66e-1db42499954c" (UID: "8e51690e-5691-4a29-a66e-1db42499954c"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 19:17:40.783566 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:17:40.783497    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8e51690e-5691-4a29-a66e-1db42499954c-console-config" (OuterVolumeSpecName: "console-config") pod "8e51690e-5691-4a29-a66e-1db42499954c" (UID: "8e51690e-5691-4a29-a66e-1db42499954c"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 19:17:40.785282 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:17:40.785254    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8e51690e-5691-4a29-a66e-1db42499954c-kube-api-access-f4jvf" (OuterVolumeSpecName: "kube-api-access-f4jvf") pod "8e51690e-5691-4a29-a66e-1db42499954c" (UID: "8e51690e-5691-4a29-a66e-1db42499954c"). InnerVolumeSpecName "kube-api-access-f4jvf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 19:17:40.785631 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:17:40.785610    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8e51690e-5691-4a29-a66e-1db42499954c-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "8e51690e-5691-4a29-a66e-1db42499954c" (UID: "8e51690e-5691-4a29-a66e-1db42499954c"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 19:17:40.785700 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:17:40.785643    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8e51690e-5691-4a29-a66e-1db42499954c-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "8e51690e-5691-4a29-a66e-1db42499954c" (UID: "8e51690e-5691-4a29-a66e-1db42499954c"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 19:17:40.883706 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:17:40.883643    2565 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8e51690e-5691-4a29-a66e-1db42499954c-console-config\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Jul 14 19:17:40.883706 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:17:40.883675    2565 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8e51690e-5691-4a29-a66e-1db42499954c-trusted-ca-bundle\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Jul 14 19:17:40.883706 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:17:40.883685    2565 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8e51690e-5691-4a29-a66e-1db42499954c-console-oauth-config\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Jul 14 19:17:40.883706 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:17:40.883694    2565 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8e51690e-5691-4a29-a66e-1db42499954c-service-ca\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Jul 14 19:17:40.883706 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:17:40.883704    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f4jvf\" (UniqueName: \"kubernetes.io/projected/8e51690e-5691-4a29-a66e-1db42499954c-kube-api-access-f4jvf\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Jul 14 19:17:40.883706 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:17:40.883712    2565 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8e51690e-5691-4a29-a66e-1db42499954c-console-serving-cert\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Jul 14 19:17:40.883944 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:17:40.883721    2565 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8e51690e-5691-4a29-a66e-1db42499954c-oauth-serving-cert\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Jul 14 19:17:41.387896 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:17:41.387865    2565 generic.go:356] "Generic (PLEG): container finished" podID="8e51690e-5691-4a29-a66e-1db42499954c" containerID="dda04f3a3afe2f3edf663705e52e8640c40455112f57ad8627731444c9ecc958" exitCode=0
Jul 14 19:17:41.388320 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:17:41.387906    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7888dbdddd-2j6wh"
Jul 14 19:17:41.388320 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:17:41.387919    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7888dbdddd-2j6wh" event={"ID":"8e51690e-5691-4a29-a66e-1db42499954c","Type":"ContainerDied","Data":"dda04f3a3afe2f3edf663705e52e8640c40455112f57ad8627731444c9ecc958"}
Jul 14 19:17:41.388320 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:17:41.387957    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7888dbdddd-2j6wh" event={"ID":"8e51690e-5691-4a29-a66e-1db42499954c","Type":"ContainerDied","Data":"fe393de77f664ef4334f4abe33d7ffe5c15b08c4bcc97941d8b02d1ea743faa7"}
Jul 14 19:17:41.388320 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:17:41.387976    2565 scope.go:117] "RemoveContainer" containerID="dda04f3a3afe2f3edf663705e52e8640c40455112f57ad8627731444c9ecc958"
Jul 14 19:17:41.396900 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:17:41.396882    2565 scope.go:117] "RemoveContainer" containerID="dda04f3a3afe2f3edf663705e52e8640c40455112f57ad8627731444c9ecc958"
Jul 14 19:17:41.397132 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:17:41.397115    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dda04f3a3afe2f3edf663705e52e8640c40455112f57ad8627731444c9ecc958\": container with ID starting with dda04f3a3afe2f3edf663705e52e8640c40455112f57ad8627731444c9ecc958 not found: ID does not exist" containerID="dda04f3a3afe2f3edf663705e52e8640c40455112f57ad8627731444c9ecc958"
Jul 14 19:17:41.397233 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:17:41.397142    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dda04f3a3afe2f3edf663705e52e8640c40455112f57ad8627731444c9ecc958"} err="failed to get container status \"dda04f3a3afe2f3edf663705e52e8640c40455112f57ad8627731444c9ecc958\": rpc error: code = NotFound desc = could not find container \"dda04f3a3afe2f3edf663705e52e8640c40455112f57ad8627731444c9ecc958\": container with ID starting with dda04f3a3afe2f3edf663705e52e8640c40455112f57ad8627731444c9ecc958 not found: ID does not exist"
Jul 14 19:17:41.408329 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:17:41.408306    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7888dbdddd-2j6wh"]
Jul 14 19:17:41.411638 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:17:41.411609    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7888dbdddd-2j6wh"]
Jul 14 19:17:41.967330 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:17:41.967297    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8e51690e-5691-4a29-a66e-1db42499954c" path="/var/lib/kubelet/pods/8e51690e-5691-4a29-a66e-1db42499954c/volumes"
Jul 14 19:18:11.119423 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:18:11.119390    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5cbb994989-bsmd9"]
Jul 14 19:18:11.119786 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:18:11.119719    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8e51690e-5691-4a29-a66e-1db42499954c" containerName="console"
Jul 14 19:18:11.119786 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:18:11.119731    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="8e51690e-5691-4a29-a66e-1db42499954c" containerName="console"
Jul 14 19:18:11.119786 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:18:11.119783    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="8e51690e-5691-4a29-a66e-1db42499954c" containerName="console"
Jul 14 19:18:11.124165 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:18:11.124138    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5cbb994989-bsmd9"
Jul 14 19:18:11.136206 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:18:11.136181    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5cbb994989-bsmd9"]
Jul 14 19:18:11.202612 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:18:11.202580    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b6f8731f-a5ed-489b-a730-390695475ace-console-config\") pod \"console-5cbb994989-bsmd9\" (UID: \"b6f8731f-a5ed-489b-a730-390695475ace\") " pod="openshift-console/console-5cbb994989-bsmd9"
Jul 14 19:18:11.202743 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:18:11.202650    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b6f8731f-a5ed-489b-a730-390695475ace-oauth-serving-cert\") pod \"console-5cbb994989-bsmd9\" (UID: \"b6f8731f-a5ed-489b-a730-390695475ace\") " pod="openshift-console/console-5cbb994989-bsmd9"
Jul 14 19:18:11.202743 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:18:11.202687    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b6f8731f-a5ed-489b-a730-390695475ace-console-oauth-config\") pod \"console-5cbb994989-bsmd9\" (UID: \"b6f8731f-a5ed-489b-a730-390695475ace\") " pod="openshift-console/console-5cbb994989-bsmd9"
Jul 14 19:18:11.202743 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:18:11.202729    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b6f8731f-a5ed-489b-a730-390695475ace-trusted-ca-bundle\") pod \"console-5cbb994989-bsmd9\" (UID: \"b6f8731f-a5ed-489b-a730-390695475ace\") " pod="openshift-console/console-5cbb994989-bsmd9"
Jul 14 19:18:11.202895 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:18:11.202757    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sfpkv\" (UniqueName: \"kubernetes.io/projected/b6f8731f-a5ed-489b-a730-390695475ace-kube-api-access-sfpkv\") pod \"console-5cbb994989-bsmd9\" (UID: \"b6f8731f-a5ed-489b-a730-390695475ace\") " pod="openshift-console/console-5cbb994989-bsmd9"
Jul 14 19:18:11.202895 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:18:11.202775    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b6f8731f-a5ed-489b-a730-390695475ace-console-serving-cert\") pod \"console-5cbb994989-bsmd9\" (UID: \"b6f8731f-a5ed-489b-a730-390695475ace\") " pod="openshift-console/console-5cbb994989-bsmd9"
Jul 14 19:18:11.202895 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:18:11.202854    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b6f8731f-a5ed-489b-a730-390695475ace-service-ca\") pod \"console-5cbb994989-bsmd9\" (UID: \"b6f8731f-a5ed-489b-a730-390695475ace\") " pod="openshift-console/console-5cbb994989-bsmd9"
Jul 14 19:18:11.303437 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:18:11.303409    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sfpkv\" (UniqueName: \"kubernetes.io/projected/b6f8731f-a5ed-489b-a730-390695475ace-kube-api-access-sfpkv\") pod \"console-5cbb994989-bsmd9\" (UID: \"b6f8731f-a5ed-489b-a730-390695475ace\") " pod="openshift-console/console-5cbb994989-bsmd9"
Jul 14 19:18:11.303437 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:18:11.303438    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b6f8731f-a5ed-489b-a730-390695475ace-console-serving-cert\") pod \"console-5cbb994989-bsmd9\" (UID: \"b6f8731f-a5ed-489b-a730-390695475ace\") " pod="openshift-console/console-5cbb994989-bsmd9"
Jul 14 19:18:11.303575 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:18:11.303461    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b6f8731f-a5ed-489b-a730-390695475ace-service-ca\") pod \"console-5cbb994989-bsmd9\" (UID: \"b6f8731f-a5ed-489b-a730-390695475ace\") " pod="openshift-console/console-5cbb994989-bsmd9"
Jul 14 19:18:11.303575 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:18:11.303478    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b6f8731f-a5ed-489b-a730-390695475ace-console-config\") pod \"console-5cbb994989-bsmd9\" (UID: \"b6f8731f-a5ed-489b-a730-390695475ace\") " pod="openshift-console/console-5cbb994989-bsmd9"
Jul 14 19:18:11.303575 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:18:11.303524    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b6f8731f-a5ed-489b-a730-390695475ace-oauth-serving-cert\") pod \"console-5cbb994989-bsmd9\" (UID: \"b6f8731f-a5ed-489b-a730-390695475ace\") " pod="openshift-console/console-5cbb994989-bsmd9"
Jul 14 19:18:11.303575 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:18:11.303544    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b6f8731f-a5ed-489b-a730-390695475ace-console-oauth-config\") pod \"console-5cbb994989-bsmd9\" (UID: \"b6f8731f-a5ed-489b-a730-390695475ace\") " pod="openshift-console/console-5cbb994989-bsmd9"
Jul 14 19:18:11.303575 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:18:11.303568    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b6f8731f-a5ed-489b-a730-390695475ace-trusted-ca-bundle\") pod \"console-5cbb994989-bsmd9\" (UID: \"b6f8731f-a5ed-489b-a730-390695475ace\") " pod="openshift-console/console-5cbb994989-bsmd9"
Jul 14 19:18:11.304242 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:18:11.304219    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b6f8731f-a5ed-489b-a730-390695475ace-service-ca\") pod \"console-5cbb994989-bsmd9\" (UID: \"b6f8731f-a5ed-489b-a730-390695475ace\") " pod="openshift-console/console-5cbb994989-bsmd9"
Jul 14 19:18:11.304400 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:18:11.304381    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b6f8731f-a5ed-489b-a730-390695475ace-trusted-ca-bundle\") pod \"console-5cbb994989-bsmd9\" (UID: \"b6f8731f-a5ed-489b-a730-390695475ace\") " pod="openshift-console/console-5cbb994989-bsmd9"
Jul 14 19:18:11.304469 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:18:11.304342    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b6f8731f-a5ed-489b-a730-390695475ace-console-config\") pod \"console-5cbb994989-bsmd9\" (UID: \"b6f8731f-a5ed-489b-a730-390695475ace\") " pod="openshift-console/console-5cbb994989-bsmd9"
Jul 14 19:18:11.304469 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:18:11.304303    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b6f8731f-a5ed-489b-a730-390695475ace-oauth-serving-cert\") pod \"console-5cbb994989-bsmd9\" (UID: \"b6f8731f-a5ed-489b-a730-390695475ace\") " pod="openshift-console/console-5cbb994989-bsmd9"
Jul 14 19:18:11.306031 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:18:11.306015    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b6f8731f-a5ed-489b-a730-390695475ace-console-serving-cert\") pod \"console-5cbb994989-bsmd9\" (UID: \"b6f8731f-a5ed-489b-a730-390695475ace\") " pod="openshift-console/console-5cbb994989-bsmd9"
Jul 14 19:18:11.306095 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:18:11.306053    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b6f8731f-a5ed-489b-a730-390695475ace-console-oauth-config\") pod \"console-5cbb994989-bsmd9\" (UID: \"b6f8731f-a5ed-489b-a730-390695475ace\") " pod="openshift-console/console-5cbb994989-bsmd9"
Jul 14 19:18:11.310869 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:18:11.310852    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sfpkv\" (UniqueName: \"kubernetes.io/projected/b6f8731f-a5ed-489b-a730-390695475ace-kube-api-access-sfpkv\") pod \"console-5cbb994989-bsmd9\" (UID: \"b6f8731f-a5ed-489b-a730-390695475ace\") " pod="openshift-console/console-5cbb994989-bsmd9"
Jul 14 19:18:11.434804 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:18:11.434748    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5cbb994989-bsmd9"
Jul 14 19:18:11.566614 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:18:11.566591    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5cbb994989-bsmd9"]
Jul 14 19:18:11.568648 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:18:11.568618    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb6f8731f_a5ed_489b_a730_390695475ace.slice/crio-c4bb17529af6ac017fca19b110b7528d2da061deb208743ab86cfbded577615a WatchSource:0}: Error finding container c4bb17529af6ac017fca19b110b7528d2da061deb208743ab86cfbded577615a: Status 404 returned error can't find the container with id c4bb17529af6ac017fca19b110b7528d2da061deb208743ab86cfbded577615a
Jul 14 19:18:12.512512 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:18:12.512480    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5cbb994989-bsmd9" event={"ID":"b6f8731f-a5ed-489b-a730-390695475ace","Type":"ContainerStarted","Data":"e5056a3ce6e8fcf0188dc3e3ebdc37fff22d8485ffa46f65f86d2b7e03ecb964"}
Jul 14 19:18:12.512872 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:18:12.512524    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5cbb994989-bsmd9" event={"ID":"b6f8731f-a5ed-489b-a730-390695475ace","Type":"ContainerStarted","Data":"c4bb17529af6ac017fca19b110b7528d2da061deb208743ab86cfbded577615a"}
Jul 14 19:18:12.531226 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:18:12.531181    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5cbb994989-bsmd9" podStartSLOduration=1.531144871 podStartE2EDuration="1.531144871s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 19:18:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:18:12.529523373 +0000 UTC m=+439.090380266" watchObservedRunningTime="2026-07-14 19:18:12.531144871 +0000 UTC m=+439.092001764"
Jul 14 19:18:21.435957 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:18:21.435865    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5cbb994989-bsmd9"
Jul 14 19:18:21.435957 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:18:21.435933    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5cbb994989-bsmd9"
Jul 14 19:18:21.440731 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:18:21.440708    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5cbb994989-bsmd9"
Jul 14 19:18:21.551556 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:18:21.551532    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5cbb994989-bsmd9"
Jul 14 19:18:21.597509 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:18:21.597484    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5cbf99bc46-796m7"]
Jul 14 19:18:46.620127 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:18:46.620079    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5cbf99bc46-796m7" podUID="282816e8-8771-4495-a204-3c174f6ac510" containerName="console" containerID="cri-o://2db894f5734a814a282f6d088893b7c0908714e339091d6012f0379940ed6c6a" gracePeriod=15
Jul 14 19:18:46.863526 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:18:46.863503    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5cbf99bc46-796m7"
Jul 14 19:18:46.974294 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:18:46.974276    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/282816e8-8771-4495-a204-3c174f6ac510-console-oauth-config\") pod \"282816e8-8771-4495-a204-3c174f6ac510\" (UID: \"282816e8-8771-4495-a204-3c174f6ac510\") "
Jul 14 19:18:46.974433 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:18:46.974308    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-djhvf\" (UniqueName: \"kubernetes.io/projected/282816e8-8771-4495-a204-3c174f6ac510-kube-api-access-djhvf\") pod \"282816e8-8771-4495-a204-3c174f6ac510\" (UID: \"282816e8-8771-4495-a204-3c174f6ac510\") "
Jul 14 19:18:46.974433 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:18:46.974335    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/282816e8-8771-4495-a204-3c174f6ac510-trusted-ca-bundle\") pod \"282816e8-8771-4495-a204-3c174f6ac510\" (UID: \"282816e8-8771-4495-a204-3c174f6ac510\") "
Jul 14 19:18:46.974433 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:18:46.974383    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/282816e8-8771-4495-a204-3c174f6ac510-service-ca\") pod \"282816e8-8771-4495-a204-3c174f6ac510\" (UID: \"282816e8-8771-4495-a204-3c174f6ac510\") "
Jul 14 19:18:46.974433 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:18:46.974416    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/282816e8-8771-4495-a204-3c174f6ac510-oauth-serving-cert\") pod \"282816e8-8771-4495-a204-3c174f6ac510\" (UID: \"282816e8-8771-4495-a204-3c174f6ac510\") "
Jul 14 19:18:46.974604 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:18:46.974499    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/282816e8-8771-4495-a204-3c174f6ac510-console-serving-cert\") pod \"282816e8-8771-4495-a204-3c174f6ac510\" (UID: \"282816e8-8771-4495-a204-3c174f6ac510\") "
Jul 14 19:18:46.974604 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:18:46.974526    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/282816e8-8771-4495-a204-3c174f6ac510-console-config\") pod \"282816e8-8771-4495-a204-3c174f6ac510\" (UID: \"282816e8-8771-4495-a204-3c174f6ac510\") "
Jul 14 19:18:46.974932 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:18:46.974902    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/282816e8-8771-4495-a204-3c174f6ac510-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "282816e8-8771-4495-a204-3c174f6ac510" (UID: "282816e8-8771-4495-a204-3c174f6ac510"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 19:18:46.975187 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:18:46.974957    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/282816e8-8771-4495-a204-3c174f6ac510-service-ca" (OuterVolumeSpecName: "service-ca") pod "282816e8-8771-4495-a204-3c174f6ac510" (UID: "282816e8-8771-4495-a204-3c174f6ac510"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 19:18:46.975187 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:18:46.974991    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/282816e8-8771-4495-a204-3c174f6ac510-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "282816e8-8771-4495-a204-3c174f6ac510" (UID: "282816e8-8771-4495-a204-3c174f6ac510"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 19:18:46.975187 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:18:46.975061    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/282816e8-8771-4495-a204-3c174f6ac510-console-config" (OuterVolumeSpecName: "console-config") pod "282816e8-8771-4495-a204-3c174f6ac510" (UID: "282816e8-8771-4495-a204-3c174f6ac510"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 19:18:46.976555 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:18:46.976531    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/282816e8-8771-4495-a204-3c174f6ac510-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "282816e8-8771-4495-a204-3c174f6ac510" (UID: "282816e8-8771-4495-a204-3c174f6ac510"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 19:18:46.976664 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:18:46.976641    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/282816e8-8771-4495-a204-3c174f6ac510-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "282816e8-8771-4495-a204-3c174f6ac510" (UID: "282816e8-8771-4495-a204-3c174f6ac510"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 19:18:46.976727 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:18:46.976706    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/282816e8-8771-4495-a204-3c174f6ac510-kube-api-access-djhvf" (OuterVolumeSpecName: "kube-api-access-djhvf") pod "282816e8-8771-4495-a204-3c174f6ac510" (UID: "282816e8-8771-4495-a204-3c174f6ac510"). InnerVolumeSpecName "kube-api-access-djhvf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 19:18:47.075868 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:18:47.075846    2565 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/282816e8-8771-4495-a204-3c174f6ac510-console-serving-cert\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Jul 14 19:18:47.075868 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:18:47.075864    2565 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/282816e8-8771-4495-a204-3c174f6ac510-console-config\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Jul 14 19:18:47.075979 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:18:47.075873    2565 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/282816e8-8771-4495-a204-3c174f6ac510-console-oauth-config\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Jul 14 19:18:47.075979 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:18:47.075884    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-djhvf\" (UniqueName: \"kubernetes.io/projected/282816e8-8771-4495-a204-3c174f6ac510-kube-api-access-djhvf\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Jul 14 19:18:47.075979 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:18:47.075892    2565 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/282816e8-8771-4495-a204-3c174f6ac510-trusted-ca-bundle\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Jul 14 19:18:47.075979 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:18:47.075900    2565 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/282816e8-8771-4495-a204-3c174f6ac510-service-ca\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Jul 14 19:18:47.075979 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:18:47.075908    2565 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/282816e8-8771-4495-a204-3c174f6ac510-oauth-serving-cert\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Jul 14 19:18:47.652439 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:18:47.652403    2565 generic.go:356] "Generic (PLEG): container finished" podID="282816e8-8771-4495-a204-3c174f6ac510" containerID="2db894f5734a814a282f6d088893b7c0908714e339091d6012f0379940ed6c6a" exitCode=0
Jul 14 19:18:47.652876 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:18:47.652456    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5cbf99bc46-796m7"
Jul 14 19:18:47.652876 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:18:47.652486    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5cbf99bc46-796m7" event={"ID":"282816e8-8771-4495-a204-3c174f6ac510","Type":"ContainerDied","Data":"2db894f5734a814a282f6d088893b7c0908714e339091d6012f0379940ed6c6a"}
Jul 14 19:18:47.652876 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:18:47.652547    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5cbf99bc46-796m7" event={"ID":"282816e8-8771-4495-a204-3c174f6ac510","Type":"ContainerDied","Data":"79ebab5a61cdebff8829c1a64e9c689e2f1062e14b4e80984e125321c7b34cbc"}
Jul 14 19:18:47.652876 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:18:47.652572    2565 scope.go:117] "RemoveContainer" containerID="2db894f5734a814a282f6d088893b7c0908714e339091d6012f0379940ed6c6a"
Jul 14 19:18:47.663071 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:18:47.663051    2565 scope.go:117] "RemoveContainer" containerID="2db894f5734a814a282f6d088893b7c0908714e339091d6012f0379940ed6c6a"
Jul 14 19:18:47.663406 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:18:47.663387    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2db894f5734a814a282f6d088893b7c0908714e339091d6012f0379940ed6c6a\": container with ID starting with 2db894f5734a814a282f6d088893b7c0908714e339091d6012f0379940ed6c6a not found: ID does not exist" containerID="2db894f5734a814a282f6d088893b7c0908714e339091d6012f0379940ed6c6a"
Jul 14 19:18:47.663477 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:18:47.663416    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2db894f5734a814a282f6d088893b7c0908714e339091d6012f0379940ed6c6a"} err="failed to get container status \"2db894f5734a814a282f6d088893b7c0908714e339091d6012f0379940ed6c6a\": rpc error: code = NotFound desc = could not find container \"2db894f5734a814a282f6d088893b7c0908714e339091d6012f0379940ed6c6a\": container with ID starting with 2db894f5734a814a282f6d088893b7c0908714e339091d6012f0379940ed6c6a not found: ID does not exist"
Jul 14 19:18:47.676285 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:18:47.676258    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5cbf99bc46-796m7"]
Jul 14 19:18:47.680382 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:18:47.680359    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5cbf99bc46-796m7"]
Jul 14 19:18:47.966738 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:18:47.966672    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="282816e8-8771-4495-a204-3c174f6ac510" path="/var/lib/kubelet/pods/282816e8-8771-4495-a204-3c174f6ac510/volumes"
Jul 14 19:19:32.005050 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:19:32.005016    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540v4x5s"]
Jul 14 19:19:32.005602 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:19:32.005352    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="282816e8-8771-4495-a204-3c174f6ac510" containerName="console"
Jul 14 19:19:32.005602 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:19:32.005365    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="282816e8-8771-4495-a204-3c174f6ac510" containerName="console"
Jul 14 19:19:32.005602 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:19:32.005432    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="282816e8-8771-4495-a204-3c174f6ac510" containerName="console"
Jul 14 19:19:32.008518 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:19:32.008501    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540v4x5s"
Jul 14 19:19:32.011115 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:19:32.011092    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-ngskb\""
Jul 14 19:19:32.011263 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:19:32.011168    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 14 19:19:32.012104 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:19:32.012086    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 14 19:19:32.018091 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:19:32.018063    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540v4x5s"]
Jul 14 19:19:32.091192 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:19:32.091144    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3fa9c875-2543-46f8-b0ab-72fadac86986-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540v4x5s\" (UID: \"3fa9c875-2543-46f8-b0ab-72fadac86986\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540v4x5s"
Jul 14 19:19:32.091289 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:19:32.091198    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vj959\" (UniqueName: \"kubernetes.io/projected/3fa9c875-2543-46f8-b0ab-72fadac86986-kube-api-access-vj959\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540v4x5s\" (UID: \"3fa9c875-2543-46f8-b0ab-72fadac86986\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540v4x5s"
Jul 14 19:19:32.091330 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:19:32.091289    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3fa9c875-2543-46f8-b0ab-72fadac86986-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540v4x5s\" (UID: \"3fa9c875-2543-46f8-b0ab-72fadac86986\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540v4x5s"
Jul 14 19:19:32.191922 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:19:32.191900    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3fa9c875-2543-46f8-b0ab-72fadac86986-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540v4x5s\" (UID: \"3fa9c875-2543-46f8-b0ab-72fadac86986\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540v4x5s"
Jul 14 19:19:32.192013 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:19:32.191935    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3fa9c875-2543-46f8-b0ab-72fadac86986-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540v4x5s\" (UID: \"3fa9c875-2543-46f8-b0ab-72fadac86986\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540v4x5s"
Jul 14 19:19:32.192013 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:19:32.191953    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vj959\" (UniqueName: \"kubernetes.io/projected/3fa9c875-2543-46f8-b0ab-72fadac86986-kube-api-access-vj959\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540v4x5s\" (UID: \"3fa9c875-2543-46f8-b0ab-72fadac86986\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540v4x5s"
Jul 14 19:19:32.192280 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:19:32.192260    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3fa9c875-2543-46f8-b0ab-72fadac86986-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540v4x5s\" (UID: \"3fa9c875-2543-46f8-b0ab-72fadac86986\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540v4x5s"
Jul 14 19:19:32.192346 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:19:32.192330    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3fa9c875-2543-46f8-b0ab-72fadac86986-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540v4x5s\" (UID: \"3fa9c875-2543-46f8-b0ab-72fadac86986\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540v4x5s"
Jul 14 19:19:32.200232 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:19:32.200209    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vj959\" (UniqueName: \"kubernetes.io/projected/3fa9c875-2543-46f8-b0ab-72fadac86986-kube-api-access-vj959\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540v4x5s\" (UID: \"3fa9c875-2543-46f8-b0ab-72fadac86986\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540v4x5s"
Jul 14 19:19:32.318718 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:19:32.318657    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540v4x5s"
Jul 14 19:19:32.449196 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:19:32.449148    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540v4x5s"]
Jul 14 19:19:32.452332 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:19:32.452305    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3fa9c875_2543_46f8_b0ab_72fadac86986.slice/crio-35d5d77a8d72b32e21d269abcfbebba7dfb1b86ce251362afc2ebf5b9f3287fd WatchSource:0}: Error finding container 35d5d77a8d72b32e21d269abcfbebba7dfb1b86ce251362afc2ebf5b9f3287fd: Status 404 returned error can't find the container with id 35d5d77a8d72b32e21d269abcfbebba7dfb1b86ce251362afc2ebf5b9f3287fd
Jul 14 19:19:32.847551 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:19:32.847517    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540v4x5s" event={"ID":"3fa9c875-2543-46f8-b0ab-72fadac86986","Type":"ContainerStarted","Data":"35d5d77a8d72b32e21d269abcfbebba7dfb1b86ce251362afc2ebf5b9f3287fd"}
Jul 14 19:19:41.891964 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:19:41.891924    2565 generic.go:356] "Generic (PLEG): container finished" podID="3fa9c875-2543-46f8-b0ab-72fadac86986" containerID="043fcb0abae74d04beba2521d0ddf395e4dd897985259aabdb54e93a9a1e79db" exitCode=0
Jul 14 19:19:41.892425 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:19:41.891967    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540v4x5s" event={"ID":"3fa9c875-2543-46f8-b0ab-72fadac86986","Type":"ContainerDied","Data":"043fcb0abae74d04beba2521d0ddf395e4dd897985259aabdb54e93a9a1e79db"}
Jul 14 19:19:44.906112 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:19:44.906079    2565 generic.go:356] "Generic (PLEG): container finished" podID="3fa9c875-2543-46f8-b0ab-72fadac86986" containerID="563d2f400605f0b4f970af43750a69cb555deded02569245ad997ceddec14eae" exitCode=0
Jul 14 19:19:44.906497 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:19:44.906185    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540v4x5s" event={"ID":"3fa9c875-2543-46f8-b0ab-72fadac86986","Type":"ContainerDied","Data":"563d2f400605f0b4f970af43750a69cb555deded02569245ad997ceddec14eae"}
Jul 14 19:19:52.946040 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:19:52.945972    2565 generic.go:356] "Generic (PLEG): container finished" podID="3fa9c875-2543-46f8-b0ab-72fadac86986" containerID="853f9fd090f8c0d23723e7e5ab78fc0dc205eae20a101e86abe13b716ad310ad" exitCode=0
Jul 14 19:19:52.946348 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:19:52.946061    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540v4x5s" event={"ID":"3fa9c875-2543-46f8-b0ab-72fadac86986","Type":"ContainerDied","Data":"853f9fd090f8c0d23723e7e5ab78fc0dc205eae20a101e86abe13b716ad310ad"}
Jul 14 19:19:54.122468 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:19:54.122444    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540v4x5s"
Jul 14 19:19:54.162455 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:19:54.162430    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vj959\" (UniqueName: \"kubernetes.io/projected/3fa9c875-2543-46f8-b0ab-72fadac86986-kube-api-access-vj959\") pod \"3fa9c875-2543-46f8-b0ab-72fadac86986\" (UID: \"3fa9c875-2543-46f8-b0ab-72fadac86986\") "
Jul 14 19:19:54.162561 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:19:54.162490    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3fa9c875-2543-46f8-b0ab-72fadac86986-bundle\") pod \"3fa9c875-2543-46f8-b0ab-72fadac86986\" (UID: \"3fa9c875-2543-46f8-b0ab-72fadac86986\") "
Jul 14 19:19:54.162561 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:19:54.162512    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3fa9c875-2543-46f8-b0ab-72fadac86986-util\") pod \"3fa9c875-2543-46f8-b0ab-72fadac86986\" (UID: \"3fa9c875-2543-46f8-b0ab-72fadac86986\") "
Jul 14 19:19:54.163281 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:19:54.163255    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3fa9c875-2543-46f8-b0ab-72fadac86986-bundle" (OuterVolumeSpecName: "bundle") pod "3fa9c875-2543-46f8-b0ab-72fadac86986" (UID: "3fa9c875-2543-46f8-b0ab-72fadac86986"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 19:19:54.164559 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:19:54.164540    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3fa9c875-2543-46f8-b0ab-72fadac86986-kube-api-access-vj959" (OuterVolumeSpecName: "kube-api-access-vj959") pod "3fa9c875-2543-46f8-b0ab-72fadac86986" (UID: "3fa9c875-2543-46f8-b0ab-72fadac86986"). InnerVolumeSpecName "kube-api-access-vj959". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 19:19:54.166770 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:19:54.166752    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3fa9c875-2543-46f8-b0ab-72fadac86986-util" (OuterVolumeSpecName: "util") pod "3fa9c875-2543-46f8-b0ab-72fadac86986" (UID: "3fa9c875-2543-46f8-b0ab-72fadac86986"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 19:19:54.263126 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:19:54.263102    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vj959\" (UniqueName: \"kubernetes.io/projected/3fa9c875-2543-46f8-b0ab-72fadac86986-kube-api-access-vj959\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Jul 14 19:19:54.263126 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:19:54.263122    2565 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3fa9c875-2543-46f8-b0ab-72fadac86986-bundle\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Jul 14 19:19:54.263292 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:19:54.263131    2565 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3fa9c875-2543-46f8-b0ab-72fadac86986-util\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Jul 14 19:19:54.954789 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:19:54.954755    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540v4x5s" event={"ID":"3fa9c875-2543-46f8-b0ab-72fadac86986","Type":"ContainerDied","Data":"35d5d77a8d72b32e21d269abcfbebba7dfb1b86ce251362afc2ebf5b9f3287fd"}
Jul 14 19:19:54.954947 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:19:54.954809    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="35d5d77a8d72b32e21d269abcfbebba7dfb1b86ce251362afc2ebf5b9f3287fd"
Jul 14 19:19:54.954947 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:19:54.954764    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540v4x5s"
Jul 14 19:20:00.100627 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:20:00.100597    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-vw9w8"]
Jul 14 19:20:00.101040 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:20:00.100898    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3fa9c875-2543-46f8-b0ab-72fadac86986" containerName="extract"
Jul 14 19:20:00.101040 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:20:00.100908    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="3fa9c875-2543-46f8-b0ab-72fadac86986" containerName="extract"
Jul 14 19:20:00.101040 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:20:00.100916    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3fa9c875-2543-46f8-b0ab-72fadac86986" containerName="pull"
Jul 14 19:20:00.101040 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:20:00.100922    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="3fa9c875-2543-46f8-b0ab-72fadac86986" containerName="pull"
Jul 14 19:20:00.101040 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:20:00.100931    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3fa9c875-2543-46f8-b0ab-72fadac86986" containerName="util"
Jul 14 19:20:00.101040 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:20:00.100937    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="3fa9c875-2543-46f8-b0ab-72fadac86986" containerName="util"
Jul 14 19:20:00.101040 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:20:00.100979    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="3fa9c875-2543-46f8-b0ab-72fadac86986" containerName="extract"
Jul 14 19:20:00.103062 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:20:00.103046    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-vw9w8"
Jul 14 19:20:00.105499 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:20:00.105477    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Jul 14 19:20:00.105633 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:20:00.105508    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-vqq8j\""
Jul 14 19:20:00.105633 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:20:00.105568    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Jul 14 19:20:00.117944 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:20:00.117920    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-vw9w8"]
Jul 14 19:20:00.201412 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:20:00.201372    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9b42a718-9b7e-4282-85d0-92d20d8eb63b-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-vw9w8\" (UID: \"9b42a718-9b7e-4282-85d0-92d20d8eb63b\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-vw9w8"
Jul 14 19:20:00.201539 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:20:00.201436    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bnxp6\" (UniqueName: \"kubernetes.io/projected/9b42a718-9b7e-4282-85d0-92d20d8eb63b-kube-api-access-bnxp6\") pod \"cert-manager-operator-controller-manager-55c444bf86-vw9w8\" (UID: \"9b42a718-9b7e-4282-85d0-92d20d8eb63b\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-vw9w8"
Jul 14 19:20:00.301922 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:20:00.301889    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9b42a718-9b7e-4282-85d0-92d20d8eb63b-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-vw9w8\" (UID: \"9b42a718-9b7e-4282-85d0-92d20d8eb63b\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-vw9w8"
Jul 14 19:20:00.302022 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:20:00.301937    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bnxp6\" (UniqueName: \"kubernetes.io/projected/9b42a718-9b7e-4282-85d0-92d20d8eb63b-kube-api-access-bnxp6\") pod \"cert-manager-operator-controller-manager-55c444bf86-vw9w8\" (UID: \"9b42a718-9b7e-4282-85d0-92d20d8eb63b\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-vw9w8"
Jul 14 19:20:00.302288 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:20:00.302270    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9b42a718-9b7e-4282-85d0-92d20d8eb63b-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-vw9w8\" (UID: \"9b42a718-9b7e-4282-85d0-92d20d8eb63b\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-vw9w8"
Jul 14 19:20:00.310930 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:20:00.310904    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bnxp6\" (UniqueName: \"kubernetes.io/projected/9b42a718-9b7e-4282-85d0-92d20d8eb63b-kube-api-access-bnxp6\") pod \"cert-manager-operator-controller-manager-55c444bf86-vw9w8\" (UID: \"9b42a718-9b7e-4282-85d0-92d20d8eb63b\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-vw9w8"
Jul 14 19:20:00.412033 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:20:00.411983    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-vw9w8"
Jul 14 19:20:00.541348 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:20:00.541320    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-vw9w8"]
Jul 14 19:20:00.545138 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:20:00.545113    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b42a718_9b7e_4282_85d0_92d20d8eb63b.slice/crio-75eb1a643860f497060171f648069148b6ab20f16068870090763512bb66395d WatchSource:0}: Error finding container 75eb1a643860f497060171f648069148b6ab20f16068870090763512bb66395d: Status 404 returned error can't find the container with id 75eb1a643860f497060171f648069148b6ab20f16068870090763512bb66395d
Jul 14 19:20:00.980451 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:20:00.980425    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-vw9w8" event={"ID":"9b42a718-9b7e-4282-85d0-92d20d8eb63b","Type":"ContainerStarted","Data":"75eb1a643860f497060171f648069148b6ab20f16068870090763512bb66395d"}
Jul 14 19:20:02.992413 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:20:02.992373    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-vw9w8" event={"ID":"9b42a718-9b7e-4282-85d0-92d20d8eb63b","Type":"ContainerStarted","Data":"98c0274baaa250e566c7ceb4f9537f90401a4dcf6955fefee5b4b20bd769cd04"}
Jul 14 19:20:03.016461 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:20:03.016413    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-vw9w8" podStartSLOduration=1.540924427 podStartE2EDuration="3.016397964s" totalImagesPullingTime="1.475473537s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 19:20:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:20:03.013942895 +0000 UTC m=+549.574799809" watchObservedRunningTime="2026-07-14 19:20:03.016397964 +0000 UTC m=+549.577254853"
Jul 14 19:20:03.972138 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:20:03.972109    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnp6vm"]
Jul 14 19:20:03.974375 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:20:03.974360    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnp6vm"
Jul 14 19:20:03.977989 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:20:03.977969    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-ngskb\""
Jul 14 19:20:03.978101 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:20:03.977994    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 14 19:20:03.978101 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:20:03.977969    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 14 19:20:03.992648 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:20:03.992621    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnp6vm"]
Jul 14 19:20:04.032169 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:20:04.032121    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/33503a7a-24c2-42fe-ac72-aa72bb397584-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnp6vm\" (UID: \"33503a7a-24c2-42fe-ac72-aa72bb397584\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnp6vm"
Jul 14 19:20:04.032320 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:20:04.032177    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/33503a7a-24c2-42fe-ac72-aa72bb397584-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnp6vm\" (UID: \"33503a7a-24c2-42fe-ac72-aa72bb397584\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnp6vm"
Jul 14 19:20:04.032320 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:20:04.032275    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jxcgs\" (UniqueName: \"kubernetes.io/projected/33503a7a-24c2-42fe-ac72-aa72bb397584-kube-api-access-jxcgs\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnp6vm\" (UID: \"33503a7a-24c2-42fe-ac72-aa72bb397584\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnp6vm"
Jul 14 19:20:04.133215 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:20:04.133182    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jxcgs\" (UniqueName: \"kubernetes.io/projected/33503a7a-24c2-42fe-ac72-aa72bb397584-kube-api-access-jxcgs\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnp6vm\" (UID: \"33503a7a-24c2-42fe-ac72-aa72bb397584\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnp6vm"
Jul 14 19:20:04.133371 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:20:04.133254    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/33503a7a-24c2-42fe-ac72-aa72bb397584-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnp6vm\" (UID: \"33503a7a-24c2-42fe-ac72-aa72bb397584\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnp6vm"
Jul 14 19:20:04.133371 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:20:04.133296    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/33503a7a-24c2-42fe-ac72-aa72bb397584-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnp6vm\" (UID: \"33503a7a-24c2-42fe-ac72-aa72bb397584\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnp6vm"
Jul 14 19:20:04.133612 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:20:04.133595    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/33503a7a-24c2-42fe-ac72-aa72bb397584-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnp6vm\" (UID: \"33503a7a-24c2-42fe-ac72-aa72bb397584\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnp6vm"
Jul 14 19:20:04.133668 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:20:04.133653    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/33503a7a-24c2-42fe-ac72-aa72bb397584-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnp6vm\" (UID: \"33503a7a-24c2-42fe-ac72-aa72bb397584\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnp6vm"
Jul 14 19:20:04.150425 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:20:04.150396    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jxcgs\" (UniqueName: \"kubernetes.io/projected/33503a7a-24c2-42fe-ac72-aa72bb397584-kube-api-access-jxcgs\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnp6vm\" (UID: \"33503a7a-24c2-42fe-ac72-aa72bb397584\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnp6vm"
Jul 14 19:20:04.283413 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:20:04.283325    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnp6vm"
Jul 14 19:20:04.418577 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:20:04.418543    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnp6vm"]
Jul 14 19:20:04.420693 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:20:04.420666    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33503a7a_24c2_42fe_ac72_aa72bb397584.slice/crio-0ceaebdf3e880ffe48c803d76292004344ac9c755a61cedaacc4465ee268cdfb WatchSource:0}: Error finding container 0ceaebdf3e880ffe48c803d76292004344ac9c755a61cedaacc4465ee268cdfb: Status 404 returned error can't find the container with id 0ceaebdf3e880ffe48c803d76292004344ac9c755a61cedaacc4465ee268cdfb
Jul 14 19:20:05.003257 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:20:05.003221    2565 generic.go:356] "Generic (PLEG): container finished" podID="33503a7a-24c2-42fe-ac72-aa72bb397584" containerID="493268d5d0c4adc1636a53b3f869d378c8f98879899fa610042981b5449eb28f" exitCode=0
Jul 14 19:20:05.003627 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:20:05.003268    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnp6vm" event={"ID":"33503a7a-24c2-42fe-ac72-aa72bb397584","Type":"ContainerDied","Data":"493268d5d0c4adc1636a53b3f869d378c8f98879899fa610042981b5449eb28f"}
Jul 14 19:20:05.003627 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:20:05.003324    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnp6vm" event={"ID":"33503a7a-24c2-42fe-ac72-aa72bb397584","Type":"ContainerStarted","Data":"0ceaebdf3e880ffe48c803d76292004344ac9c755a61cedaacc4465ee268cdfb"}
Jul 14 19:20:06.340922 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:20:06.340873    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-nr7qk"]
Jul 14 19:20:06.346804 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:20:06.346781    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-nr7qk"
Jul 14 19:20:06.350956 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:20:06.350715    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-4dv8g\""
Jul 14 19:20:06.350956 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:20:06.350753    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 14 19:20:06.350956 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:20:06.350784    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 14 19:20:06.351964 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:20:06.351940    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-nr7qk"]
Jul 14 19:20:06.455333 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:20:06.455288    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kdrn6\" (UniqueName: \"kubernetes.io/projected/04b3a653-6d37-4c45-9320-f9fe10423d60-kube-api-access-kdrn6\") pod \"cert-manager-webhook-6486ffd997-nr7qk\" (UID: \"04b3a653-6d37-4c45-9320-f9fe10423d60\") " pod="cert-manager/cert-manager-webhook-6486ffd997-nr7qk"
Jul 14 19:20:06.455539 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:20:06.455464    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/04b3a653-6d37-4c45-9320-f9fe10423d60-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-nr7qk\" (UID: \"04b3a653-6d37-4c45-9320-f9fe10423d60\") " pod="cert-manager/cert-manager-webhook-6486ffd997-nr7qk"
Jul 14 19:20:06.556805 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:20:06.556767    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/04b3a653-6d37-4c45-9320-f9fe10423d60-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-nr7qk\" (UID: \"04b3a653-6d37-4c45-9320-f9fe10423d60\") " pod="cert-manager/cert-manager-webhook-6486ffd997-nr7qk"
Jul 14 19:20:06.556980 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:20:06.556877    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kdrn6\" (UniqueName: \"kubernetes.io/projected/04b3a653-6d37-4c45-9320-f9fe10423d60-kube-api-access-kdrn6\") pod \"cert-manager-webhook-6486ffd997-nr7qk\" (UID: \"04b3a653-6d37-4c45-9320-f9fe10423d60\") " pod="cert-manager/cert-manager-webhook-6486ffd997-nr7qk"
Jul 14 19:20:06.565407 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:20:06.565382    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/04b3a653-6d37-4c45-9320-f9fe10423d60-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-nr7qk\" (UID: \"04b3a653-6d37-4c45-9320-f9fe10423d60\") " pod="cert-manager/cert-manager-webhook-6486ffd997-nr7qk"
Jul 14 19:20:06.565560 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:20:06.565532    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kdrn6\" (UniqueName: \"kubernetes.io/projected/04b3a653-6d37-4c45-9320-f9fe10423d60-kube-api-access-kdrn6\") pod \"cert-manager-webhook-6486ffd997-nr7qk\" (UID: \"04b3a653-6d37-4c45-9320-f9fe10423d60\") " pod="cert-manager/cert-manager-webhook-6486ffd997-nr7qk"
Jul 14 19:20:06.572917 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:20:06.572804    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-j99ks"]
Jul 14 19:20:06.576521 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:20:06.576497    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-j99ks"
Jul 14 19:20:06.578924 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:20:06.578903    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-ffxtc\""
Jul 14 19:20:06.583833 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:20:06.583810    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-j99ks"]
Jul 14 19:20:06.657304 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:20:06.657231    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/19d0e6b1-5fa8-456d-9610-b9fb01522cf3-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-j99ks\" (UID: \"19d0e6b1-5fa8-456d-9610-b9fb01522cf3\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-j99ks"
Jul 14 19:20:06.657437 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:20:06.657305    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-twn68\" (UniqueName: \"kubernetes.io/projected/19d0e6b1-5fa8-456d-9610-b9fb01522cf3-kube-api-access-twn68\") pod \"cert-manager-cainjector-559cdd8c87-j99ks\" (UID: \"19d0e6b1-5fa8-456d-9610-b9fb01522cf3\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-j99ks"
Jul 14 19:20:06.663177 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:20:06.663138    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-nr7qk"
Jul 14 19:20:06.758658 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:20:06.758623    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-twn68\" (UniqueName: \"kubernetes.io/projected/19d0e6b1-5fa8-456d-9610-b9fb01522cf3-kube-api-access-twn68\") pod \"cert-manager-cainjector-559cdd8c87-j99ks\" (UID: \"19d0e6b1-5fa8-456d-9610-b9fb01522cf3\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-j99ks"
Jul 14 19:20:06.758803 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:20:06.758735    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/19d0e6b1-5fa8-456d-9610-b9fb01522cf3-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-j99ks\" (UID: \"19d0e6b1-5fa8-456d-9610-b9fb01522cf3\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-j99ks"
Jul 14 19:20:06.768010 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:20:06.767983    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/19d0e6b1-5fa8-456d-9610-b9fb01522cf3-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-j99ks\" (UID: \"19d0e6b1-5fa8-456d-9610-b9fb01522cf3\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-j99ks"
Jul 14 19:20:06.768130 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:20:06.768113    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-twn68\" (UniqueName: \"kubernetes.io/projected/19d0e6b1-5fa8-456d-9610-b9fb01522cf3-kube-api-access-twn68\") pod \"cert-manager-cainjector-559cdd8c87-j99ks\" (UID: \"19d0e6b1-5fa8-456d-9610-b9fb01522cf3\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-j99ks"
Jul 14 19:20:06.890196 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:20:06.890166    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-j99ks"
Jul 14 19:20:06.997075 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:20:06.996267    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-nr7qk"]
Jul 14 19:20:06.999403 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:20:06.999360    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod04b3a653_6d37_4c45_9320_f9fe10423d60.slice/crio-7a6529ae317a26d2c5ae1a7a6e4b421007f0a1835e415228f04d080e8840eb53 WatchSource:0}: Error finding container 7a6529ae317a26d2c5ae1a7a6e4b421007f0a1835e415228f04d080e8840eb53: Status 404 returned error can't find the container with id 7a6529ae317a26d2c5ae1a7a6e4b421007f0a1835e415228f04d080e8840eb53
Jul 14 19:20:07.015961 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:20:07.015924    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-nr7qk" event={"ID":"04b3a653-6d37-4c45-9320-f9fe10423d60","Type":"ContainerStarted","Data":"7a6529ae317a26d2c5ae1a7a6e4b421007f0a1835e415228f04d080e8840eb53"}
Jul 14 19:20:07.017956 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:20:07.017933    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnp6vm" event={"ID":"33503a7a-24c2-42fe-ac72-aa72bb397584","Type":"ContainerStarted","Data":"106e7b2439ab21709c84fe2382711a064709401c5a925107cae01ce6c2aff9f9"}
Jul 14 19:20:07.042113 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:20:07.042091    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-j99ks"]
Jul 14 19:20:07.079898 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:20:07.079867    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod19d0e6b1_5fa8_456d_9610_b9fb01522cf3.slice/crio-fe50d00e6374259bebd89b127a5006aff7271f17e79be543ac353bf28b377c9c WatchSource:0}: Error finding container fe50d00e6374259bebd89b127a5006aff7271f17e79be543ac353bf28b377c9c: Status 404 returned error can't find the container with id fe50d00e6374259bebd89b127a5006aff7271f17e79be543ac353bf28b377c9c
Jul 14 19:20:08.025135 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:20:08.025099    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-j99ks" event={"ID":"19d0e6b1-5fa8-456d-9610-b9fb01522cf3","Type":"ContainerStarted","Data":"fe50d00e6374259bebd89b127a5006aff7271f17e79be543ac353bf28b377c9c"}
Jul 14 19:20:08.027847 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:20:08.027814    2565 generic.go:356] "Generic (PLEG): container finished" podID="33503a7a-24c2-42fe-ac72-aa72bb397584" containerID="106e7b2439ab21709c84fe2382711a064709401c5a925107cae01ce6c2aff9f9" exitCode=0
Jul 14 19:20:08.028003 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:20:08.027904    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnp6vm" event={"ID":"33503a7a-24c2-42fe-ac72-aa72bb397584","Type":"ContainerDied","Data":"106e7b2439ab21709c84fe2382711a064709401c5a925107cae01ce6c2aff9f9"}
Jul 14 19:20:09.036303 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:20:09.036268    2565 generic.go:356] "Generic (PLEG): container finished" podID="33503a7a-24c2-42fe-ac72-aa72bb397584" containerID="8f5a47578b4926114feba90813fa751c3415c7d88ad4a42bca405072a9aa5621" exitCode=0
Jul 14 19:20:09.036740 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:20:09.036350    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnp6vm" event={"ID":"33503a7a-24c2-42fe-ac72-aa72bb397584","Type":"ContainerDied","Data":"8f5a47578b4926114feba90813fa751c3415c7d88ad4a42bca405072a9aa5621"}
Jul 14 19:20:10.042878 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:20:10.042781    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-nr7qk" event={"ID":"04b3a653-6d37-4c45-9320-f9fe10423d60","Type":"ContainerStarted","Data":"b8765c58c013537275431d469702d1ebc326341a1b4ced1ac8fa9e62d8ec3965"}
Jul 14 19:20:10.042878 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:20:10.042830    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-nr7qk"
Jul 14 19:20:10.044546 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:20:10.044520    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-j99ks" event={"ID":"19d0e6b1-5fa8-456d-9610-b9fb01522cf3","Type":"ContainerStarted","Data":"61d07f6ed0e85e9fa6c95d16088396319afee371b4aa33c32bc1fd0ab929964d"}
Jul 14 19:20:10.114222 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:20:10.113763    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-nr7qk" podStartSLOduration=1.369257151 podStartE2EDuration="4.113742444s" totalImagesPullingTime="2.744485293s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 19:20:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:20:10.07714345 +0000 UTC m=+556.638000345" watchObservedRunningTime="2026-07-14 19:20:10.113742444 +0000 UTC m=+556.674599330"
Jul 14 19:20:10.116299 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:20:10.114570    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-j99ks" podStartSLOduration=1.4421233469999999 podStartE2EDuration="4.114558449s" totalImagesPullingTime="2.672435102s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 19:20:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:20:10.113937168 +0000 UTC m=+556.674794060" watchObservedRunningTime="2026-07-14 19:20:10.114558449 +0000 UTC m=+556.675415341"
Jul 14 19:20:10.186681 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:20:10.186655    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnp6vm"
Jul 14 19:20:10.290398 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:20:10.290372    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/33503a7a-24c2-42fe-ac72-aa72bb397584-bundle\") pod \"33503a7a-24c2-42fe-ac72-aa72bb397584\" (UID: \"33503a7a-24c2-42fe-ac72-aa72bb397584\") "
Jul 14 19:20:10.290557 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:20:10.290438    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jxcgs\" (UniqueName: \"kubernetes.io/projected/33503a7a-24c2-42fe-ac72-aa72bb397584-kube-api-access-jxcgs\") pod \"33503a7a-24c2-42fe-ac72-aa72bb397584\" (UID: \"33503a7a-24c2-42fe-ac72-aa72bb397584\") "
Jul 14 19:20:10.290557 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:20:10.290492    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/33503a7a-24c2-42fe-ac72-aa72bb397584-util\") pod \"33503a7a-24c2-42fe-ac72-aa72bb397584\" (UID: \"33503a7a-24c2-42fe-ac72-aa72bb397584\") "
Jul 14 19:20:10.290823 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:20:10.290801    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/33503a7a-24c2-42fe-ac72-aa72bb397584-bundle" (OuterVolumeSpecName: "bundle") pod "33503a7a-24c2-42fe-ac72-aa72bb397584" (UID: "33503a7a-24c2-42fe-ac72-aa72bb397584"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 19:20:10.292684 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:20:10.292658    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/33503a7a-24c2-42fe-ac72-aa72bb397584-kube-api-access-jxcgs" (OuterVolumeSpecName: "kube-api-access-jxcgs") pod "33503a7a-24c2-42fe-ac72-aa72bb397584" (UID: "33503a7a-24c2-42fe-ac72-aa72bb397584"). InnerVolumeSpecName "kube-api-access-jxcgs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 19:20:10.294480 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:20:10.294442    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/33503a7a-24c2-42fe-ac72-aa72bb397584-util" (OuterVolumeSpecName: "util") pod "33503a7a-24c2-42fe-ac72-aa72bb397584" (UID: "33503a7a-24c2-42fe-ac72-aa72bb397584"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 19:20:10.391091 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:20:10.391067    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jxcgs\" (UniqueName: \"kubernetes.io/projected/33503a7a-24c2-42fe-ac72-aa72bb397584-kube-api-access-jxcgs\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Jul 14 19:20:10.391091 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:20:10.391088    2565 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/33503a7a-24c2-42fe-ac72-aa72bb397584-util\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Jul 14 19:20:10.391236 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:20:10.391097    2565 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/33503a7a-24c2-42fe-ac72-aa72bb397584-bundle\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Jul 14 19:20:11.051247 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:20:11.051221    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnp6vm"
Jul 14 19:20:11.051670 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:20:11.051254    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnp6vm" event={"ID":"33503a7a-24c2-42fe-ac72-aa72bb397584","Type":"ContainerDied","Data":"0ceaebdf3e880ffe48c803d76292004344ac9c755a61cedaacc4465ee268cdfb"}
Jul 14 19:20:11.051670 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:20:11.051299    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0ceaebdf3e880ffe48c803d76292004344ac9c755a61cedaacc4465ee268cdfb"
Jul 14 19:20:16.054141 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:20:16.054114    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-nr7qk"
Jul 14 19:20:28.161515 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:20:28.161485    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-f8msz"]
Jul 14 19:20:28.162058 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:20:28.161945    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="33503a7a-24c2-42fe-ac72-aa72bb397584" containerName="util"
Jul 14 19:20:28.162058 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:20:28.161963    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="33503a7a-24c2-42fe-ac72-aa72bb397584" containerName="util"
Jul 14 19:20:28.162058 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:20:28.161973    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="33503a7a-24c2-42fe-ac72-aa72bb397584" containerName="pull"
Jul 14 19:20:28.162058 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:20:28.161982    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="33503a7a-24c2-42fe-ac72-aa72bb397584" containerName="pull"
Jul 14 19:20:28.162058 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:20:28.161994    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="33503a7a-24c2-42fe-ac72-aa72bb397584" containerName="extract"
Jul 14 19:20:28.162058 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:20:28.162003    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="33503a7a-24c2-42fe-ac72-aa72bb397584" containerName="extract"
Jul 14 19:20:28.162382 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:20:28.162094    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="33503a7a-24c2-42fe-ac72-aa72bb397584" containerName="extract"
Jul 14 19:20:28.166002 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:20:28.165980    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-f8msz"
Jul 14 19:20:28.168588 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:20:28.168571    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-vfcr7\""
Jul 14 19:20:28.168677 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:20:28.168575    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 14 19:20:28.169569 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:20:28.169555    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 14 19:20:28.175038 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:20:28.175018    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-f8msz"]
Jul 14 19:20:28.323633 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:20:28.323613    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/00a6afba-6096-4a00-bf7b-5f6f67d08360-tmp\") pod \"openshift-lws-operator-fd8ccff4c-f8msz\" (UID: \"00a6afba-6096-4a00-bf7b-5f6f67d08360\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-f8msz"
Jul 14 19:20:28.323731 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:20:28.323672    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fbswx\" (UniqueName: \"kubernetes.io/projected/00a6afba-6096-4a00-bf7b-5f6f67d08360-kube-api-access-fbswx\") pod \"openshift-lws-operator-fd8ccff4c-f8msz\" (UID: \"00a6afba-6096-4a00-bf7b-5f6f67d08360\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-f8msz"
Jul 14 19:20:28.424410 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:20:28.424359    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fbswx\" (UniqueName: \"kubernetes.io/projected/00a6afba-6096-4a00-bf7b-5f6f67d08360-kube-api-access-fbswx\") pod \"openshift-lws-operator-fd8ccff4c-f8msz\" (UID: \"00a6afba-6096-4a00-bf7b-5f6f67d08360\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-f8msz"
Jul 14 19:20:28.424410 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:20:28.424397    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/00a6afba-6096-4a00-bf7b-5f6f67d08360-tmp\") pod \"openshift-lws-operator-fd8ccff4c-f8msz\" (UID: \"00a6afba-6096-4a00-bf7b-5f6f67d08360\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-f8msz"
Jul 14 19:20:28.424741 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:20:28.424725    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/00a6afba-6096-4a00-bf7b-5f6f67d08360-tmp\") pod \"openshift-lws-operator-fd8ccff4c-f8msz\" (UID: \"00a6afba-6096-4a00-bf7b-5f6f67d08360\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-f8msz"
Jul 14 19:20:28.432410 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:20:28.432386    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fbswx\" (UniqueName: \"kubernetes.io/projected/00a6afba-6096-4a00-bf7b-5f6f67d08360-kube-api-access-fbswx\") pod \"openshift-lws-operator-fd8ccff4c-f8msz\" (UID: \"00a6afba-6096-4a00-bf7b-5f6f67d08360\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-f8msz"
Jul 14 19:20:28.474856 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:20:28.474835    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-f8msz"
Jul 14 19:20:28.601808 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:20:28.601778    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-f8msz"]
Jul 14 19:20:28.605709 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:20:28.605681    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod00a6afba_6096_4a00_bf7b_5f6f67d08360.slice/crio-8d33f3e329a5be348bab332a4a42bcfa6ad84a5adfd9f085191a1e963a57ee62 WatchSource:0}: Error finding container 8d33f3e329a5be348bab332a4a42bcfa6ad84a5adfd9f085191a1e963a57ee62: Status 404 returned error can't find the container with id 8d33f3e329a5be348bab332a4a42bcfa6ad84a5adfd9f085191a1e963a57ee62
Jul 14 19:20:29.127922 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:20:29.127887    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-f8msz" event={"ID":"00a6afba-6096-4a00-bf7b-5f6f67d08360","Type":"ContainerStarted","Data":"8d33f3e329a5be348bab332a4a42bcfa6ad84a5adfd9f085191a1e963a57ee62"}
Jul 14 19:20:31.141667 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:20:31.141628    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-f8msz" event={"ID":"00a6afba-6096-4a00-bf7b-5f6f67d08360","Type":"ContainerStarted","Data":"c513e58ccbcb947b4c317cfb7d43b01305c519cf05e77e11a96e437903f4b2b7"}
Jul 14 19:20:31.160170 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:20:31.160105    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-f8msz" podStartSLOduration=1.5730063749999998 podStartE2EDuration="3.160091341s" totalImagesPullingTime="1.587084966s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 19:20:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:20:31.158122313 +0000 UTC m=+577.718979204" watchObservedRunningTime="2026-07-14 19:20:31.160091341 +0000 UTC m=+577.720948231"
Jul 14 19:20:33.968073 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:20:33.968042    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2cx74"]
Jul 14 19:20:33.970802 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:20:33.970785    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2cx74"
Jul 14 19:20:33.974312 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:20:33.974137    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-ngskb\""
Jul 14 19:20:33.974312 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:20:33.974192    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 14 19:20:33.974312 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:20:33.974289    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 14 19:20:33.975336 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:20:33.975305    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2cx74"]
Jul 14 19:20:34.069599 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:20:34.069570    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ddmr2\" (UniqueName: \"kubernetes.io/projected/88f39981-ceda-4ca1-9268-2507ff97d024-kube-api-access-ddmr2\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2cx74\" (UID: \"88f39981-ceda-4ca1-9268-2507ff97d024\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2cx74"
Jul 14 19:20:34.069737 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:20:34.069606    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/88f39981-ceda-4ca1-9268-2507ff97d024-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2cx74\" (UID: \"88f39981-ceda-4ca1-9268-2507ff97d024\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2cx74"
Jul 14 19:20:34.069737 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:20:34.069673    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/88f39981-ceda-4ca1-9268-2507ff97d024-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2cx74\" (UID: \"88f39981-ceda-4ca1-9268-2507ff97d024\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2cx74"
Jul 14 19:20:34.169944 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:20:34.169911    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ddmr2\" (UniqueName: \"kubernetes.io/projected/88f39981-ceda-4ca1-9268-2507ff97d024-kube-api-access-ddmr2\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2cx74\" (UID: \"88f39981-ceda-4ca1-9268-2507ff97d024\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2cx74"
Jul 14 19:20:34.170100 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:20:34.169949    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/88f39981-ceda-4ca1-9268-2507ff97d024-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2cx74\" (UID: \"88f39981-ceda-4ca1-9268-2507ff97d024\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2cx74"
Jul 14 19:20:34.170100 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:20:34.170008    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/88f39981-ceda-4ca1-9268-2507ff97d024-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2cx74\" (UID: \"88f39981-ceda-4ca1-9268-2507ff97d024\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2cx74"
Jul 14 19:20:34.170361 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:20:34.170339    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/88f39981-ceda-4ca1-9268-2507ff97d024-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2cx74\" (UID: \"88f39981-ceda-4ca1-9268-2507ff97d024\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2cx74"
Jul 14 19:20:34.170428 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:20:34.170379    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/88f39981-ceda-4ca1-9268-2507ff97d024-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2cx74\" (UID: \"88f39981-ceda-4ca1-9268-2507ff97d024\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2cx74"
Jul 14 19:20:34.179192 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:20:34.179148    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ddmr2\" (UniqueName: \"kubernetes.io/projected/88f39981-ceda-4ca1-9268-2507ff97d024-kube-api-access-ddmr2\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2cx74\" (UID: \"88f39981-ceda-4ca1-9268-2507ff97d024\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2cx74"
Jul 14 19:20:34.281060 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:20:34.281035    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2cx74"
Jul 14 19:20:34.416614 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:20:34.416592    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2cx74"]
Jul 14 19:20:34.419076 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:20:34.419048    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod88f39981_ceda_4ca1_9268_2507ff97d024.slice/crio-f59266ab5a28839b4b325defd2995c0043c48b4195173a839a72a98140597400 WatchSource:0}: Error finding container f59266ab5a28839b4b325defd2995c0043c48b4195173a839a72a98140597400: Status 404 returned error can't find the container with id f59266ab5a28839b4b325defd2995c0043c48b4195173a839a72a98140597400
Jul 14 19:20:35.161793 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:20:35.161758    2565 generic.go:356] "Generic (PLEG): container finished" podID="88f39981-ceda-4ca1-9268-2507ff97d024" containerID="442f4555f755383fbcbc48be936d26e681c5519d69a048de35998ea9613781e1" exitCode=0
Jul 14 19:20:35.162276 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:20:35.161801    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2cx74" event={"ID":"88f39981-ceda-4ca1-9268-2507ff97d024","Type":"ContainerDied","Data":"442f4555f755383fbcbc48be936d26e681c5519d69a048de35998ea9613781e1"}
Jul 14 19:20:35.162276 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:20:35.161870    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2cx74" event={"ID":"88f39981-ceda-4ca1-9268-2507ff97d024","Type":"ContainerStarted","Data":"f59266ab5a28839b4b325defd2995c0043c48b4195173a839a72a98140597400"}
Jul 14 19:20:36.168708 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:20:36.168626    2565 generic.go:356] "Generic (PLEG): container finished" podID="88f39981-ceda-4ca1-9268-2507ff97d024" containerID="98b68d3094d650fc5c0a75dcafd5c4b396124e627d3305770c68065003b753a4" exitCode=0
Jul 14 19:20:36.169050 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:20:36.168713    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2cx74" event={"ID":"88f39981-ceda-4ca1-9268-2507ff97d024","Type":"ContainerDied","Data":"98b68d3094d650fc5c0a75dcafd5c4b396124e627d3305770c68065003b753a4"}
Jul 14 19:20:37.175171 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:20:37.175121    2565 generic.go:356] "Generic (PLEG): container finished" podID="88f39981-ceda-4ca1-9268-2507ff97d024" containerID="31460384d1e53178bf08dab0b7428d833bd0e8ec9469b108c554826eb7869262" exitCode=0
Jul 14 19:20:37.175495 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:20:37.175184    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2cx74" event={"ID":"88f39981-ceda-4ca1-9268-2507ff97d024","Type":"ContainerDied","Data":"31460384d1e53178bf08dab0b7428d833bd0e8ec9469b108c554826eb7869262"}
Jul 14 19:20:38.309871 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:20:38.309843    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2cx74"
Jul 14 19:20:38.402352 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:20:38.402329    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/88f39981-ceda-4ca1-9268-2507ff97d024-bundle\") pod \"88f39981-ceda-4ca1-9268-2507ff97d024\" (UID: \"88f39981-ceda-4ca1-9268-2507ff97d024\") "
Jul 14 19:20:38.402494 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:20:38.402368    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ddmr2\" (UniqueName: \"kubernetes.io/projected/88f39981-ceda-4ca1-9268-2507ff97d024-kube-api-access-ddmr2\") pod \"88f39981-ceda-4ca1-9268-2507ff97d024\" (UID: \"88f39981-ceda-4ca1-9268-2507ff97d024\") "
Jul 14 19:20:38.402494 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:20:38.402419    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/88f39981-ceda-4ca1-9268-2507ff97d024-util\") pod \"88f39981-ceda-4ca1-9268-2507ff97d024\" (UID: \"88f39981-ceda-4ca1-9268-2507ff97d024\") "
Jul 14 19:20:38.403101 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:20:38.403072    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/88f39981-ceda-4ca1-9268-2507ff97d024-bundle" (OuterVolumeSpecName: "bundle") pod "88f39981-ceda-4ca1-9268-2507ff97d024" (UID: "88f39981-ceda-4ca1-9268-2507ff97d024"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 19:20:38.404621 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:20:38.404597    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/88f39981-ceda-4ca1-9268-2507ff97d024-kube-api-access-ddmr2" (OuterVolumeSpecName: "kube-api-access-ddmr2") pod "88f39981-ceda-4ca1-9268-2507ff97d024" (UID: "88f39981-ceda-4ca1-9268-2507ff97d024"). InnerVolumeSpecName "kube-api-access-ddmr2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 19:20:38.408402 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:20:38.408366    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/88f39981-ceda-4ca1-9268-2507ff97d024-util" (OuterVolumeSpecName: "util") pod "88f39981-ceda-4ca1-9268-2507ff97d024" (UID: "88f39981-ceda-4ca1-9268-2507ff97d024"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 19:20:38.503066 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:20:38.503043    2565 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/88f39981-ceda-4ca1-9268-2507ff97d024-bundle\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Jul 14 19:20:38.503066 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:20:38.503062    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ddmr2\" (UniqueName: \"kubernetes.io/projected/88f39981-ceda-4ca1-9268-2507ff97d024-kube-api-access-ddmr2\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Jul 14 19:20:38.503224 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:20:38.503072    2565 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/88f39981-ceda-4ca1-9268-2507ff97d024-util\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Jul 14 19:20:39.186323 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:20:39.186289    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2cx74" event={"ID":"88f39981-ceda-4ca1-9268-2507ff97d024","Type":"ContainerDied","Data":"f59266ab5a28839b4b325defd2995c0043c48b4195173a839a72a98140597400"}
Jul 14 19:20:39.186493 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:20:39.186335    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2cx74"
Jul 14 19:20:39.186493 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:20:39.186340    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f59266ab5a28839b4b325defd2995c0043c48b4195173a839a72a98140597400"
Jul 14 19:20:51.175051 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:20:51.175017    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6f9786d97d-mchdj"]
Jul 14 19:20:51.175482 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:20:51.175363    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="88f39981-ceda-4ca1-9268-2507ff97d024" containerName="extract"
Jul 14 19:20:51.175482 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:20:51.175376    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="88f39981-ceda-4ca1-9268-2507ff97d024" containerName="extract"
Jul 14 19:20:51.175482 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:20:51.175393    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="88f39981-ceda-4ca1-9268-2507ff97d024" containerName="pull"
Jul 14 19:20:51.175482 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:20:51.175400    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="88f39981-ceda-4ca1-9268-2507ff97d024" containerName="pull"
Jul 14 19:20:51.175482 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:20:51.175408    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="88f39981-ceda-4ca1-9268-2507ff97d024" containerName="util"
Jul 14 19:20:51.175482 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:20:51.175413    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="88f39981-ceda-4ca1-9268-2507ff97d024" containerName="util"
Jul 14 19:20:51.175482 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:20:51.175482    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="88f39981-ceda-4ca1-9268-2507ff97d024" containerName="extract"
Jul 14 19:20:51.177289 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:20:51.177273    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6f9786d97d-mchdj"
Jul 14 19:20:51.180351 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:20:51.180325    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 14 19:20:51.180472 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:20:51.180385    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 14 19:20:51.180609 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:20:51.180594    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 14 19:20:51.180874 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:20:51.180857    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-2r59f\""
Jul 14 19:20:51.180960 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:20:51.180876    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 14 19:20:51.205275 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:20:51.205252    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6f9786d97d-mchdj"]
Jul 14 19:20:51.306653 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:20:51.306620    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dmbxf\" (UniqueName: \"kubernetes.io/projected/b4d66fe5-f315-4b5b-9c1b-7c539e02a839-kube-api-access-dmbxf\") pod \"opendatahub-operator-controller-manager-6f9786d97d-mchdj\" (UID: \"b4d66fe5-f315-4b5b-9c1b-7c539e02a839\") " pod="opendatahub/opendatahub-operator-controller-manager-6f9786d97d-mchdj"
Jul 14 19:20:51.306653 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:20:51.306656    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/b4d66fe5-f315-4b5b-9c1b-7c539e02a839-manifests\") pod \"opendatahub-operator-controller-manager-6f9786d97d-mchdj\" (UID: \"b4d66fe5-f315-4b5b-9c1b-7c539e02a839\") " pod="opendatahub/opendatahub-operator-controller-manager-6f9786d97d-mchdj"
Jul 14 19:20:51.306874 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:20:51.306686    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b4d66fe5-f315-4b5b-9c1b-7c539e02a839-tmp\") pod \"opendatahub-operator-controller-manager-6f9786d97d-mchdj\" (UID: \"b4d66fe5-f315-4b5b-9c1b-7c539e02a839\") " pod="opendatahub/opendatahub-operator-controller-manager-6f9786d97d-mchdj"
Jul 14 19:20:51.306874 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:20:51.306770    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b4d66fe5-f315-4b5b-9c1b-7c539e02a839-webhook-cert\") pod \"opendatahub-operator-controller-manager-6f9786d97d-mchdj\" (UID: \"b4d66fe5-f315-4b5b-9c1b-7c539e02a839\") " pod="opendatahub/opendatahub-operator-controller-manager-6f9786d97d-mchdj"
Jul 14 19:20:51.306874 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:20:51.306809    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/b4d66fe5-f315-4b5b-9c1b-7c539e02a839-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6f9786d97d-mchdj\" (UID: \"b4d66fe5-f315-4b5b-9c1b-7c539e02a839\") " pod="opendatahub/opendatahub-operator-controller-manager-6f9786d97d-mchdj"
Jul 14 19:20:51.408007 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:20:51.407975    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dmbxf\" (UniqueName: \"kubernetes.io/projected/b4d66fe5-f315-4b5b-9c1b-7c539e02a839-kube-api-access-dmbxf\") pod \"opendatahub-operator-controller-manager-6f9786d97d-mchdj\" (UID: \"b4d66fe5-f315-4b5b-9c1b-7c539e02a839\") " pod="opendatahub/opendatahub-operator-controller-manager-6f9786d97d-mchdj"
Jul 14 19:20:51.408007 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:20:51.408012    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/b4d66fe5-f315-4b5b-9c1b-7c539e02a839-manifests\") pod \"opendatahub-operator-controller-manager-6f9786d97d-mchdj\" (UID: \"b4d66fe5-f315-4b5b-9c1b-7c539e02a839\") " pod="opendatahub/opendatahub-operator-controller-manager-6f9786d97d-mchdj"
Jul 14 19:20:51.408232 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:20:51.408040    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b4d66fe5-f315-4b5b-9c1b-7c539e02a839-tmp\") pod \"opendatahub-operator-controller-manager-6f9786d97d-mchdj\" (UID: \"b4d66fe5-f315-4b5b-9c1b-7c539e02a839\") " pod="opendatahub/opendatahub-operator-controller-manager-6f9786d97d-mchdj"
Jul 14 19:20:51.408232 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:20:51.408076    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b4d66fe5-f315-4b5b-9c1b-7c539e02a839-webhook-cert\") pod \"opendatahub-operator-controller-manager-6f9786d97d-mchdj\" (UID: \"b4d66fe5-f315-4b5b-9c1b-7c539e02a839\") " pod="opendatahub/opendatahub-operator-controller-manager-6f9786d97d-mchdj"
Jul 14 19:20:51.408232 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:20:51.408095    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/b4d66fe5-f315-4b5b-9c1b-7c539e02a839-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6f9786d97d-mchdj\" (UID: \"b4d66fe5-f315-4b5b-9c1b-7c539e02a839\") " pod="opendatahub/opendatahub-operator-controller-manager-6f9786d97d-mchdj"
Jul 14 19:20:51.408499 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:20:51.408459    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/b4d66fe5-f315-4b5b-9c1b-7c539e02a839-manifests\") pod \"opendatahub-operator-controller-manager-6f9786d97d-mchdj\" (UID: \"b4d66fe5-f315-4b5b-9c1b-7c539e02a839\") " pod="opendatahub/opendatahub-operator-controller-manager-6f9786d97d-mchdj"
Jul 14 19:20:51.410496 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:20:51.410477    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b4d66fe5-f315-4b5b-9c1b-7c539e02a839-tmp\") pod \"opendatahub-operator-controller-manager-6f9786d97d-mchdj\" (UID: \"b4d66fe5-f315-4b5b-9c1b-7c539e02a839\") " pod="opendatahub/opendatahub-operator-controller-manager-6f9786d97d-mchdj"
Jul 14 19:20:51.410841 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:20:51.410820    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b4d66fe5-f315-4b5b-9c1b-7c539e02a839-webhook-cert\") pod \"opendatahub-operator-controller-manager-6f9786d97d-mchdj\" (UID: \"b4d66fe5-f315-4b5b-9c1b-7c539e02a839\") " pod="opendatahub/opendatahub-operator-controller-manager-6f9786d97d-mchdj"
Jul 14 19:20:51.410882 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:20:51.410820    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/b4d66fe5-f315-4b5b-9c1b-7c539e02a839-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6f9786d97d-mchdj\" (UID: \"b4d66fe5-f315-4b5b-9c1b-7c539e02a839\") " pod="opendatahub/opendatahub-operator-controller-manager-6f9786d97d-mchdj"
Jul 14 19:20:51.416363 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:20:51.416339    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dmbxf\" (UniqueName: \"kubernetes.io/projected/b4d66fe5-f315-4b5b-9c1b-7c539e02a839-kube-api-access-dmbxf\") pod \"opendatahub-operator-controller-manager-6f9786d97d-mchdj\" (UID: \"b4d66fe5-f315-4b5b-9c1b-7c539e02a839\") " pod="opendatahub/opendatahub-operator-controller-manager-6f9786d97d-mchdj"
Jul 14 19:20:51.488103 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:20:51.488073    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6f9786d97d-mchdj"
Jul 14 19:20:51.659625 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:20:51.659603    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6f9786d97d-mchdj"]
Jul 14 19:20:51.661935 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:20:51.661907    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4d66fe5_f315_4b5b_9c1b_7c539e02a839.slice/crio-b00c55634d03770063a3b0b04e0b63dfc9570cb98d03ef154631973901da0387 WatchSource:0}: Error finding container b00c55634d03770063a3b0b04e0b63dfc9570cb98d03ef154631973901da0387: Status 404 returned error can't find the container with id b00c55634d03770063a3b0b04e0b63dfc9570cb98d03ef154631973901da0387
Jul 14 19:20:52.247199 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:20:52.247140    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6f9786d97d-mchdj" event={"ID":"b4d66fe5-f315-4b5b-9c1b-7c539e02a839","Type":"ContainerStarted","Data":"b00c55634d03770063a3b0b04e0b63dfc9570cb98d03ef154631973901da0387"}
Jul 14 19:20:53.820221 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:20:53.820195    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-p5lb5_7ab60b2b-a644-4e35-b8b1-49c676e0f63f/console-operator/1.log"
Jul 14 19:20:53.820637 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:20:53.820195    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-p5lb5_7ab60b2b-a644-4e35-b8b1-49c676e0f63f/console-operator/1.log"
Jul 14 19:20:53.823845 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:20:53.823817    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cqqv8_7a447cf6-9373-4497-8028-97d590f38262/ovn-acl-logging/0.log"
Jul 14 19:20:53.824026 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:20:53.824009    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cqqv8_7a447cf6-9373-4497-8028-97d590f38262/ovn-acl-logging/0.log"
Jul 14 19:20:57.275345 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:20:57.275305    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6f9786d97d-mchdj" event={"ID":"b4d66fe5-f315-4b5b-9c1b-7c539e02a839","Type":"ContainerStarted","Data":"264b9bd116062754c3f5a4109f7785c8940c387a7e78c44c5af3006229e84397"}
Jul 14 19:20:58.281826 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:20:58.281788    2565 generic.go:356] "Generic (PLEG): container finished" podID="b4d66fe5-f315-4b5b-9c1b-7c539e02a839" containerID="264b9bd116062754c3f5a4109f7785c8940c387a7e78c44c5af3006229e84397" exitCode=0
Jul 14 19:20:58.282241 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:20:58.281888    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6f9786d97d-mchdj" event={"ID":"b4d66fe5-f315-4b5b-9c1b-7c539e02a839","Type":"ContainerDied","Data":"264b9bd116062754c3f5a4109f7785c8940c387a7e78c44c5af3006229e84397"}
Jul 14 19:20:59.288723 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:20:59.288676    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6f9786d97d-mchdj" event={"ID":"b4d66fe5-f315-4b5b-9c1b-7c539e02a839","Type":"ContainerStarted","Data":"d4692ee74d612d6f962619f1f6c21d8584a309671a42ffe948ff932bafc380a5"}
Jul 14 19:20:59.289188 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:20:59.288783    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6f9786d97d-mchdj"
Jul 14 19:20:59.313541 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:20:59.313498    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6f9786d97d-mchdj" podStartSLOduration=1.765497313 podStartE2EDuration="8.313484199s" totalImagesPullingTime="5.544044403s" totalInitContainerRuntime="1.003942483s" isStatefulPod=false podCreationTimestamp="2026-07-14 19:20:51 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:20:59.311268602 +0000 UTC m=+605.872125514" watchObservedRunningTime="2026-07-14 19:20:59.313484199 +0000 UTC m=+605.874341163"
Jul 14 19:21:10.295565 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:21:10.295533    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6f9786d97d-mchdj"
Jul 14 19:21:12.701752 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:21:12.701717    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-5d877944c-867np"]
Jul 14 19:21:12.710494 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:21:12.710465    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5d877944c-867np"
Jul 14 19:21:12.716048 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:21:12.716020    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 14 19:21:12.716234 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:21:12.716060    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 14 19:21:12.716234 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:21:12.716073    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-9tf92\""
Jul 14 19:21:12.716234 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:21:12.716031    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 14 19:21:12.716234 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:21:12.716019    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 14 19:21:12.722624 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:21:12.722597    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5d877944c-867np"]
Jul 14 19:21:12.785453 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:21:12.785423    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/adda783a-0ef9-40a9-99a7-445d881305ec-tmp\") pod \"kube-auth-proxy-5d877944c-867np\" (UID: \"adda783a-0ef9-40a9-99a7-445d881305ec\") " pod="openshift-ingress/kube-auth-proxy-5d877944c-867np"
Jul 14 19:21:12.785624 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:21:12.785507    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/adda783a-0ef9-40a9-99a7-445d881305ec-tls-certs\") pod \"kube-auth-proxy-5d877944c-867np\" (UID: \"adda783a-0ef9-40a9-99a7-445d881305ec\") " pod="openshift-ingress/kube-auth-proxy-5d877944c-867np"
Jul 14 19:21:12.785624 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:21:12.785529    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lrv7t\" (UniqueName: \"kubernetes.io/projected/adda783a-0ef9-40a9-99a7-445d881305ec-kube-api-access-lrv7t\") pod \"kube-auth-proxy-5d877944c-867np\" (UID: \"adda783a-0ef9-40a9-99a7-445d881305ec\") " pod="openshift-ingress/kube-auth-proxy-5d877944c-867np"
Jul 14 19:21:12.886405 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:21:12.886367    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/adda783a-0ef9-40a9-99a7-445d881305ec-tmp\") pod \"kube-auth-proxy-5d877944c-867np\" (UID: \"adda783a-0ef9-40a9-99a7-445d881305ec\") " pod="openshift-ingress/kube-auth-proxy-5d877944c-867np"
Jul 14 19:21:12.886601 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:21:12.886451    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/adda783a-0ef9-40a9-99a7-445d881305ec-tls-certs\") pod \"kube-auth-proxy-5d877944c-867np\" (UID: \"adda783a-0ef9-40a9-99a7-445d881305ec\") " pod="openshift-ingress/kube-auth-proxy-5d877944c-867np"
Jul 14 19:21:12.886601 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:21:12.886477    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lrv7t\" (UniqueName: \"kubernetes.io/projected/adda783a-0ef9-40a9-99a7-445d881305ec-kube-api-access-lrv7t\") pod \"kube-auth-proxy-5d877944c-867np\" (UID: \"adda783a-0ef9-40a9-99a7-445d881305ec\") " pod="openshift-ingress/kube-auth-proxy-5d877944c-867np"
Jul 14 19:21:12.888783 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:21:12.888748    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/adda783a-0ef9-40a9-99a7-445d881305ec-tmp\") pod \"kube-auth-proxy-5d877944c-867np\" (UID: \"adda783a-0ef9-40a9-99a7-445d881305ec\") " pod="openshift-ingress/kube-auth-proxy-5d877944c-867np"
Jul 14 19:21:12.888963 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:21:12.888945    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/adda783a-0ef9-40a9-99a7-445d881305ec-tls-certs\") pod \"kube-auth-proxy-5d877944c-867np\" (UID: \"adda783a-0ef9-40a9-99a7-445d881305ec\") " pod="openshift-ingress/kube-auth-proxy-5d877944c-867np"
Jul 14 19:21:12.895382 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:21:12.895359    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lrv7t\" (UniqueName: \"kubernetes.io/projected/adda783a-0ef9-40a9-99a7-445d881305ec-kube-api-access-lrv7t\") pod \"kube-auth-proxy-5d877944c-867np\" (UID: \"adda783a-0ef9-40a9-99a7-445d881305ec\") " pod="openshift-ingress/kube-auth-proxy-5d877944c-867np"
Jul 14 19:21:13.020251 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:21:13.020217    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5d877944c-867np"
Jul 14 19:21:13.184056 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:21:13.184021    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5d877944c-867np"]
Jul 14 19:21:13.187392 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:21:13.187361    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podadda783a_0ef9_40a9_99a7_445d881305ec.slice/crio-641da7d22fa35c3e868bf287e34056d903c82dd07d1d63c8c1882a903b2d9f35 WatchSource:0}: Error finding container 641da7d22fa35c3e868bf287e34056d903c82dd07d1d63c8c1882a903b2d9f35: Status 404 returned error can't find the container with id 641da7d22fa35c3e868bf287e34056d903c82dd07d1d63c8c1882a903b2d9f35
Jul 14 19:21:13.355726 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:21:13.355624    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5d877944c-867np" event={"ID":"adda783a-0ef9-40a9-99a7-445d881305ec","Type":"ContainerStarted","Data":"641da7d22fa35c3e868bf287e34056d903c82dd07d1d63c8c1882a903b2d9f35"}
Jul 14 19:21:13.625687 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:21:13.625591    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-76jnp"]
Jul 14 19:21:13.630367 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:21:13.630342    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-76jnp"
Jul 14 19:21:13.633075 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:21:13.633055    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Jul 14 19:21:13.643666 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:21:13.643644    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-76jnp"]
Jul 14 19:21:13.797431 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:21:13.797393    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c946ab58-d1fd-4016-9310-3dbf08b679c6-tls-certs\") pod \"model-serving-api-54d89bd5fc-76jnp\" (UID: \"c946ab58-d1fd-4016-9310-3dbf08b679c6\") " pod="opendatahub/model-serving-api-54d89bd5fc-76jnp"
Jul 14 19:21:13.797814 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:21:13.797438    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gnbvm\" (UniqueName: \"kubernetes.io/projected/c946ab58-d1fd-4016-9310-3dbf08b679c6-kube-api-access-gnbvm\") pod \"model-serving-api-54d89bd5fc-76jnp\" (UID: \"c946ab58-d1fd-4016-9310-3dbf08b679c6\") " pod="opendatahub/model-serving-api-54d89bd5fc-76jnp"
Jul 14 19:21:13.898182 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:21:13.898057    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c946ab58-d1fd-4016-9310-3dbf08b679c6-tls-certs\") pod \"model-serving-api-54d89bd5fc-76jnp\" (UID: \"c946ab58-d1fd-4016-9310-3dbf08b679c6\") " pod="opendatahub/model-serving-api-54d89bd5fc-76jnp"
Jul 14 19:21:13.898182 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:21:13.898111    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gnbvm\" (UniqueName: \"kubernetes.io/projected/c946ab58-d1fd-4016-9310-3dbf08b679c6-kube-api-access-gnbvm\") pod \"model-serving-api-54d89bd5fc-76jnp\" (UID: \"c946ab58-d1fd-4016-9310-3dbf08b679c6\") " pod="opendatahub/model-serving-api-54d89bd5fc-76jnp"
Jul 14 19:21:13.898363 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:21:13.898260    2565 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found
Jul 14 19:21:13.898363 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:21:13.898349    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c946ab58-d1fd-4016-9310-3dbf08b679c6-tls-certs podName:c946ab58-d1fd-4016-9310-3dbf08b679c6 nodeName:}" failed. No retries permitted until 2026-07-14 19:21:14.398326658 +0000 UTC m=+620.959183529 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/c946ab58-d1fd-4016-9310-3dbf08b679c6-tls-certs") pod "model-serving-api-54d89bd5fc-76jnp" (UID: "c946ab58-d1fd-4016-9310-3dbf08b679c6") : secret "model-serving-api-tls" not found
Jul 14 19:21:13.921410 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:21:13.921376    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gnbvm\" (UniqueName: \"kubernetes.io/projected/c946ab58-d1fd-4016-9310-3dbf08b679c6-kube-api-access-gnbvm\") pod \"model-serving-api-54d89bd5fc-76jnp\" (UID: \"c946ab58-d1fd-4016-9310-3dbf08b679c6\") " pod="opendatahub/model-serving-api-54d89bd5fc-76jnp"
Jul 14 19:21:14.403414 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:21:14.403377    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c946ab58-d1fd-4016-9310-3dbf08b679c6-tls-certs\") pod \"model-serving-api-54d89bd5fc-76jnp\" (UID: \"c946ab58-d1fd-4016-9310-3dbf08b679c6\") " pod="opendatahub/model-serving-api-54d89bd5fc-76jnp"
Jul 14 19:21:14.403594 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:21:14.403518    2565 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found
Jul 14 19:21:14.403594 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:21:14.403573    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c946ab58-d1fd-4016-9310-3dbf08b679c6-tls-certs podName:c946ab58-d1fd-4016-9310-3dbf08b679c6 nodeName:}" failed. No retries permitted until 2026-07-14 19:21:15.403559586 +0000 UTC m=+621.964416455 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/c946ab58-d1fd-4016-9310-3dbf08b679c6-tls-certs") pod "model-serving-api-54d89bd5fc-76jnp" (UID: "c946ab58-d1fd-4016-9310-3dbf08b679c6") : secret "model-serving-api-tls" not found
Jul 14 19:21:15.413615 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:21:15.413575    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c946ab58-d1fd-4016-9310-3dbf08b679c6-tls-certs\") pod \"model-serving-api-54d89bd5fc-76jnp\" (UID: \"c946ab58-d1fd-4016-9310-3dbf08b679c6\") " pod="opendatahub/model-serving-api-54d89bd5fc-76jnp"
Jul 14 19:21:15.416241 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:21:15.416215    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c946ab58-d1fd-4016-9310-3dbf08b679c6-tls-certs\") pod \"model-serving-api-54d89bd5fc-76jnp\" (UID: \"c946ab58-d1fd-4016-9310-3dbf08b679c6\") " pod="opendatahub/model-serving-api-54d89bd5fc-76jnp"
Jul 14 19:21:15.441072 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:21:15.441027    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-76jnp"
Jul 14 19:21:15.580754 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:21:15.580723    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-76jnp"]
Jul 14 19:21:15.583640 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:21:15.583610    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc946ab58_d1fd_4016_9310_3dbf08b679c6.slice/crio-af0c3441b228dbd1a371448a284afb91e4c8a63850cfa46746501699d2361d9f WatchSource:0}: Error finding container af0c3441b228dbd1a371448a284afb91e4c8a63850cfa46746501699d2361d9f: Status 404 returned error can't find the container with id af0c3441b228dbd1a371448a284afb91e4c8a63850cfa46746501699d2361d9f
Jul 14 19:21:16.371716 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:21:16.371680    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-76jnp" event={"ID":"c946ab58-d1fd-4016-9310-3dbf08b679c6","Type":"ContainerStarted","Data":"af0c3441b228dbd1a371448a284afb91e4c8a63850cfa46746501699d2361d9f"}
Jul 14 19:21:18.386281 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:21:18.386243    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-76jnp" event={"ID":"c946ab58-d1fd-4016-9310-3dbf08b679c6","Type":"ContainerStarted","Data":"9f12d513b233f82acee898da56e6977ed4d7028f3f40be9319dc2e7cd438ef6a"}
Jul 14 19:21:18.386740 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:21:18.386407    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-76jnp"
Jul 14 19:21:18.406011 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:21:18.405954    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-76jnp" podStartSLOduration=3.396147921 podStartE2EDuration="5.405938203s" totalImagesPullingTime="2.009790282s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 19:21:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:21:18.404988305 +0000 UTC m=+624.965845219" watchObservedRunningTime="2026-07-14 19:21:18.405938203 +0000 UTC m=+624.966795074"
Jul 14 19:21:18.837539 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:21:18.837508    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4sklb8"]
Jul 14 19:21:18.841670 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:21:18.841645    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4sklb8"
Jul 14 19:21:18.844108 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:21:18.844090    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 14 19:21:18.844248 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:21:18.844130    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-9tttw\""
Jul 14 19:21:18.851908 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:21:18.851876    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4sklb8"]
Jul 14 19:21:18.945384 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:21:18.945289    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f9309242-1edc-409b-bc18-d243463b18d5-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4sklb8\" (UID: \"f9309242-1edc-409b-bc18-d243463b18d5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4sklb8"
Jul 14 19:21:18.945384 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:21:18.945340    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f9309242-1edc-409b-bc18-d243463b18d5-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4sklb8\" (UID: \"f9309242-1edc-409b-bc18-d243463b18d5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4sklb8"
Jul 14 19:21:18.945384 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:21:18.945363    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f9309242-1edc-409b-bc18-d243463b18d5-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4sklb8\" (UID: \"f9309242-1edc-409b-bc18-d243463b18d5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4sklb8"
Jul 14 19:21:18.945648 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:21:18.945387    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f9309242-1edc-409b-bc18-d243463b18d5-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4sklb8\" (UID: \"f9309242-1edc-409b-bc18-d243463b18d5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4sklb8"
Jul 14 19:21:18.945648 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:21:18.945421    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f9309242-1edc-409b-bc18-d243463b18d5-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4sklb8\" (UID: \"f9309242-1edc-409b-bc18-d243463b18d5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4sklb8"
Jul 14 19:21:18.945648 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:21:18.945440    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f9309242-1edc-409b-bc18-d243463b18d5-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4sklb8\" (UID: \"f9309242-1edc-409b-bc18-d243463b18d5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4sklb8"
Jul 14 19:21:18.945648 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:21:18.945469    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f9309242-1edc-409b-bc18-d243463b18d5-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4sklb8\" (UID: \"f9309242-1edc-409b-bc18-d243463b18d5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4sklb8"
Jul 14 19:21:18.945648 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:21:18.945489    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f9309242-1edc-409b-bc18-d243463b18d5-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4sklb8\" (UID: \"f9309242-1edc-409b-bc18-d243463b18d5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4sklb8"
Jul 14 19:21:18.945648 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:21:18.945512    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ccjhh\" (UniqueName: \"kubernetes.io/projected/f9309242-1edc-409b-bc18-d243463b18d5-kube-api-access-ccjhh\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4sklb8\" (UID: \"f9309242-1edc-409b-bc18-d243463b18d5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4sklb8"
Jul 14 19:21:19.047026 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:21:19.046991    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f9309242-1edc-409b-bc18-d243463b18d5-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4sklb8\" (UID: \"f9309242-1edc-409b-bc18-d243463b18d5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4sklb8"
Jul 14 19:21:19.047205 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:21:19.047040    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f9309242-1edc-409b-bc18-d243463b18d5-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4sklb8\" (UID: \"f9309242-1edc-409b-bc18-d243463b18d5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4sklb8"
Jul 14 19:21:19.047205 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:21:19.047120    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f9309242-1edc-409b-bc18-d243463b18d5-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4sklb8\" (UID: \"f9309242-1edc-409b-bc18-d243463b18d5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4sklb8"
Jul 14 19:21:19.047205 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:21:19.047185    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f9309242-1edc-409b-bc18-d243463b18d5-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4sklb8\" (UID: \"f9309242-1edc-409b-bc18-d243463b18d5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4sklb8"
Jul 14 19:21:19.047375 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:21:19.047214    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f9309242-1edc-409b-bc18-d243463b18d5-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4sklb8\" (UID: \"f9309242-1edc-409b-bc18-d243463b18d5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4sklb8"
Jul 14 19:21:19.047375 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:21:19.047242    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f9309242-1edc-409b-bc18-d243463b18d5-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4sklb8\" (UID: \"f9309242-1edc-409b-bc18-d243463b18d5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4sklb8"
Jul 14 19:21:19.047375 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:21:19.047280    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f9309242-1edc-409b-bc18-d243463b18d5-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4sklb8\" (UID: \"f9309242-1edc-409b-bc18-d243463b18d5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4sklb8"
Jul 14 19:21:19.047375 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:21:19.047313    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f9309242-1edc-409b-bc18-d243463b18d5-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4sklb8\" (UID: \"f9309242-1edc-409b-bc18-d243463b18d5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4sklb8"
Jul 14 19:21:19.047375 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:21:19.047354    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ccjhh\" (UniqueName: \"kubernetes.io/projected/f9309242-1edc-409b-bc18-d243463b18d5-kube-api-access-ccjhh\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4sklb8\" (UID: \"f9309242-1edc-409b-bc18-d243463b18d5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4sklb8"
Jul 14 19:21:19.047622 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:21:19.047411    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f9309242-1edc-409b-bc18-d243463b18d5-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4sklb8\" (UID: \"f9309242-1edc-409b-bc18-d243463b18d5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4sklb8"
Jul 14 19:21:19.047622 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:21:19.047473    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f9309242-1edc-409b-bc18-d243463b18d5-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4sklb8\" (UID: \"f9309242-1edc-409b-bc18-d243463b18d5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4sklb8"
Jul 14 19:21:19.047622 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:21:19.047608    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f9309242-1edc-409b-bc18-d243463b18d5-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4sklb8\" (UID: \"f9309242-1edc-409b-bc18-d243463b18d5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4sklb8"
Jul 14 19:21:19.047780 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:21:19.047714    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f9309242-1edc-409b-bc18-d243463b18d5-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4sklb8\" (UID: \"f9309242-1edc-409b-bc18-d243463b18d5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4sklb8"
Jul 14 19:21:19.047953 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:21:19.047931    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f9309242-1edc-409b-bc18-d243463b18d5-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4sklb8\" (UID: \"f9309242-1edc-409b-bc18-d243463b18d5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4sklb8"
Jul 14 19:21:19.049506 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:21:19.049483    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f9309242-1edc-409b-bc18-d243463b18d5-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4sklb8\" (UID: \"f9309242-1edc-409b-bc18-d243463b18d5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4sklb8"
Jul 14 19:21:19.049809 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:21:19.049789    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f9309242-1edc-409b-bc18-d243463b18d5-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4sklb8\" (UID: \"f9309242-1edc-409b-bc18-d243463b18d5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4sklb8"
Jul 14 19:21:19.055014 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:21:19.054989    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f9309242-1edc-409b-bc18-d243463b18d5-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4sklb8\" (UID: \"f9309242-1edc-409b-bc18-d243463b18d5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4sklb8"
Jul 14 19:21:19.055098 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:21:19.055067    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ccjhh\" (UniqueName: \"kubernetes.io/projected/f9309242-1edc-409b-bc18-d243463b18d5-kube-api-access-ccjhh\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4sklb8\" (UID: \"f9309242-1edc-409b-bc18-d243463b18d5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4sklb8"
Jul 14 19:21:19.152316 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:21:19.152282    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4sklb8"
Jul 14 19:21:19.305237 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:21:19.305097    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4sklb8"]
Jul 14 19:21:19.307649 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:21:19.307624    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9309242_1edc_409b_bc18_d243463b18d5.slice/crio-d814e40acdc38703e801a9959e3c71c9331c9cde9d1a17d8ae1239405de7b526 WatchSource:0}: Error finding container d814e40acdc38703e801a9959e3c71c9331c9cde9d1a17d8ae1239405de7b526: Status 404 returned error can't find the container with id d814e40acdc38703e801a9959e3c71c9331c9cde9d1a17d8ae1239405de7b526
Jul 14 19:21:19.393087 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:21:19.393045    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4sklb8" event={"ID":"f9309242-1edc-409b-bc18-d243463b18d5","Type":"ContainerStarted","Data":"d814e40acdc38703e801a9959e3c71c9331c9cde9d1a17d8ae1239405de7b526"}
Jul 14 19:21:19.394783 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:21:19.394743    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5d877944c-867np" event={"ID":"adda783a-0ef9-40a9-99a7-445d881305ec","Type":"ContainerStarted","Data":"ebe41a2ef1b49e9d8db9a37f9833baef0c689dbb5bc99d5c77d7293bb5b749b4"}
Jul 14 19:21:19.420616 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:21:19.420562    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-5d877944c-867np" podStartSLOduration=2.02133065 podStartE2EDuration="7.420542511s" totalImagesPullingTime="5.399211861s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 19:21:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:21:19.418306219 +0000 UTC m=+625.979163130" watchObservedRunningTime="2026-07-14 19:21:19.420542511 +0000 UTC m=+625.981399403"
Jul 14 19:21:21.027049 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:21:21.027014    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-l9wqn"]
Jul 14 19:21:21.030673 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:21:21.030655    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-l9wqn"
Jul 14 19:21:21.033963 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:21:21.033921    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-sj9wq\""
Jul 14 19:21:21.034134 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:21:21.034045    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 14 19:21:21.034134 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:21:21.034045    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 14 19:21:21.034399 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:21:21.034376    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 14 19:21:21.049999 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:21:21.049920    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-l9wqn"]
Jul 14 19:21:21.171785 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:21:21.171748    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/63d095e3-a845-49d3-a5a9-abd823fad9aa-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-l9wqn\" (UID: \"63d095e3-a845-49d3-a5a9-abd823fad9aa\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-l9wqn"
Jul 14 19:21:21.171785 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:21:21.171786    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vvw6z\" (UniqueName: \"kubernetes.io/projected/63d095e3-a845-49d3-a5a9-abd823fad9aa-kube-api-access-vvw6z\") pod \"istiod-openshift-gateway-94bb8fbfd-l9wqn\" (UID: \"63d095e3-a845-49d3-a5a9-abd823fad9aa\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-l9wqn"
Jul 14 19:21:21.172041 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:21:21.171864    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/63d095e3-a845-49d3-a5a9-abd823fad9aa-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-l9wqn\" (UID: \"63d095e3-a845-49d3-a5a9-abd823fad9aa\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-l9wqn"
Jul 14 19:21:21.172041 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:21:21.171921    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/63d095e3-a845-49d3-a5a9-abd823fad9aa-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-l9wqn\" (UID: \"63d095e3-a845-49d3-a5a9-abd823fad9aa\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-l9wqn"
Jul 14 19:21:21.172041 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:21:21.171956    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/63d095e3-a845-49d3-a5a9-abd823fad9aa-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-l9wqn\" (UID: \"63d095e3-a845-49d3-a5a9-abd823fad9aa\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-l9wqn"
Jul 14 19:21:21.172229 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:21:21.172088    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/63d095e3-a845-49d3-a5a9-abd823fad9aa-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-l9wqn\" (UID: \"63d095e3-a845-49d3-a5a9-abd823fad9aa\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-l9wqn"
Jul 14 19:21:21.172229 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:21:21.172205    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/63d095e3-a845-49d3-a5a9-abd823fad9aa-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-l9wqn\" (UID: \"63d095e3-a845-49d3-a5a9-abd823fad9aa\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-l9wqn"
Jul 14 19:21:21.273609 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:21:21.273575    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/63d095e3-a845-49d3-a5a9-abd823fad9aa-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-l9wqn\" (UID: \"63d095e3-a845-49d3-a5a9-abd823fad9aa\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-l9wqn"
Jul 14 19:21:21.273789 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:21:21.273658    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/63d095e3-a845-49d3-a5a9-abd823fad9aa-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-l9wqn\" (UID: \"63d095e3-a845-49d3-a5a9-abd823fad9aa\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-l9wqn"
Jul 14 19:21:21.273789 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:21:21.273695    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/63d095e3-a845-49d3-a5a9-abd823fad9aa-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-l9wqn\" (UID: \"63d095e3-a845-49d3-a5a9-abd823fad9aa\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-l9wqn"
Jul 14 19:21:21.273789 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:21:21.273719    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vvw6z\" (UniqueName: \"kubernetes.io/projected/63d095e3-a845-49d3-a5a9-abd823fad9aa-kube-api-access-vvw6z\") pod \"istiod-openshift-gateway-94bb8fbfd-l9wqn\" (UID: \"63d095e3-a845-49d3-a5a9-abd823fad9aa\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-l9wqn"
Jul 14 19:21:21.273789 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:21:21.273756    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/63d095e3-a845-49d3-a5a9-abd823fad9aa-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-l9wqn\" (UID: \"63d095e3-a845-49d3-a5a9-abd823fad9aa\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-l9wqn"
Jul 14 19:21:21.273789 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:21:21.273781    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/63d095e3-a845-49d3-a5a9-abd823fad9aa-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-l9wqn\" (UID: \"63d095e3-a845-49d3-a5a9-abd823fad9aa\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-l9wqn"
Jul 14 19:21:21.274061 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:21:21.273809    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/63d095e3-a845-49d3-a5a9-abd823fad9aa-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-l9wqn\" (UID: \"63d095e3-a845-49d3-a5a9-abd823fad9aa\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-l9wqn"
Jul 14 19:21:21.274753 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:21:21.274570    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/63d095e3-a845-49d3-a5a9-abd823fad9aa-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-l9wqn\" (UID: \"63d095e3-a845-49d3-a5a9-abd823fad9aa\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-l9wqn"
Jul 14 19:21:21.276880 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:21:21.276827    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/63d095e3-a845-49d3-a5a9-abd823fad9aa-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-l9wqn\" (UID: \"63d095e3-a845-49d3-a5a9-abd823fad9aa\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-l9wqn"
Jul 14 19:21:21.277032 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:21:21.277008    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/63d095e3-a845-49d3-a5a9-abd823fad9aa-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-l9wqn\" (UID: \"63d095e3-a845-49d3-a5a9-abd823fad9aa\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-l9wqn"
Jul 14 19:21:21.277563 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:21:21.277501    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/63d095e3-a845-49d3-a5a9-abd823fad9aa-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-l9wqn\" (UID: \"63d095e3-a845-49d3-a5a9-abd823fad9aa\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-l9wqn"
Jul 14 19:21:21.277691 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:21:21.277646    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/63d095e3-a845-49d3-a5a9-abd823fad9aa-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-l9wqn\" (UID: \"63d095e3-a845-49d3-a5a9-abd823fad9aa\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-l9wqn"
Jul 14 19:21:21.282976 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:21:21.282943    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vvw6z\" (UniqueName: \"kubernetes.io/projected/63d095e3-a845-49d3-a5a9-abd823fad9aa-kube-api-access-vvw6z\") pod \"istiod-openshift-gateway-94bb8fbfd-l9wqn\" (UID: \"63d095e3-a845-49d3-a5a9-abd823fad9aa\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-l9wqn"
Jul 14 19:21:21.283329 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:21:21.283304    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/63d095e3-a845-49d3-a5a9-abd823fad9aa-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-l9wqn\" (UID: \"63d095e3-a845-49d3-a5a9-abd823fad9aa\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-l9wqn"
Jul 14 19:21:21.343283 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:21:21.343243    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-l9wqn"
Jul 14 19:21:22.087984 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:21:22.087950    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 14 19:21:22.088350 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:21:22.088017    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 14 19:21:22.088350 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:21:22.088051    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 14 19:21:22.181650 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:21:22.181619    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63d095e3_a845_49d3_a5a9_abd823fad9aa.slice/crio-ec6f6b6dc51b714b49b353f3a58890b45cf97ea588c22d055e79f1690a3fc023 WatchSource:0}: Error finding container ec6f6b6dc51b714b49b353f3a58890b45cf97ea588c22d055e79f1690a3fc023: Status 404 returned error can't find the container with id ec6f6b6dc51b714b49b353f3a58890b45cf97ea588c22d055e79f1690a3fc023
Jul 14 19:21:22.182367 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:21:22.182344    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-l9wqn"]
Jul 14 19:21:22.414380 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:21:22.414282    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4sklb8" event={"ID":"f9309242-1edc-409b-bc18-d243463b18d5","Type":"ContainerStarted","Data":"4f79da6436a1ef93e2e08145c6d24fb913068b777d5928fca9e7d420b1e3ca77"}
Jul 14 19:21:22.415558 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:21:22.415533    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-l9wqn" event={"ID":"63d095e3-a845-49d3-a5a9-abd823fad9aa","Type":"ContainerStarted","Data":"ec6f6b6dc51b714b49b353f3a58890b45cf97ea588c22d055e79f1690a3fc023"}
Jul 14 19:21:22.438695 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:21:22.438656    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4sklb8" podStartSLOduration=1.660776679 podStartE2EDuration="4.438640779s" totalImagesPullingTime="2.7778641s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 19:21:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:21:22.438608736 +0000 UTC m=+628.999465629" watchObservedRunningTime="2026-07-14 19:21:22.438640779 +0000 UTC m=+628.999497674"
Jul 14 19:21:23.153296 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:21:23.153261    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4sklb8"
Jul 14 19:21:23.157795 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:21:23.157769    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4sklb8"
Jul 14 19:21:23.420905 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:21:23.420818    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4sklb8"
Jul 14 19:21:23.421936 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:21:23.421909    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4sklb8"
Jul 14 19:21:23.637103 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:21:23.637050    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-8jx5x"]
Jul 14 19:21:23.641098 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:21:23.641070    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-8jx5x"
Jul 14 19:21:23.643725 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:21:23.643694    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Jul 14 19:21:23.646329 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:21:23.646307    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-7cwb5\""
Jul 14 19:21:23.657374 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:21:23.657344    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-59s7m"]
Jul 14 19:21:23.661042 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:21:23.661015    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-8jx5x"]
Jul 14 19:21:23.661219 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:21:23.661111    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-59s7m"
Jul 14 19:21:23.664512 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:21:23.664478    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-qqj7g\""
Jul 14 19:21:23.664780 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:21:23.664760    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Jul 14 19:21:23.679915 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:21:23.679831    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-59s7m"]
Jul 14 19:21:23.796581 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:21:23.796538    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a6cc2edb-535e-453e-8dae-347994f44b03-cert\") pod \"kserve-controller-manager-d6f4b65b8-59s7m\" (UID: \"a6cc2edb-535e-453e-8dae-347994f44b03\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-59s7m"
Jul 14 19:21:23.796737 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:21:23.796591    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zmmn7\" (UniqueName: \"kubernetes.io/projected/a6cc2edb-535e-453e-8dae-347994f44b03-kube-api-access-zmmn7\") pod \"kserve-controller-manager-d6f4b65b8-59s7m\" (UID: \"a6cc2edb-535e-453e-8dae-347994f44b03\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-59s7m"
Jul 14 19:21:23.796737 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:21:23.796665    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vtzbx\" (UniqueName: \"kubernetes.io/projected/477ec5d3-633e-43ad-884d-04ecf8e99df4-kube-api-access-vtzbx\") pod \"llmisvc-controller-manager-777c6bd7d5-8jx5x\" (UID: \"477ec5d3-633e-43ad-884d-04ecf8e99df4\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-8jx5x"
Jul 14 19:21:23.796831 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:21:23.796745    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/477ec5d3-633e-43ad-884d-04ecf8e99df4-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-8jx5x\" (UID: \"477ec5d3-633e-43ad-884d-04ecf8e99df4\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-8jx5x"
Jul 14 19:21:23.897942 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:21:23.897902    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/477ec5d3-633e-43ad-884d-04ecf8e99df4-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-8jx5x\" (UID: \"477ec5d3-633e-43ad-884d-04ecf8e99df4\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-8jx5x"
Jul 14 19:21:23.897942 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:21:23.897945    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a6cc2edb-535e-453e-8dae-347994f44b03-cert\") pod \"kserve-controller-manager-d6f4b65b8-59s7m\" (UID: \"a6cc2edb-535e-453e-8dae-347994f44b03\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-59s7m"
Jul 14 19:21:23.898221 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:21:23.897983    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zmmn7\" (UniqueName: \"kubernetes.io/projected/a6cc2edb-535e-453e-8dae-347994f44b03-kube-api-access-zmmn7\") pod \"kserve-controller-manager-d6f4b65b8-59s7m\" (UID: \"a6cc2edb-535e-453e-8dae-347994f44b03\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-59s7m"
Jul 14 19:21:23.898221 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:21:23.898081    2565 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found
Jul 14 19:21:23.898221 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:21:23.898122    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vtzbx\" (UniqueName: \"kubernetes.io/projected/477ec5d3-633e-43ad-884d-04ecf8e99df4-kube-api-access-vtzbx\") pod \"llmisvc-controller-manager-777c6bd7d5-8jx5x\" (UID: \"477ec5d3-633e-43ad-884d-04ecf8e99df4\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-8jx5x"
Jul 14 19:21:23.898221 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:21:23.898188    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/477ec5d3-633e-43ad-884d-04ecf8e99df4-cert podName:477ec5d3-633e-43ad-884d-04ecf8e99df4 nodeName:}" failed. No retries permitted until 2026-07-14 19:21:24.398142911 +0000 UTC m=+630.958999780 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/477ec5d3-633e-43ad-884d-04ecf8e99df4-cert") pod "llmisvc-controller-manager-777c6bd7d5-8jx5x" (UID: "477ec5d3-633e-43ad-884d-04ecf8e99df4") : secret "llmisvc-webhook-server-cert" not found
Jul 14 19:21:23.900726 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:21:23.900700    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a6cc2edb-535e-453e-8dae-347994f44b03-cert\") pod \"kserve-controller-manager-d6f4b65b8-59s7m\" (UID: \"a6cc2edb-535e-453e-8dae-347994f44b03\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-59s7m"
Jul 14 19:21:23.919484 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:21:23.919451    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vtzbx\" (UniqueName: \"kubernetes.io/projected/477ec5d3-633e-43ad-884d-04ecf8e99df4-kube-api-access-vtzbx\") pod \"llmisvc-controller-manager-777c6bd7d5-8jx5x\" (UID: \"477ec5d3-633e-43ad-884d-04ecf8e99df4\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-8jx5x"
Jul 14 19:21:23.921575 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:21:23.921535    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zmmn7\" (UniqueName: \"kubernetes.io/projected/a6cc2edb-535e-453e-8dae-347994f44b03-kube-api-access-zmmn7\") pod \"kserve-controller-manager-d6f4b65b8-59s7m\" (UID: \"a6cc2edb-535e-453e-8dae-347994f44b03\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-59s7m"
Jul 14 19:21:23.971552 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:21:23.971519    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-59s7m"
Jul 14 19:21:24.118019 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:21:24.117988    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-59s7m"]
Jul 14 19:21:24.119557 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:21:24.119524    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6cc2edb_535e_453e_8dae_347994f44b03.slice/crio-368909770d5408898e7ff9ed8bde56a4189f9cf1c9fdd7398b5e8f827ca44ca6 WatchSource:0}: Error finding container 368909770d5408898e7ff9ed8bde56a4189f9cf1c9fdd7398b5e8f827ca44ca6: Status 404 returned error can't find the container with id 368909770d5408898e7ff9ed8bde56a4189f9cf1c9fdd7398b5e8f827ca44ca6
Jul 14 19:21:24.401814 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:21:24.401719    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/477ec5d3-633e-43ad-884d-04ecf8e99df4-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-8jx5x\" (UID: \"477ec5d3-633e-43ad-884d-04ecf8e99df4\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-8jx5x"
Jul 14 19:21:24.404374 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:21:24.404350    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/477ec5d3-633e-43ad-884d-04ecf8e99df4-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-8jx5x\" (UID: \"477ec5d3-633e-43ad-884d-04ecf8e99df4\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-8jx5x"
Jul 14 19:21:24.427404 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:21:24.427365    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-59s7m" event={"ID":"a6cc2edb-535e-453e-8dae-347994f44b03","Type":"ContainerStarted","Data":"368909770d5408898e7ff9ed8bde56a4189f9cf1c9fdd7398b5e8f827ca44ca6"}
Jul 14 19:21:24.552123 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:21:24.552082    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-8jx5x"
Jul 14 19:21:24.693997 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:21:24.693971    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-8jx5x"]
Jul 14 19:21:24.696665 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:21:24.696640    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod477ec5d3_633e_43ad_884d_04ecf8e99df4.slice/crio-1b1ac8fcaddb357a458deb56eb42a1a840312996da464783ec8b855a63d874b1 WatchSource:0}: Error finding container 1b1ac8fcaddb357a458deb56eb42a1a840312996da464783ec8b855a63d874b1: Status 404 returned error can't find the container with id 1b1ac8fcaddb357a458deb56eb42a1a840312996da464783ec8b855a63d874b1
Jul 14 19:21:25.434309 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:21:25.434276    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-8jx5x" event={"ID":"477ec5d3-633e-43ad-884d-04ecf8e99df4","Type":"ContainerStarted","Data":"1b1ac8fcaddb357a458deb56eb42a1a840312996da464783ec8b855a63d874b1"}
Jul 14 19:21:27.448470 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:21:27.448368    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-59s7m" event={"ID":"a6cc2edb-535e-453e-8dae-347994f44b03","Type":"ContainerStarted","Data":"64dfd0ab047eaa539b2c0723d5b669f2c20e83907b16d83fe078217cee26bbcd"}
Jul 14 19:21:27.448930 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:21:27.448497    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-59s7m"
Jul 14 19:21:27.468616 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:21:27.468554    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-59s7m" podStartSLOduration=1.487309119 podStartE2EDuration="4.468535769s" totalImagesPullingTime="2.98122665s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 19:21:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:21:27.46737956 +0000 UTC m=+634.028236476" watchObservedRunningTime="2026-07-14 19:21:27.468535769 +0000 UTC m=+634.029392660"
Jul 14 19:21:28.455855 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:21:28.455817    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-8jx5x" event={"ID":"477ec5d3-633e-43ad-884d-04ecf8e99df4","Type":"ContainerStarted","Data":"26fd5619552fe4194871f866a5085a247c3111c547e34ca943db15023c825acf"}
Jul 14 19:21:28.456385 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:21:28.455923    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-8jx5x"
Jul 14 19:21:28.471966 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:21:28.471907    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-8jx5x" podStartSLOduration=2.343039411 podStartE2EDuration="5.471890688s" totalImagesPullingTime="3.128851277s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 19:21:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:21:28.471347008 +0000 UTC m=+635.032203921" watchObservedRunningTime="2026-07-14 19:21:28.471890688 +0000 UTC m=+635.032747580"
Jul 14 19:21:29.399322 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:21:29.399293    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-76jnp"
Jul 14 19:21:38.353897 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:21:38.353855    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 14 19:21:38.354243 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:21:38.353925    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 14 19:21:38.509538 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:21:38.509491    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-l9wqn" event={"ID":"63d095e3-a845-49d3-a5a9-abd823fad9aa","Type":"ContainerStarted","Data":"17275fe4553a070e59af2dbfbe88a98d82ed5aa7682c8c13808bd0bf2ff93634"}
Jul 14 19:21:38.509722 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:21:38.509621    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-l9wqn"
Jul 14 19:21:38.530371 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:21:38.530317    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-l9wqn" podStartSLOduration=1.360380994 podStartE2EDuration="17.530299042s" totalImagesPullingTime="16.169918048s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 19:21:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:21:38.529365606 +0000 UTC m=+645.090222525" watchObservedRunningTime="2026-07-14 19:21:38.530299042 +0000 UTC m=+645.091155934"
Jul 14 19:21:39.516778 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:21:39.516748    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-l9wqn"
Jul 14 19:21:58.461488 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:21:58.461443    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-59s7m"
Jul 14 19:21:59.462956 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:21:59.462928    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-8jx5x"
Jul 14 19:22:28.136437 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:22:28.136406    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5cbb994989-bsmd9"]
Jul 14 19:22:29.723166 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:22:29.723122    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736qcrg"]
Jul 14 19:22:29.725682 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:22:29.725666    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736qcrg"
Jul 14 19:22:29.728376 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:22:29.728358    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-jwxt4\""
Jul 14 19:22:29.728489 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:22:29.728378    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 14 19:22:29.729265 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:22:29.729248    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 14 19:22:29.737672 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:22:29.737651    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736qcrg"]
Jul 14 19:22:29.781522 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:22:29.781496    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fd9e1d7d-4294-42c8-82e1-351b6373a8d6-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736qcrg\" (UID: \"fd9e1d7d-4294-42c8-82e1-351b6373a8d6\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736qcrg"
Jul 14 19:22:29.781671 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:22:29.781540    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fd9e1d7d-4294-42c8-82e1-351b6373a8d6-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736qcrg\" (UID: \"fd9e1d7d-4294-42c8-82e1-351b6373a8d6\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736qcrg"
Jul 14 19:22:29.781671 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:22:29.781570    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jtkct\" (UniqueName: \"kubernetes.io/projected/fd9e1d7d-4294-42c8-82e1-351b6373a8d6-kube-api-access-jtkct\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736qcrg\" (UID: \"fd9e1d7d-4294-42c8-82e1-351b6373a8d6\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736qcrg"
Jul 14 19:22:29.882792 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:22:29.882760    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jtkct\" (UniqueName: \"kubernetes.io/projected/fd9e1d7d-4294-42c8-82e1-351b6373a8d6-kube-api-access-jtkct\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736qcrg\" (UID: \"fd9e1d7d-4294-42c8-82e1-351b6373a8d6\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736qcrg"
Jul 14 19:22:29.882920 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:22:29.882831    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fd9e1d7d-4294-42c8-82e1-351b6373a8d6-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736qcrg\" (UID: \"fd9e1d7d-4294-42c8-82e1-351b6373a8d6\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736qcrg"
Jul 14 19:22:29.882920 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:22:29.882866    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fd9e1d7d-4294-42c8-82e1-351b6373a8d6-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736qcrg\" (UID: \"fd9e1d7d-4294-42c8-82e1-351b6373a8d6\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736qcrg"
Jul 14 19:22:29.883315 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:22:29.883297    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fd9e1d7d-4294-42c8-82e1-351b6373a8d6-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736qcrg\" (UID: \"fd9e1d7d-4294-42c8-82e1-351b6373a8d6\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736qcrg"
Jul 14 19:22:29.883315 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:22:29.883283    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fd9e1d7d-4294-42c8-82e1-351b6373a8d6-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736qcrg\" (UID: \"fd9e1d7d-4294-42c8-82e1-351b6373a8d6\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736qcrg"
Jul 14 19:22:29.892089 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:22:29.892067    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jtkct\" (UniqueName: \"kubernetes.io/projected/fd9e1d7d-4294-42c8-82e1-351b6373a8d6-kube-api-access-jtkct\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736qcrg\" (UID: \"fd9e1d7d-4294-42c8-82e1-351b6373a8d6\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736qcrg"
Jul 14 19:22:30.034909 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:22:30.034837    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736qcrg"
Jul 14 19:22:30.169150 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:22:30.169124    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736qcrg"]
Jul 14 19:22:30.171129 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:22:30.171102    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd9e1d7d_4294_42c8_82e1_351b6373a8d6.slice/crio-6134689a0af5b151a14d8525023a39bec6e03182ea42bfdf104036e84e23b4ee WatchSource:0}: Error finding container 6134689a0af5b151a14d8525023a39bec6e03182ea42bfdf104036e84e23b4ee: Status 404 returned error can't find the container with id 6134689a0af5b151a14d8525023a39bec6e03182ea42bfdf104036e84e23b4ee
Jul 14 19:22:30.506838 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:22:30.506798    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595q484"]
Jul 14 19:22:30.509571 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:22:30.509552    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595q484"
Jul 14 19:22:30.519461 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:22:30.519435    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595q484"]
Jul 14 19:22:30.590869 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:22:30.590827    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/96d2ff75-d472-4381-b506-9732d122a030-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595q484\" (UID: \"96d2ff75-d472-4381-b506-9732d122a030\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595q484"
Jul 14 19:22:30.591075 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:22:30.590883    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k59t2\" (UniqueName: \"kubernetes.io/projected/96d2ff75-d472-4381-b506-9732d122a030-kube-api-access-k59t2\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595q484\" (UID: \"96d2ff75-d472-4381-b506-9732d122a030\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595q484"
Jul 14 19:22:30.591075 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:22:30.590973    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/96d2ff75-d472-4381-b506-9732d122a030-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595q484\" (UID: \"96d2ff75-d472-4381-b506-9732d122a030\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595q484"
Jul 14 19:22:30.692417 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:22:30.692373    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k59t2\" (UniqueName: \"kubernetes.io/projected/96d2ff75-d472-4381-b506-9732d122a030-kube-api-access-k59t2\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595q484\" (UID: \"96d2ff75-d472-4381-b506-9732d122a030\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595q484"
Jul 14 19:22:30.692609 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:22:30.692426    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/96d2ff75-d472-4381-b506-9732d122a030-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595q484\" (UID: \"96d2ff75-d472-4381-b506-9732d122a030\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595q484"
Jul 14 19:22:30.692609 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:22:30.692492    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/96d2ff75-d472-4381-b506-9732d122a030-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595q484\" (UID: \"96d2ff75-d472-4381-b506-9732d122a030\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595q484"
Jul 14 19:22:30.692841 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:22:30.692824    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/96d2ff75-d472-4381-b506-9732d122a030-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595q484\" (UID: \"96d2ff75-d472-4381-b506-9732d122a030\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595q484"
Jul 14 19:22:30.692917 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:22:30.692869    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/96d2ff75-d472-4381-b506-9732d122a030-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595q484\" (UID: \"96d2ff75-d472-4381-b506-9732d122a030\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595q484"
Jul 14 19:22:30.700666 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:22:30.700638    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k59t2\" (UniqueName: \"kubernetes.io/projected/96d2ff75-d472-4381-b506-9732d122a030-kube-api-access-k59t2\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595q484\" (UID: \"96d2ff75-d472-4381-b506-9732d122a030\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595q484"
Jul 14 19:22:30.787455 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:22:30.787366    2565 generic.go:356] "Generic (PLEG): container finished" podID="fd9e1d7d-4294-42c8-82e1-351b6373a8d6" containerID="3018d03b0aed68012cfcf88f3f70c0701f8804ff6884a945efa7e1c036ce661c" exitCode=0
Jul 14 19:22:30.787801 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:22:30.787454    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736qcrg" event={"ID":"fd9e1d7d-4294-42c8-82e1-351b6373a8d6","Type":"ContainerDied","Data":"3018d03b0aed68012cfcf88f3f70c0701f8804ff6884a945efa7e1c036ce661c"}
Jul 14 19:22:30.787801 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:22:30.787508    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736qcrg" event={"ID":"fd9e1d7d-4294-42c8-82e1-351b6373a8d6","Type":"ContainerStarted","Data":"6134689a0af5b151a14d8525023a39bec6e03182ea42bfdf104036e84e23b4ee"}
Jul 14 19:22:30.787911 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:22:30.787894    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 14 19:22:30.819225 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:22:30.819188    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595q484"
Jul 14 19:22:30.963603 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:22:30.963568    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595q484"]
Jul 14 19:22:30.965412 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:22:30.965375    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96d2ff75_d472_4381_b506_9732d122a030.slice/crio-4ea4306abfb594503a79c0974b475c6fee17aa7bffe7448ef2472deb434369bc WatchSource:0}: Error finding container 4ea4306abfb594503a79c0974b475c6fee17aa7bffe7448ef2472deb434369bc: Status 404 returned error can't find the container with id 4ea4306abfb594503a79c0974b475c6fee17aa7bffe7448ef2472deb434369bc
Jul 14 19:22:31.326306 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:22:31.323969    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jg8rq"]
Jul 14 19:22:31.331437 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:22:31.331402    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jg8rq"
Jul 14 19:22:31.336297 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:22:31.336259    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jg8rq"]
Jul 14 19:22:31.399554 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:22:31.399511    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-77nwx\" (UniqueName: \"kubernetes.io/projected/11705ca2-7d60-4441-92d1-90987e0f1a4e-kube-api-access-77nwx\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jg8rq\" (UID: \"11705ca2-7d60-4441-92d1-90987e0f1a4e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jg8rq"
Jul 14 19:22:31.399740 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:22:31.399564    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/11705ca2-7d60-4441-92d1-90987e0f1a4e-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jg8rq\" (UID: \"11705ca2-7d60-4441-92d1-90987e0f1a4e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jg8rq"
Jul 14 19:22:31.399740 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:22:31.399658    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/11705ca2-7d60-4441-92d1-90987e0f1a4e-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jg8rq\" (UID: \"11705ca2-7d60-4441-92d1-90987e0f1a4e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jg8rq"
Jul 14 19:22:31.501185 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:22:31.501102    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/11705ca2-7d60-4441-92d1-90987e0f1a4e-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jg8rq\" (UID: \"11705ca2-7d60-4441-92d1-90987e0f1a4e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jg8rq"
Jul 14 19:22:31.501381 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:22:31.501259    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-77nwx\" (UniqueName: \"kubernetes.io/projected/11705ca2-7d60-4441-92d1-90987e0f1a4e-kube-api-access-77nwx\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jg8rq\" (UID: \"11705ca2-7d60-4441-92d1-90987e0f1a4e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jg8rq"
Jul 14 19:22:31.501381 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:22:31.501298    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/11705ca2-7d60-4441-92d1-90987e0f1a4e-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jg8rq\" (UID: \"11705ca2-7d60-4441-92d1-90987e0f1a4e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jg8rq"
Jul 14 19:22:31.501547 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:22:31.501524    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/11705ca2-7d60-4441-92d1-90987e0f1a4e-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jg8rq\" (UID: \"11705ca2-7d60-4441-92d1-90987e0f1a4e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jg8rq"
Jul 14 19:22:31.501603 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:22:31.501575    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/11705ca2-7d60-4441-92d1-90987e0f1a4e-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jg8rq\" (UID: \"11705ca2-7d60-4441-92d1-90987e0f1a4e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jg8rq"
Jul 14 19:22:31.510303 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:22:31.510277    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-77nwx\" (UniqueName: \"kubernetes.io/projected/11705ca2-7d60-4441-92d1-90987e0f1a4e-kube-api-access-77nwx\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jg8rq\" (UID: \"11705ca2-7d60-4441-92d1-90987e0f1a4e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jg8rq"
Jul 14 19:22:31.646549 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:22:31.646467    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jg8rq"
Jul 14 19:22:31.799729 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:22:31.799695    2565 generic.go:356] "Generic (PLEG): container finished" podID="fd9e1d7d-4294-42c8-82e1-351b6373a8d6" containerID="e05d1fafe8237c074cb13e0593b924f23f8c2cbe6b1a43362b263aa25ae49358" exitCode=0
Jul 14 19:22:31.800245 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:22:31.799796    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736qcrg" event={"ID":"fd9e1d7d-4294-42c8-82e1-351b6373a8d6","Type":"ContainerDied","Data":"e05d1fafe8237c074cb13e0593b924f23f8c2cbe6b1a43362b263aa25ae49358"}
Jul 14 19:22:31.801902 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:22:31.801877    2565 generic.go:356] "Generic (PLEG): container finished" podID="96d2ff75-d472-4381-b506-9732d122a030" containerID="f6260140bcadbe9c9578017a9c01495d4873c1198078e70e60359afba12a1410" exitCode=0
Jul 14 19:22:31.801984 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:22:31.801963    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595q484" event={"ID":"96d2ff75-d472-4381-b506-9732d122a030","Type":"ContainerDied","Data":"f6260140bcadbe9c9578017a9c01495d4873c1198078e70e60359afba12a1410"}
Jul 14 19:22:31.802033 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:22:31.802005    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595q484" event={"ID":"96d2ff75-d472-4381-b506-9732d122a030","Type":"ContainerStarted","Data":"4ea4306abfb594503a79c0974b475c6fee17aa7bffe7448ef2472deb434369bc"}
Jul 14 19:22:31.814106 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:22:31.814073    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jg8rq"]
Jul 14 19:22:31.816419 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:22:31.816394    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11705ca2_7d60_4441_92d1_90987e0f1a4e.slice/crio-4e96388bc6e685e8aa2956708a557243b78b70ca1b1fc36ce0597bcf38cd693c WatchSource:0}: Error finding container 4e96388bc6e685e8aa2956708a557243b78b70ca1b1fc36ce0597bcf38cd693c: Status 404 returned error can't find the container with id 4e96388bc6e685e8aa2956708a557243b78b70ca1b1fc36ce0597bcf38cd693c
Jul 14 19:22:32.114349 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:22:32.114301    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0bcx7z"]
Jul 14 19:22:32.117323 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:22:32.117288    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0bcx7z"
Jul 14 19:22:32.125659 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:22:32.125628    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0bcx7z"]
Jul 14 19:22:32.208086 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:22:32.207982    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f4738274-1650-4b36-8c34-8bc1c71050ac-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0bcx7z\" (UID: \"f4738274-1650-4b36-8c34-8bc1c71050ac\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0bcx7z"
Jul 14 19:22:32.208086 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:22:32.208035    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f4738274-1650-4b36-8c34-8bc1c71050ac-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0bcx7z\" (UID: \"f4738274-1650-4b36-8c34-8bc1c71050ac\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0bcx7z"
Jul 14 19:22:32.208366 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:22:32.208128    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gf568\" (UniqueName: \"kubernetes.io/projected/f4738274-1650-4b36-8c34-8bc1c71050ac-kube-api-access-gf568\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0bcx7z\" (UID: \"f4738274-1650-4b36-8c34-8bc1c71050ac\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0bcx7z"
Jul 14 19:22:32.309085 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:22:32.309037    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f4738274-1650-4b36-8c34-8bc1c71050ac-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0bcx7z\" (UID: \"f4738274-1650-4b36-8c34-8bc1c71050ac\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0bcx7z"
Jul 14 19:22:32.309331 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:22:32.309198    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f4738274-1650-4b36-8c34-8bc1c71050ac-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0bcx7z\" (UID: \"f4738274-1650-4b36-8c34-8bc1c71050ac\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0bcx7z"
Jul 14 19:22:32.309331 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:22:32.309265    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gf568\" (UniqueName: \"kubernetes.io/projected/f4738274-1650-4b36-8c34-8bc1c71050ac-kube-api-access-gf568\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0bcx7z\" (UID: \"f4738274-1650-4b36-8c34-8bc1c71050ac\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0bcx7z"
Jul 14 19:22:32.309569 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:22:32.309548    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f4738274-1650-4b36-8c34-8bc1c71050ac-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0bcx7z\" (UID: \"f4738274-1650-4b36-8c34-8bc1c71050ac\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0bcx7z"
Jul 14 19:22:32.309643 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:22:32.309557    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f4738274-1650-4b36-8c34-8bc1c71050ac-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0bcx7z\" (UID: \"f4738274-1650-4b36-8c34-8bc1c71050ac\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0bcx7z"
Jul 14 19:22:32.318352 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:22:32.318317    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gf568\" (UniqueName: \"kubernetes.io/projected/f4738274-1650-4b36-8c34-8bc1c71050ac-kube-api-access-gf568\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0bcx7z\" (UID: \"f4738274-1650-4b36-8c34-8bc1c71050ac\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0bcx7z"
Jul 14 19:22:32.429406 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:22:32.429361    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0bcx7z"
Jul 14 19:22:32.583417 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:22:32.583386    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0bcx7z"]
Jul 14 19:22:32.585368 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:22:32.585336    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4738274_1650_4b36_8c34_8bc1c71050ac.slice/crio-e30655874c15568f8668ed76b6b84d1f0dca7a0bd2c397bd4dec539dd2d7b9dd WatchSource:0}: Error finding container e30655874c15568f8668ed76b6b84d1f0dca7a0bd2c397bd4dec539dd2d7b9dd: Status 404 returned error can't find the container with id e30655874c15568f8668ed76b6b84d1f0dca7a0bd2c397bd4dec539dd2d7b9dd
Jul 14 19:22:32.810652 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:22:32.810552    2565 generic.go:356] "Generic (PLEG): container finished" podID="11705ca2-7d60-4441-92d1-90987e0f1a4e" containerID="f5f8ff8c3f1a8e0da4d7e0893688c9abedb812625f504900ea4fa3ed828855e8" exitCode=0
Jul 14 19:22:32.810652 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:22:32.810632    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jg8rq" event={"ID":"11705ca2-7d60-4441-92d1-90987e0f1a4e","Type":"ContainerDied","Data":"f5f8ff8c3f1a8e0da4d7e0893688c9abedb812625f504900ea4fa3ed828855e8"}
Jul 14 19:22:32.811121 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:22:32.810690    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jg8rq" event={"ID":"11705ca2-7d60-4441-92d1-90987e0f1a4e","Type":"ContainerStarted","Data":"4e96388bc6e685e8aa2956708a557243b78b70ca1b1fc36ce0597bcf38cd693c"}
Jul 14 19:22:32.812494 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:22:32.812460    2565 generic.go:356] "Generic (PLEG): container finished" podID="f4738274-1650-4b36-8c34-8bc1c71050ac" containerID="853caa2805bf177851370fdfc9a4f5d8c9a2cc82db279702edc77292e40f9717" exitCode=0
Jul 14 19:22:32.812637 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:22:32.812552    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0bcx7z" event={"ID":"f4738274-1650-4b36-8c34-8bc1c71050ac","Type":"ContainerDied","Data":"853caa2805bf177851370fdfc9a4f5d8c9a2cc82db279702edc77292e40f9717"}
Jul 14 19:22:32.812637 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:22:32.812616    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0bcx7z" event={"ID":"f4738274-1650-4b36-8c34-8bc1c71050ac","Type":"ContainerStarted","Data":"e30655874c15568f8668ed76b6b84d1f0dca7a0bd2c397bd4dec539dd2d7b9dd"}
Jul 14 19:22:32.815389 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:22:32.815357    2565 generic.go:356] "Generic (PLEG): container finished" podID="fd9e1d7d-4294-42c8-82e1-351b6373a8d6" containerID="6e852ac6e4496ab06f7e4de5b3bcfdce5dffb9fe5c3b5320c959b747cee32d35" exitCode=0
Jul 14 19:22:32.815499 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:22:32.815447    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736qcrg" event={"ID":"fd9e1d7d-4294-42c8-82e1-351b6373a8d6","Type":"ContainerDied","Data":"6e852ac6e4496ab06f7e4de5b3bcfdce5dffb9fe5c3b5320c959b747cee32d35"}
Jul 14 19:22:33.833236 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:22:33.833191    2565 generic.go:356] "Generic (PLEG): container finished" podID="11705ca2-7d60-4441-92d1-90987e0f1a4e" containerID="d50dd55515bcf520caa9b191786b201f06283a79bbabf12504ad2bebe8684493" exitCode=0
Jul 14 19:22:33.833647 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:22:33.833268    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jg8rq" event={"ID":"11705ca2-7d60-4441-92d1-90987e0f1a4e","Type":"ContainerDied","Data":"d50dd55515bcf520caa9b191786b201f06283a79bbabf12504ad2bebe8684493"}
Jul 14 19:22:34.070855 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:22:34.070749    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736qcrg"
Jul 14 19:22:34.127839 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:22:34.127794    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fd9e1d7d-4294-42c8-82e1-351b6373a8d6-bundle\") pod \"fd9e1d7d-4294-42c8-82e1-351b6373a8d6\" (UID: \"fd9e1d7d-4294-42c8-82e1-351b6373a8d6\") "
Jul 14 19:22:34.128044 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:22:34.127920    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fd9e1d7d-4294-42c8-82e1-351b6373a8d6-util\") pod \"fd9e1d7d-4294-42c8-82e1-351b6373a8d6\" (UID: \"fd9e1d7d-4294-42c8-82e1-351b6373a8d6\") "
Jul 14 19:22:34.128044 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:22:34.127963    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jtkct\" (UniqueName: \"kubernetes.io/projected/fd9e1d7d-4294-42c8-82e1-351b6373a8d6-kube-api-access-jtkct\") pod \"fd9e1d7d-4294-42c8-82e1-351b6373a8d6\" (UID: \"fd9e1d7d-4294-42c8-82e1-351b6373a8d6\") "
Jul 14 19:22:34.128540 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:22:34.128504    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fd9e1d7d-4294-42c8-82e1-351b6373a8d6-bundle" (OuterVolumeSpecName: "bundle") pod "fd9e1d7d-4294-42c8-82e1-351b6373a8d6" (UID: "fd9e1d7d-4294-42c8-82e1-351b6373a8d6"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 19:22:34.130773 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:22:34.130725    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fd9e1d7d-4294-42c8-82e1-351b6373a8d6-kube-api-access-jtkct" (OuterVolumeSpecName: "kube-api-access-jtkct") pod "fd9e1d7d-4294-42c8-82e1-351b6373a8d6" (UID: "fd9e1d7d-4294-42c8-82e1-351b6373a8d6"). InnerVolumeSpecName "kube-api-access-jtkct". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 19:22:34.133013 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:22:34.132972    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fd9e1d7d-4294-42c8-82e1-351b6373a8d6-util" (OuterVolumeSpecName: "util") pod "fd9e1d7d-4294-42c8-82e1-351b6373a8d6" (UID: "fd9e1d7d-4294-42c8-82e1-351b6373a8d6"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 19:22:34.229773 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:22:34.229707    2565 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fd9e1d7d-4294-42c8-82e1-351b6373a8d6-util\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Jul 14 19:22:34.229773 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:22:34.229759    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jtkct\" (UniqueName: \"kubernetes.io/projected/fd9e1d7d-4294-42c8-82e1-351b6373a8d6-kube-api-access-jtkct\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Jul 14 19:22:34.229773 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:22:34.229773    2565 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fd9e1d7d-4294-42c8-82e1-351b6373a8d6-bundle\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Jul 14 19:22:34.842635 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:22:34.842519    2565 generic.go:356] "Generic (PLEG): container finished" podID="11705ca2-7d60-4441-92d1-90987e0f1a4e" containerID="4cfbac78baf8c26505bd7d044fc702e0ac700747d5cddc43b368581143c6ab22" exitCode=0
Jul 14 19:22:34.842635 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:22:34.842556    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jg8rq" event={"ID":"11705ca2-7d60-4441-92d1-90987e0f1a4e","Type":"ContainerDied","Data":"4cfbac78baf8c26505bd7d044fc702e0ac700747d5cddc43b368581143c6ab22"}
Jul 14 19:22:34.844682 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:22:34.844648    2565 generic.go:356] "Generic (PLEG): container finished" podID="f4738274-1650-4b36-8c34-8bc1c71050ac" containerID="b815fae4e9ad4114c7551aac893099825a0c2e9b839c51239d70f947f91e37f0" exitCode=0
Jul 14 19:22:34.844836 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:22:34.844736    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0bcx7z" event={"ID":"f4738274-1650-4b36-8c34-8bc1c71050ac","Type":"ContainerDied","Data":"b815fae4e9ad4114c7551aac893099825a0c2e9b839c51239d70f947f91e37f0"}
Jul 14 19:22:34.846997 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:22:34.846963    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736qcrg" event={"ID":"fd9e1d7d-4294-42c8-82e1-351b6373a8d6","Type":"ContainerDied","Data":"6134689a0af5b151a14d8525023a39bec6e03182ea42bfdf104036e84e23b4ee"}
Jul 14 19:22:34.846997 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:22:34.846990    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736qcrg"
Jul 14 19:22:34.847212 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:22:34.847075    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6134689a0af5b151a14d8525023a39bec6e03182ea42bfdf104036e84e23b4ee"
Jul 14 19:22:34.849100 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:22:34.849068    2565 generic.go:356] "Generic (PLEG): container finished" podID="96d2ff75-d472-4381-b506-9732d122a030" containerID="32d9c3f8d885e577f132d0a815ad838b22a0bbf37f6178afc2d2952fa5468183" exitCode=0
Jul 14 19:22:34.849255 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:22:34.849130    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595q484" event={"ID":"96d2ff75-d472-4381-b506-9732d122a030","Type":"ContainerDied","Data":"32d9c3f8d885e577f132d0a815ad838b22a0bbf37f6178afc2d2952fa5468183"}
Jul 14 19:22:35.865042 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:22:35.864993    2565 generic.go:356] "Generic (PLEG): container finished" podID="f4738274-1650-4b36-8c34-8bc1c71050ac" containerID="79b65f6c65f7f25e6cf952bb49f1f155dd09981c09c2479d6695a59940ad7ea9" exitCode=0
Jul 14 19:22:35.865525 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:22:35.865087    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0bcx7z" event={"ID":"f4738274-1650-4b36-8c34-8bc1c71050ac","Type":"ContainerDied","Data":"79b65f6c65f7f25e6cf952bb49f1f155dd09981c09c2479d6695a59940ad7ea9"}
Jul 14 19:22:35.867446 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:22:35.867416    2565 generic.go:356] "Generic (PLEG): container finished" podID="96d2ff75-d472-4381-b506-9732d122a030" containerID="f342dde8b65ac4d84c7d02dd3ed3d5e18dd7034aba7cc92c053a34f1810b2dca" exitCode=0
Jul 14 19:22:35.867615 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:22:35.867504    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595q484" event={"ID":"96d2ff75-d472-4381-b506-9732d122a030","Type":"ContainerDied","Data":"f342dde8b65ac4d84c7d02dd3ed3d5e18dd7034aba7cc92c053a34f1810b2dca"}
Jul 14 19:22:36.025288 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:22:36.025248    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jg8rq"
Jul 14 19:22:36.147545 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:22:36.147432    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/11705ca2-7d60-4441-92d1-90987e0f1a4e-util\") pod \"11705ca2-7d60-4441-92d1-90987e0f1a4e\" (UID: \"11705ca2-7d60-4441-92d1-90987e0f1a4e\") "
Jul 14 19:22:36.147545 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:22:36.147531    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/11705ca2-7d60-4441-92d1-90987e0f1a4e-bundle\") pod \"11705ca2-7d60-4441-92d1-90987e0f1a4e\" (UID: \"11705ca2-7d60-4441-92d1-90987e0f1a4e\") "
Jul 14 19:22:36.147796 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:22:36.147564    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-77nwx\" (UniqueName: \"kubernetes.io/projected/11705ca2-7d60-4441-92d1-90987e0f1a4e-kube-api-access-77nwx\") pod \"11705ca2-7d60-4441-92d1-90987e0f1a4e\" (UID: \"11705ca2-7d60-4441-92d1-90987e0f1a4e\") "
Jul 14 19:22:36.148105 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:22:36.148077    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/11705ca2-7d60-4441-92d1-90987e0f1a4e-bundle" (OuterVolumeSpecName: "bundle") pod "11705ca2-7d60-4441-92d1-90987e0f1a4e" (UID: "11705ca2-7d60-4441-92d1-90987e0f1a4e"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 19:22:36.150089 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:22:36.150054    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/11705ca2-7d60-4441-92d1-90987e0f1a4e-kube-api-access-77nwx" (OuterVolumeSpecName: "kube-api-access-77nwx") pod "11705ca2-7d60-4441-92d1-90987e0f1a4e" (UID: "11705ca2-7d60-4441-92d1-90987e0f1a4e"). InnerVolumeSpecName "kube-api-access-77nwx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 19:22:36.152361 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:22:36.152331    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/11705ca2-7d60-4441-92d1-90987e0f1a4e-util" (OuterVolumeSpecName: "util") pod "11705ca2-7d60-4441-92d1-90987e0f1a4e" (UID: "11705ca2-7d60-4441-92d1-90987e0f1a4e"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 19:22:36.249248 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:22:36.249200    2565 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/11705ca2-7d60-4441-92d1-90987e0f1a4e-util\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Jul 14 19:22:36.249248 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:22:36.249235    2565 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/11705ca2-7d60-4441-92d1-90987e0f1a4e-bundle\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Jul 14 19:22:36.249248 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:22:36.249244    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-77nwx\" (UniqueName: \"kubernetes.io/projected/11705ca2-7d60-4441-92d1-90987e0f1a4e-kube-api-access-77nwx\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Jul 14 19:22:36.875845 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:22:36.875806    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jg8rq"
Jul 14 19:22:36.875845 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:22:36.875824    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jg8rq" event={"ID":"11705ca2-7d60-4441-92d1-90987e0f1a4e","Type":"ContainerDied","Data":"4e96388bc6e685e8aa2956708a557243b78b70ca1b1fc36ce0597bcf38cd693c"}
Jul 14 19:22:36.876377 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:22:36.875875    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4e96388bc6e685e8aa2956708a557243b78b70ca1b1fc36ce0597bcf38cd693c"
Jul 14 19:22:37.057495 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:22:37.057463    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0bcx7z"
Jul 14 19:22:37.060989 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:22:37.060953    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595q484"
Jul 14 19:22:37.159551 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:22:37.159439    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/96d2ff75-d472-4381-b506-9732d122a030-bundle\") pod \"96d2ff75-d472-4381-b506-9732d122a030\" (UID: \"96d2ff75-d472-4381-b506-9732d122a030\") "
Jul 14 19:22:37.159551 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:22:37.159498    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/96d2ff75-d472-4381-b506-9732d122a030-util\") pod \"96d2ff75-d472-4381-b506-9732d122a030\" (UID: \"96d2ff75-d472-4381-b506-9732d122a030\") "
Jul 14 19:22:37.159551 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:22:37.159525    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f4738274-1650-4b36-8c34-8bc1c71050ac-util\") pod \"f4738274-1650-4b36-8c34-8bc1c71050ac\" (UID: \"f4738274-1650-4b36-8c34-8bc1c71050ac\") "
Jul 14 19:22:37.159551 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:22:37.159547    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k59t2\" (UniqueName: \"kubernetes.io/projected/96d2ff75-d472-4381-b506-9732d122a030-kube-api-access-k59t2\") pod \"96d2ff75-d472-4381-b506-9732d122a030\" (UID: \"96d2ff75-d472-4381-b506-9732d122a030\") "
Jul 14 19:22:37.159997 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:22:37.159572    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f4738274-1650-4b36-8c34-8bc1c71050ac-bundle\") pod \"f4738274-1650-4b36-8c34-8bc1c71050ac\" (UID: \"f4738274-1650-4b36-8c34-8bc1c71050ac\") "
Jul 14 19:22:37.159997 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:22:37.159614    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gf568\" (UniqueName: \"kubernetes.io/projected/f4738274-1650-4b36-8c34-8bc1c71050ac-kube-api-access-gf568\") pod \"f4738274-1650-4b36-8c34-8bc1c71050ac\" (UID: \"f4738274-1650-4b36-8c34-8bc1c71050ac\") "
Jul 14 19:22:37.160216 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:22:37.160183    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/96d2ff75-d472-4381-b506-9732d122a030-bundle" (OuterVolumeSpecName: "bundle") pod "96d2ff75-d472-4381-b506-9732d122a030" (UID: "96d2ff75-d472-4381-b506-9732d122a030"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 19:22:37.160293 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:22:37.160266    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f4738274-1650-4b36-8c34-8bc1c71050ac-bundle" (OuterVolumeSpecName: "bundle") pod "f4738274-1650-4b36-8c34-8bc1c71050ac" (UID: "f4738274-1650-4b36-8c34-8bc1c71050ac"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 19:22:37.162926 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:22:37.162886    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/96d2ff75-d472-4381-b506-9732d122a030-kube-api-access-k59t2" (OuterVolumeSpecName: "kube-api-access-k59t2") pod "96d2ff75-d472-4381-b506-9732d122a030" (UID: "96d2ff75-d472-4381-b506-9732d122a030"). InnerVolumeSpecName "kube-api-access-k59t2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 19:22:37.162926 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:22:37.162913    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f4738274-1650-4b36-8c34-8bc1c71050ac-kube-api-access-gf568" (OuterVolumeSpecName: "kube-api-access-gf568") pod "f4738274-1650-4b36-8c34-8bc1c71050ac" (UID: "f4738274-1650-4b36-8c34-8bc1c71050ac"). InnerVolumeSpecName "kube-api-access-gf568". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 19:22:37.167237 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:22:37.167185    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/96d2ff75-d472-4381-b506-9732d122a030-util" (OuterVolumeSpecName: "util") pod "96d2ff75-d472-4381-b506-9732d122a030" (UID: "96d2ff75-d472-4381-b506-9732d122a030"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 19:22:37.168482 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:22:37.168449    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f4738274-1650-4b36-8c34-8bc1c71050ac-util" (OuterVolumeSpecName: "util") pod "f4738274-1650-4b36-8c34-8bc1c71050ac" (UID: "f4738274-1650-4b36-8c34-8bc1c71050ac"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 19:22:37.260706 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:22:37.260663    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gf568\" (UniqueName: \"kubernetes.io/projected/f4738274-1650-4b36-8c34-8bc1c71050ac-kube-api-access-gf568\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Jul 14 19:22:37.260706 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:22:37.260700    2565 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/96d2ff75-d472-4381-b506-9732d122a030-bundle\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Jul 14 19:22:37.260706 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:22:37.260710    2565 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/96d2ff75-d472-4381-b506-9732d122a030-util\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Jul 14 19:22:37.260706 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:22:37.260717    2565 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f4738274-1650-4b36-8c34-8bc1c71050ac-util\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Jul 14 19:22:37.260970 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:22:37.260726    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k59t2\" (UniqueName: \"kubernetes.io/projected/96d2ff75-d472-4381-b506-9732d122a030-kube-api-access-k59t2\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Jul 14 19:22:37.260970 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:22:37.260737    2565 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f4738274-1650-4b36-8c34-8bc1c71050ac-bundle\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Jul 14 19:22:37.884356 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:22:37.884325    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0bcx7z"
Jul 14 19:22:37.884356 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:22:37.884346    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0bcx7z" event={"ID":"f4738274-1650-4b36-8c34-8bc1c71050ac","Type":"ContainerDied","Data":"e30655874c15568f8668ed76b6b84d1f0dca7a0bd2c397bd4dec539dd2d7b9dd"}
Jul 14 19:22:37.884860 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:22:37.884400    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e30655874c15568f8668ed76b6b84d1f0dca7a0bd2c397bd4dec539dd2d7b9dd"
Jul 14 19:22:37.886595 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:22:37.886566    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595q484" event={"ID":"96d2ff75-d472-4381-b506-9732d122a030","Type":"ContainerDied","Data":"4ea4306abfb594503a79c0974b475c6fee17aa7bffe7448ef2472deb434369bc"}
Jul 14 19:22:37.886595 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:22:37.886582    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595q484"
Jul 14 19:22:37.886757 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:22:37.886612    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4ea4306abfb594503a79c0974b475c6fee17aa7bffe7448ef2472deb434369bc"
Jul 14 19:22:53.157965 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:22:53.157855    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5cbb994989-bsmd9" podUID="b6f8731f-a5ed-489b-a730-390695475ace" containerName="console" containerID="cri-o://e5056a3ce6e8fcf0188dc3e3ebdc37fff22d8485ffa46f65f86d2b7e03ecb964" gracePeriod=15
Jul 14 19:22:53.167363 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:22:53.167330    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-5shhk"]
Jul 14 19:22:53.167886 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:22:53.167867    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="11705ca2-7d60-4441-92d1-90987e0f1a4e" containerName="pull"
Jul 14 19:22:53.167953 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:22:53.167890    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="11705ca2-7d60-4441-92d1-90987e0f1a4e" containerName="pull"
Jul 14 19:22:53.167953 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:22:53.167901    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="96d2ff75-d472-4381-b506-9732d122a030" containerName="pull"
Jul 14 19:22:53.167953 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:22:53.167906    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="96d2ff75-d472-4381-b506-9732d122a030" containerName="pull"
Jul 14 19:22:53.167953 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:22:53.167916    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fd9e1d7d-4294-42c8-82e1-351b6373a8d6" containerName="extract"
Jul 14 19:22:53.167953 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:22:53.167922    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="fd9e1d7d-4294-42c8-82e1-351b6373a8d6" containerName="extract"
Jul 14 19:22:53.167953 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:22:53.167928    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="11705ca2-7d60-4441-92d1-90987e0f1a4e" containerName="util"
Jul 14 19:22:53.167953 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:22:53.167933    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="11705ca2-7d60-4441-92d1-90987e0f1a4e" containerName="util"
Jul 14 19:22:53.167953 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:22:53.167939    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f4738274-1650-4b36-8c34-8bc1c71050ac" containerName="util"
Jul 14 19:22:53.167953 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:22:53.167944    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="f4738274-1650-4b36-8c34-8bc1c71050ac" containerName="util"
Jul 14 19:22:53.167953 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:22:53.167958    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f4738274-1650-4b36-8c34-8bc1c71050ac" containerName="extract"
Jul 14 19:22:53.168266 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:22:53.167963    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="f4738274-1650-4b36-8c34-8bc1c71050ac" containerName="extract"
Jul 14 19:22:53.168266 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:22:53.167972    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fd9e1d7d-4294-42c8-82e1-351b6373a8d6" containerName="util"
Jul 14 19:22:53.168266 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:22:53.167977    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="fd9e1d7d-4294-42c8-82e1-351b6373a8d6" containerName="util"
Jul 14 19:22:53.168266 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:22:53.167986    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fd9e1d7d-4294-42c8-82e1-351b6373a8d6" containerName="pull"
Jul 14 19:22:53.168266 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:22:53.167991    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="fd9e1d7d-4294-42c8-82e1-351b6373a8d6" containerName="pull"
Jul 14 19:22:53.168266 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:22:53.168000    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="96d2ff75-d472-4381-b506-9732d122a030" containerName="util"
Jul 14 19:22:53.168266 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:22:53.168004    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="96d2ff75-d472-4381-b506-9732d122a030" containerName="util"
Jul 14 19:22:53.168266 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:22:53.168010    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="11705ca2-7d60-4441-92d1-90987e0f1a4e" containerName="extract"
Jul 14 19:22:53.168266 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:22:53.168015    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="11705ca2-7d60-4441-92d1-90987e0f1a4e" containerName="extract"
Jul 14 19:22:53.168266 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:22:53.168022    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f4738274-1650-4b36-8c34-8bc1c71050ac" containerName="pull"
Jul 14 19:22:53.168266 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:22:53.168027    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="f4738274-1650-4b36-8c34-8bc1c71050ac" containerName="pull"
Jul 14 19:22:53.168266 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:22:53.168039    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="96d2ff75-d472-4381-b506-9732d122a030" containerName="extract"
Jul 14 19:22:53.168266 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:22:53.168043    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="96d2ff75-d472-4381-b506-9732d122a030" containerName="extract"
Jul 14 19:22:53.168266 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:22:53.168108    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="11705ca2-7d60-4441-92d1-90987e0f1a4e" containerName="extract"
Jul 14 19:22:53.168266 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:22:53.168117    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="96d2ff75-d472-4381-b506-9732d122a030" containerName="extract"
Jul 14 19:22:53.168266 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:22:53.168123    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="fd9e1d7d-4294-42c8-82e1-351b6373a8d6" containerName="extract"
Jul 14 19:22:53.168266 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:22:53.168129    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="f4738274-1650-4b36-8c34-8bc1c71050ac" containerName="extract"
Jul 14 19:22:53.170471 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:22:53.170447    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-5shhk"
Jul 14 19:22:53.173025 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:22:53.173002    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 14 19:22:53.173116 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:22:53.173034    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 14 19:22:53.173116 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:22:53.173002    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-g67pb\""
Jul 14 19:22:53.181121 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:22:53.181085    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-5shhk"]
Jul 14 19:22:53.315524 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:22:53.315469    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t7qgm\" (UniqueName: \"kubernetes.io/projected/8101abc0-2e64-4ffe-80a4-7fcdbad99b44-kube-api-access-t7qgm\") pod \"authorino-operator-75cc8d5cb7-5shhk\" (UID: \"8101abc0-2e64-4ffe-80a4-7fcdbad99b44\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-5shhk"
Jul 14 19:22:53.416222 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:22:53.416186    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t7qgm\" (UniqueName: \"kubernetes.io/projected/8101abc0-2e64-4ffe-80a4-7fcdbad99b44-kube-api-access-t7qgm\") pod \"authorino-operator-75cc8d5cb7-5shhk\" (UID: \"8101abc0-2e64-4ffe-80a4-7fcdbad99b44\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-5shhk"
Jul 14 19:22:53.426879 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:22:53.426843    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t7qgm\" (UniqueName: \"kubernetes.io/projected/8101abc0-2e64-4ffe-80a4-7fcdbad99b44-kube-api-access-t7qgm\") pod \"authorino-operator-75cc8d5cb7-5shhk\" (UID: \"8101abc0-2e64-4ffe-80a4-7fcdbad99b44\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-5shhk"
Jul 14 19:22:53.439471 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:22:53.439433    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5cbb994989-bsmd9"
Jul 14 19:22:53.540327 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:22:53.540270    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-5shhk"
Jul 14 19:22:53.617866 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:22:53.617822    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b6f8731f-a5ed-489b-a730-390695475ace-oauth-serving-cert\") pod \"b6f8731f-a5ed-489b-a730-390695475ace\" (UID: \"b6f8731f-a5ed-489b-a730-390695475ace\") "
Jul 14 19:22:53.618044 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:22:53.617903    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b6f8731f-a5ed-489b-a730-390695475ace-console-oauth-config\") pod \"b6f8731f-a5ed-489b-a730-390695475ace\" (UID: \"b6f8731f-a5ed-489b-a730-390695475ace\") "
Jul 14 19:22:53.618044 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:22:53.617931    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b6f8731f-a5ed-489b-a730-390695475ace-service-ca\") pod \"b6f8731f-a5ed-489b-a730-390695475ace\" (UID: \"b6f8731f-a5ed-489b-a730-390695475ace\") "
Jul 14 19:22:53.618044 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:22:53.617980    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b6f8731f-a5ed-489b-a730-390695475ace-console-config\") pod \"b6f8731f-a5ed-489b-a730-390695475ace\" (UID: \"b6f8731f-a5ed-489b-a730-390695475ace\") "
Jul 14 19:22:53.618044 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:22:53.618039    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sfpkv\" (UniqueName: \"kubernetes.io/projected/b6f8731f-a5ed-489b-a730-390695475ace-kube-api-access-sfpkv\") pod \"b6f8731f-a5ed-489b-a730-390695475ace\" (UID: \"b6f8731f-a5ed-489b-a730-390695475ace\") "
Jul 14 19:22:53.618481 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:22:53.618070    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b6f8731f-a5ed-489b-a730-390695475ace-trusted-ca-bundle\") pod \"b6f8731f-a5ed-489b-a730-390695475ace\" (UID: \"b6f8731f-a5ed-489b-a730-390695475ace\") "
Jul 14 19:22:53.618481 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:22:53.618122    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b6f8731f-a5ed-489b-a730-390695475ace-console-serving-cert\") pod \"b6f8731f-a5ed-489b-a730-390695475ace\" (UID: \"b6f8731f-a5ed-489b-a730-390695475ace\") "
Jul 14 19:22:53.618481 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:22:53.618426    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b6f8731f-a5ed-489b-a730-390695475ace-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "b6f8731f-a5ed-489b-a730-390695475ace" (UID: "b6f8731f-a5ed-489b-a730-390695475ace"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 19:22:53.618650 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:22:53.618622    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b6f8731f-a5ed-489b-a730-390695475ace-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "b6f8731f-a5ed-489b-a730-390695475ace" (UID: "b6f8731f-a5ed-489b-a730-390695475ace"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 19:22:53.618894 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:22:53.618866    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b6f8731f-a5ed-489b-a730-390695475ace-console-config" (OuterVolumeSpecName: "console-config") pod "b6f8731f-a5ed-489b-a730-390695475ace" (UID: "b6f8731f-a5ed-489b-a730-390695475ace"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 19:22:53.619094 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:22:53.619044    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b6f8731f-a5ed-489b-a730-390695475ace-service-ca" (OuterVolumeSpecName: "service-ca") pod "b6f8731f-a5ed-489b-a730-390695475ace" (UID: "b6f8731f-a5ed-489b-a730-390695475ace"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 19:22:53.620704 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:22:53.620671    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b6f8731f-a5ed-489b-a730-390695475ace-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "b6f8731f-a5ed-489b-a730-390695475ace" (UID: "b6f8731f-a5ed-489b-a730-390695475ace"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 19:22:53.620704 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:22:53.620695    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b6f8731f-a5ed-489b-a730-390695475ace-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "b6f8731f-a5ed-489b-a730-390695475ace" (UID: "b6f8731f-a5ed-489b-a730-390695475ace"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 19:22:53.621453 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:22:53.621425    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b6f8731f-a5ed-489b-a730-390695475ace-kube-api-access-sfpkv" (OuterVolumeSpecName: "kube-api-access-sfpkv") pod "b6f8731f-a5ed-489b-a730-390695475ace" (UID: "b6f8731f-a5ed-489b-a730-390695475ace"). InnerVolumeSpecName "kube-api-access-sfpkv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 19:22:53.694527 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:22:53.694499    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-5shhk"]
Jul 14 19:22:53.696839 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:22:53.696811    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8101abc0_2e64_4ffe_80a4_7fcdbad99b44.slice/crio-92970cb283f7cc8a3ef552e7ee2ab2a5ea34e9e55d8ee5bee4035be0a93b31a9 WatchSource:0}: Error finding container 92970cb283f7cc8a3ef552e7ee2ab2a5ea34e9e55d8ee5bee4035be0a93b31a9: Status 404 returned error can't find the container with id 92970cb283f7cc8a3ef552e7ee2ab2a5ea34e9e55d8ee5bee4035be0a93b31a9
Jul 14 19:22:53.719593 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:22:53.719555    2565 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b6f8731f-a5ed-489b-a730-390695475ace-console-serving-cert\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Jul 14 19:22:53.719593 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:22:53.719588    2565 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b6f8731f-a5ed-489b-a730-390695475ace-oauth-serving-cert\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Jul 14 19:22:53.719593 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:22:53.719604    2565 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b6f8731f-a5ed-489b-a730-390695475ace-console-oauth-config\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Jul 14 19:22:53.719847 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:22:53.719618    2565 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b6f8731f-a5ed-489b-a730-390695475ace-service-ca\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Jul 14 19:22:53.719847 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:22:53.719628    2565 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b6f8731f-a5ed-489b-a730-390695475ace-console-config\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Jul 14 19:22:53.719847 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:22:53.719636    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sfpkv\" (UniqueName: \"kubernetes.io/projected/b6f8731f-a5ed-489b-a730-390695475ace-kube-api-access-sfpkv\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Jul 14 19:22:53.719847 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:22:53.719648    2565 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b6f8731f-a5ed-489b-a730-390695475ace-trusted-ca-bundle\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Jul 14 19:22:53.991086 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:22:53.991040    2565 generic.go:356] "Generic (PLEG): container finished" podID="b6f8731f-a5ed-489b-a730-390695475ace" containerID="e5056a3ce6e8fcf0188dc3e3ebdc37fff22d8485ffa46f65f86d2b7e03ecb964" exitCode=0
Jul 14 19:22:53.991086 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:22:53.991086    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5cbb994989-bsmd9"
Jul 14 19:22:53.991359 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:22:53.991091    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5cbb994989-bsmd9" event={"ID":"b6f8731f-a5ed-489b-a730-390695475ace","Type":"ContainerDied","Data":"e5056a3ce6e8fcf0188dc3e3ebdc37fff22d8485ffa46f65f86d2b7e03ecb964"}
Jul 14 19:22:53.991359 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:22:53.991185    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5cbb994989-bsmd9" event={"ID":"b6f8731f-a5ed-489b-a730-390695475ace","Type":"ContainerDied","Data":"c4bb17529af6ac017fca19b110b7528d2da061deb208743ab86cfbded577615a"}
Jul 14 19:22:53.991359 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:22:53.991216    2565 scope.go:117] "RemoveContainer" containerID="e5056a3ce6e8fcf0188dc3e3ebdc37fff22d8485ffa46f65f86d2b7e03ecb964"
Jul 14 19:22:53.992776 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:22:53.992741    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-5shhk" event={"ID":"8101abc0-2e64-4ffe-80a4-7fcdbad99b44","Type":"ContainerStarted","Data":"92970cb283f7cc8a3ef552e7ee2ab2a5ea34e9e55d8ee5bee4035be0a93b31a9"}
Jul 14 19:22:54.003317 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:22:54.003296    2565 scope.go:117] "RemoveContainer" containerID="e5056a3ce6e8fcf0188dc3e3ebdc37fff22d8485ffa46f65f86d2b7e03ecb964"
Jul 14 19:22:54.003586 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:22:54.003566    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e5056a3ce6e8fcf0188dc3e3ebdc37fff22d8485ffa46f65f86d2b7e03ecb964\": container with ID starting with e5056a3ce6e8fcf0188dc3e3ebdc37fff22d8485ffa46f65f86d2b7e03ecb964 not found: ID does not exist" containerID="e5056a3ce6e8fcf0188dc3e3ebdc37fff22d8485ffa46f65f86d2b7e03ecb964"
Jul 14 19:22:54.003869 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:22:54.003597    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e5056a3ce6e8fcf0188dc3e3ebdc37fff22d8485ffa46f65f86d2b7e03ecb964"} err="failed to get container status \"e5056a3ce6e8fcf0188dc3e3ebdc37fff22d8485ffa46f65f86d2b7e03ecb964\": rpc error: code = NotFound desc = could not find container \"e5056a3ce6e8fcf0188dc3e3ebdc37fff22d8485ffa46f65f86d2b7e03ecb964\": container with ID starting with e5056a3ce6e8fcf0188dc3e3ebdc37fff22d8485ffa46f65f86d2b7e03ecb964 not found: ID does not exist"
Jul 14 19:22:54.020026 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:22:54.019985    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5cbb994989-bsmd9"]
Jul 14 19:22:54.026942 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:22:54.026893    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5cbb994989-bsmd9"]
Jul 14 19:22:55.970548 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:22:55.970496    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b6f8731f-a5ed-489b-a730-390695475ace" path="/var/lib/kubelet/pods/b6f8731f-a5ed-489b-a730-390695475ace/volumes"
Jul 14 19:22:57.018668 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:22:57.018615    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-5shhk" event={"ID":"8101abc0-2e64-4ffe-80a4-7fcdbad99b44","Type":"ContainerStarted","Data":"bcdb1dd338aa59b9eeb4d32a954a8a7f0c3c146b6e669b9401c57f5258ae5d60"}
Jul 14 19:22:57.019135 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:22:57.018826    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-5shhk"
Jul 14 19:22:57.037459 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:22:57.037393    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-5shhk" podStartSLOduration=1.521905622 podStartE2EDuration="4.037374287s" totalImagesPullingTime="2.515468665s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 19:22:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:22:57.035889011 +0000 UTC m=+723.596745924" watchObservedRunningTime="2026-07-14 19:22:57.037374287 +0000 UTC m=+723.598231178"
Jul 14 19:23:08.027466 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:23:08.027426    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-5shhk"
Jul 14 19:23:09.032530 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:23:09.032484    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-49p2l"]
Jul 14 19:23:09.033559 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:23:09.033527    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b6f8731f-a5ed-489b-a730-390695475ace" containerName="console"
Jul 14 19:23:09.033559 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:23:09.033554    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="b6f8731f-a5ed-489b-a730-390695475ace" containerName="console"
Jul 14 19:23:09.033762 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:23:09.033631    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="b6f8731f-a5ed-489b-a730-390695475ace" containerName="console"
Jul 14 19:23:09.038409 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:23:09.038377    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-49p2l"
Jul 14 19:23:09.041527 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:23:09.041491    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-sncpl\""
Jul 14 19:23:09.048880 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:23:09.048845    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-49p2l"]
Jul 14 19:23:09.058718 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:23:09.058669    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0ce4c5ac-0682-40c5-8466-a289ed0ab16d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-49p2l\" (UID: \"0ce4c5ac-0682-40c5-8466-a289ed0ab16d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-49p2l"
Jul 14 19:23:09.058941 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:23:09.058766    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9f8hq\" (UniqueName: \"kubernetes.io/projected/0ce4c5ac-0682-40c5-8466-a289ed0ab16d-kube-api-access-9f8hq\") pod \"kuadrant-operator-controller-manager-8684c9ff49-49p2l\" (UID: \"0ce4c5ac-0682-40c5-8466-a289ed0ab16d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-49p2l"
Jul 14 19:23:09.160309 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:23:09.160253    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0ce4c5ac-0682-40c5-8466-a289ed0ab16d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-49p2l\" (UID: \"0ce4c5ac-0682-40c5-8466-a289ed0ab16d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-49p2l"
Jul 14 19:23:09.160309 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:23:09.160319    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9f8hq\" (UniqueName: \"kubernetes.io/projected/0ce4c5ac-0682-40c5-8466-a289ed0ab16d-kube-api-access-9f8hq\") pod \"kuadrant-operator-controller-manager-8684c9ff49-49p2l\" (UID: \"0ce4c5ac-0682-40c5-8466-a289ed0ab16d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-49p2l"
Jul 14 19:23:09.160678 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:23:09.160653    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0ce4c5ac-0682-40c5-8466-a289ed0ab16d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-49p2l\" (UID: \"0ce4c5ac-0682-40c5-8466-a289ed0ab16d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-49p2l"
Jul 14 19:23:09.172147 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:23:09.172106    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9f8hq\" (UniqueName: \"kubernetes.io/projected/0ce4c5ac-0682-40c5-8466-a289ed0ab16d-kube-api-access-9f8hq\") pod \"kuadrant-operator-controller-manager-8684c9ff49-49p2l\" (UID: \"0ce4c5ac-0682-40c5-8466-a289ed0ab16d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-49p2l"
Jul 14 19:23:09.353121 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:23:09.353013    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-49p2l"
Jul 14 19:23:09.518083 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:23:09.518053    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-49p2l"]
Jul 14 19:23:09.520589 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:23:09.520553    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ce4c5ac_0682_40c5_8466_a289ed0ab16d.slice/crio-5372d6de8e59208510afe9f3730aead8fdd81108212debc446efafefe66bf18e WatchSource:0}: Error finding container 5372d6de8e59208510afe9f3730aead8fdd81108212debc446efafefe66bf18e: Status 404 returned error can't find the container with id 5372d6de8e59208510afe9f3730aead8fdd81108212debc446efafefe66bf18e
Jul 14 19:23:10.099609 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:23:10.099572    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-49p2l" event={"ID":"0ce4c5ac-0682-40c5-8466-a289ed0ab16d","Type":"ContainerStarted","Data":"5372d6de8e59208510afe9f3730aead8fdd81108212debc446efafefe66bf18e"}
Jul 14 19:23:16.141111 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:23:16.140995    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-49p2l" event={"ID":"0ce4c5ac-0682-40c5-8466-a289ed0ab16d","Type":"ContainerStarted","Data":"24e384a59534afd8fa7d827e69e8b935f4f03cd35b1052b9d0199fdfe0f52eb5"}
Jul 14 19:23:16.141111 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:23:16.141073    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-49p2l"
Jul 14 19:23:16.166342 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:23:16.166283    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-49p2l" podStartSLOduration=0.888145534 podStartE2EDuration="7.166263903s" totalImagesPullingTime="6.278118369s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 19:23:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:23:16.164089501 +0000 UTC m=+742.724946423" watchObservedRunningTime="2026-07-14 19:23:16.166263903 +0000 UTC m=+742.727120855"
Jul 14 19:23:27.150869 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:23:27.150837    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-49p2l"
Jul 14 19:23:34.450051 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:23:34.450014    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-49p2l"]
Jul 14 19:23:34.450570 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:23:34.450245    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-49p2l" podUID="0ce4c5ac-0682-40c5-8466-a289ed0ab16d" containerName="manager" containerID="cri-o://24e384a59534afd8fa7d827e69e8b935f4f03cd35b1052b9d0199fdfe0f52eb5" gracePeriod=10
Jul 14 19:23:34.706282 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:23:34.706225    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-49p2l"
Jul 14 19:23:34.817473 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:23:34.817447    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0ce4c5ac-0682-40c5-8466-a289ed0ab16d-extensions-socket-volume\") pod \"0ce4c5ac-0682-40c5-8466-a289ed0ab16d\" (UID: \"0ce4c5ac-0682-40c5-8466-a289ed0ab16d\") "
Jul 14 19:23:34.817609 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:23:34.817492    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9f8hq\" (UniqueName: \"kubernetes.io/projected/0ce4c5ac-0682-40c5-8466-a289ed0ab16d-kube-api-access-9f8hq\") pod \"0ce4c5ac-0682-40c5-8466-a289ed0ab16d\" (UID: \"0ce4c5ac-0682-40c5-8466-a289ed0ab16d\") "
Jul 14 19:23:34.817909 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:23:34.817876    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0ce4c5ac-0682-40c5-8466-a289ed0ab16d-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "0ce4c5ac-0682-40c5-8466-a289ed0ab16d" (UID: "0ce4c5ac-0682-40c5-8466-a289ed0ab16d"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 19:23:34.819742 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:23:34.819719    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0ce4c5ac-0682-40c5-8466-a289ed0ab16d-kube-api-access-9f8hq" (OuterVolumeSpecName: "kube-api-access-9f8hq") pod "0ce4c5ac-0682-40c5-8466-a289ed0ab16d" (UID: "0ce4c5ac-0682-40c5-8466-a289ed0ab16d"). InnerVolumeSpecName "kube-api-access-9f8hq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 19:23:34.918684 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:23:34.918656    2565 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0ce4c5ac-0682-40c5-8466-a289ed0ab16d-extensions-socket-volume\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Jul 14 19:23:34.918684 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:23:34.918682    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9f8hq\" (UniqueName: \"kubernetes.io/projected/0ce4c5ac-0682-40c5-8466-a289ed0ab16d-kube-api-access-9f8hq\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Jul 14 19:23:35.257229 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:23:35.257192    2565 generic.go:356] "Generic (PLEG): container finished" podID="0ce4c5ac-0682-40c5-8466-a289ed0ab16d" containerID="24e384a59534afd8fa7d827e69e8b935f4f03cd35b1052b9d0199fdfe0f52eb5" exitCode=0
Jul 14 19:23:35.257436 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:23:35.257236    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-49p2l"
Jul 14 19:23:35.257436 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:23:35.257280    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-49p2l" event={"ID":"0ce4c5ac-0682-40c5-8466-a289ed0ab16d","Type":"ContainerDied","Data":"24e384a59534afd8fa7d827e69e8b935f4f03cd35b1052b9d0199fdfe0f52eb5"}
Jul 14 19:23:35.257436 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:23:35.257339    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-49p2l" event={"ID":"0ce4c5ac-0682-40c5-8466-a289ed0ab16d","Type":"ContainerDied","Data":"5372d6de8e59208510afe9f3730aead8fdd81108212debc446efafefe66bf18e"}
Jul 14 19:23:35.257436 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:23:35.257368    2565 scope.go:117] "RemoveContainer" containerID="24e384a59534afd8fa7d827e69e8b935f4f03cd35b1052b9d0199fdfe0f52eb5"
Jul 14 19:23:35.266970 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:23:35.266956    2565 scope.go:117] "RemoveContainer" containerID="24e384a59534afd8fa7d827e69e8b935f4f03cd35b1052b9d0199fdfe0f52eb5"
Jul 14 19:23:35.267212 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:23:35.267197    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"24e384a59534afd8fa7d827e69e8b935f4f03cd35b1052b9d0199fdfe0f52eb5\": container with ID starting with 24e384a59534afd8fa7d827e69e8b935f4f03cd35b1052b9d0199fdfe0f52eb5 not found: ID does not exist" containerID="24e384a59534afd8fa7d827e69e8b935f4f03cd35b1052b9d0199fdfe0f52eb5"
Jul 14 19:23:35.267267 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:23:35.267221    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"24e384a59534afd8fa7d827e69e8b935f4f03cd35b1052b9d0199fdfe0f52eb5"} err="failed to get container status \"24e384a59534afd8fa7d827e69e8b935f4f03cd35b1052b9d0199fdfe0f52eb5\": rpc error: code = NotFound desc = could not find container \"24e384a59534afd8fa7d827e69e8b935f4f03cd35b1052b9d0199fdfe0f52eb5\": container with ID starting with 24e384a59534afd8fa7d827e69e8b935f4f03cd35b1052b9d0199fdfe0f52eb5 not found: ID does not exist"
Jul 14 19:23:35.287965 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:23:35.287934    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-49p2l"]
Jul 14 19:23:35.311030 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:23:35.310999    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-49p2l"]
Jul 14 19:23:35.967846 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:23:35.967813    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0ce4c5ac-0682-40c5-8466-a289ed0ab16d" path="/var/lib/kubelet/pods/0ce4c5ac-0682-40c5-8466-a289ed0ab16d/volumes"
Jul 14 19:24:17.733487 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:24:17.733407    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-qvqkd"]
Jul 14 19:24:17.733946 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:24:17.733785    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0ce4c5ac-0682-40c5-8466-a289ed0ab16d" containerName="manager"
Jul 14 19:24:17.733946 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:24:17.733795    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ce4c5ac-0682-40c5-8466-a289ed0ab16d" containerName="manager"
Jul 14 19:24:17.733946 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:24:17.733868    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="0ce4c5ac-0682-40c5-8466-a289ed0ab16d" containerName="manager"
Jul 14 19:24:17.736585 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:24:17.736568    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-qvqkd"
Jul 14 19:24:17.739131 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:24:17.739105    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 14 19:24:17.739284 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:24:17.739183    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-jwxt4\""
Jul 14 19:24:17.744573 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:24:17.744545    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-qvqkd"]
Jul 14 19:24:17.813022 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:24:17.812982    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/ac0dbd55-fc64-42ff-8ccb-4402d2984198-config-file\") pod \"limitador-limitador-64c94fd64f-qvqkd\" (UID: \"ac0dbd55-fc64-42ff-8ccb-4402d2984198\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-qvqkd"
Jul 14 19:24:17.813228 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:24:17.813031    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qpt8h\" (UniqueName: \"kubernetes.io/projected/ac0dbd55-fc64-42ff-8ccb-4402d2984198-kube-api-access-qpt8h\") pod \"limitador-limitador-64c94fd64f-qvqkd\" (UID: \"ac0dbd55-fc64-42ff-8ccb-4402d2984198\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-qvqkd"
Jul 14 19:24:17.838549 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:24:17.838520    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-qvqkd"]
Jul 14 19:24:17.913882 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:24:17.913849    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/ac0dbd55-fc64-42ff-8ccb-4402d2984198-config-file\") pod \"limitador-limitador-64c94fd64f-qvqkd\" (UID: \"ac0dbd55-fc64-42ff-8ccb-4402d2984198\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-qvqkd"
Jul 14 19:24:17.914071 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:24:17.913895    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qpt8h\" (UniqueName: \"kubernetes.io/projected/ac0dbd55-fc64-42ff-8ccb-4402d2984198-kube-api-access-qpt8h\") pod \"limitador-limitador-64c94fd64f-qvqkd\" (UID: \"ac0dbd55-fc64-42ff-8ccb-4402d2984198\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-qvqkd"
Jul 14 19:24:17.914604 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:24:17.914578    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/ac0dbd55-fc64-42ff-8ccb-4402d2984198-config-file\") pod \"limitador-limitador-64c94fd64f-qvqkd\" (UID: \"ac0dbd55-fc64-42ff-8ccb-4402d2984198\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-qvqkd"
Jul 14 19:24:17.923754 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:24:17.923726    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qpt8h\" (UniqueName: \"kubernetes.io/projected/ac0dbd55-fc64-42ff-8ccb-4402d2984198-kube-api-access-qpt8h\") pod \"limitador-limitador-64c94fd64f-qvqkd\" (UID: \"ac0dbd55-fc64-42ff-8ccb-4402d2984198\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-qvqkd"
Jul 14 19:24:18.048727 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:24:18.048637    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-qvqkd"
Jul 14 19:24:18.188175 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:24:18.188134    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-qvqkd"]
Jul 14 19:24:18.190061 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:24:18.190031    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac0dbd55_fc64_42ff_8ccb_4402d2984198.slice/crio-f9f7ee9221e1665d2b23a1f00f1de8f3345b7b1389b1915139f98195bc89f58a WatchSource:0}: Error finding container f9f7ee9221e1665d2b23a1f00f1de8f3345b7b1389b1915139f98195bc89f58a: Status 404 returned error can't find the container with id f9f7ee9221e1665d2b23a1f00f1de8f3345b7b1389b1915139f98195bc89f58a
Jul 14 19:24:18.501770 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:24:18.501735    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-qvqkd" event={"ID":"ac0dbd55-fc64-42ff-8ccb-4402d2984198","Type":"ContainerStarted","Data":"f9f7ee9221e1665d2b23a1f00f1de8f3345b7b1389b1915139f98195bc89f58a"}
Jul 14 19:24:21.521836 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:24:21.521793    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-qvqkd" event={"ID":"ac0dbd55-fc64-42ff-8ccb-4402d2984198","Type":"ContainerStarted","Data":"996a750e5ffeca4f859aaccc8265140477e40d881e29a4e28b3cc1edb005e5da"}
Jul 14 19:24:21.522220 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:24:21.521954    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-qvqkd"
Jul 14 19:24:21.541666 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:24:21.541618    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-qvqkd" podStartSLOduration=1.8435655629999999 podStartE2EDuration="4.541603737s" totalImagesPullingTime="2.698038174s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 19:24:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:24:21.539224008 +0000 UTC m=+808.100080927" watchObservedRunningTime="2026-07-14 19:24:21.541603737 +0000 UTC m=+808.102460629"
Jul 14 19:24:32.528902 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:24:32.528857    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-qvqkd"
Jul 14 19:24:35.027112 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:24:35.027076    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-qvqkd"]
Jul 14 19:24:35.027579 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:24:35.027326    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-qvqkd" podUID="ac0dbd55-fc64-42ff-8ccb-4402d2984198" containerName="limitador" containerID="cri-o://996a750e5ffeca4f859aaccc8265140477e40d881e29a4e28b3cc1edb005e5da" gracePeriod=30
Jul 14 19:24:35.583903 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:24:35.583876    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-qvqkd"
Jul 14 19:24:35.599930 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:24:35.599822    2565 generic.go:356] "Generic (PLEG): container finished" podID="ac0dbd55-fc64-42ff-8ccb-4402d2984198" containerID="996a750e5ffeca4f859aaccc8265140477e40d881e29a4e28b3cc1edb005e5da" exitCode=0
Jul 14 19:24:35.600753 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:24:35.599954    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-qvqkd" event={"ID":"ac0dbd55-fc64-42ff-8ccb-4402d2984198","Type":"ContainerDied","Data":"996a750e5ffeca4f859aaccc8265140477e40d881e29a4e28b3cc1edb005e5da"}
Jul 14 19:24:35.600753 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:24:35.600041    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-qvqkd" event={"ID":"ac0dbd55-fc64-42ff-8ccb-4402d2984198","Type":"ContainerDied","Data":"f9f7ee9221e1665d2b23a1f00f1de8f3345b7b1389b1915139f98195bc89f58a"}
Jul 14 19:24:35.600753 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:24:35.600086    2565 scope.go:117] "RemoveContainer" containerID="996a750e5ffeca4f859aaccc8265140477e40d881e29a4e28b3cc1edb005e5da"
Jul 14 19:24:35.600753 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:24:35.600264    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-qvqkd"
Jul 14 19:24:35.610199 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:24:35.610173    2565 scope.go:117] "RemoveContainer" containerID="996a750e5ffeca4f859aaccc8265140477e40d881e29a4e28b3cc1edb005e5da"
Jul 14 19:24:35.610477 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:24:35.610457    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"996a750e5ffeca4f859aaccc8265140477e40d881e29a4e28b3cc1edb005e5da\": container with ID starting with 996a750e5ffeca4f859aaccc8265140477e40d881e29a4e28b3cc1edb005e5da not found: ID does not exist" containerID="996a750e5ffeca4f859aaccc8265140477e40d881e29a4e28b3cc1edb005e5da"
Jul 14 19:24:35.610564 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:24:35.610486    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"996a750e5ffeca4f859aaccc8265140477e40d881e29a4e28b3cc1edb005e5da"} err="failed to get container status \"996a750e5ffeca4f859aaccc8265140477e40d881e29a4e28b3cc1edb005e5da\": rpc error: code = NotFound desc = could not find container \"996a750e5ffeca4f859aaccc8265140477e40d881e29a4e28b3cc1edb005e5da\": container with ID starting with 996a750e5ffeca4f859aaccc8265140477e40d881e29a4e28b3cc1edb005e5da not found: ID does not exist"
Jul 14 19:24:35.680052 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:24:35.680015    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/ac0dbd55-fc64-42ff-8ccb-4402d2984198-config-file\") pod \"ac0dbd55-fc64-42ff-8ccb-4402d2984198\" (UID: \"ac0dbd55-fc64-42ff-8ccb-4402d2984198\") "
Jul 14 19:24:35.680254 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:24:35.680148    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qpt8h\" (UniqueName: \"kubernetes.io/projected/ac0dbd55-fc64-42ff-8ccb-4402d2984198-kube-api-access-qpt8h\") pod \"ac0dbd55-fc64-42ff-8ccb-4402d2984198\" (UID: \"ac0dbd55-fc64-42ff-8ccb-4402d2984198\") "
Jul 14 19:24:35.680464 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:24:35.680446    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ac0dbd55-fc64-42ff-8ccb-4402d2984198-config-file" (OuterVolumeSpecName: "config-file") pod "ac0dbd55-fc64-42ff-8ccb-4402d2984198" (UID: "ac0dbd55-fc64-42ff-8ccb-4402d2984198"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 19:24:35.682302 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:24:35.682284    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ac0dbd55-fc64-42ff-8ccb-4402d2984198-kube-api-access-qpt8h" (OuterVolumeSpecName: "kube-api-access-qpt8h") pod "ac0dbd55-fc64-42ff-8ccb-4402d2984198" (UID: "ac0dbd55-fc64-42ff-8ccb-4402d2984198"). InnerVolumeSpecName "kube-api-access-qpt8h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 19:24:35.781110 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:24:35.781068    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qpt8h\" (UniqueName: \"kubernetes.io/projected/ac0dbd55-fc64-42ff-8ccb-4402d2984198-kube-api-access-qpt8h\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Jul 14 19:24:35.781110 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:24:35.781099    2565 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/ac0dbd55-fc64-42ff-8ccb-4402d2984198-config-file\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Jul 14 19:24:35.926850 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:24:35.926822    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-qvqkd"]
Jul 14 19:24:35.929030 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:24:35.929009    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-qvqkd"]
Jul 14 19:24:35.968633 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:24:35.968608    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ac0dbd55-fc64-42ff-8ccb-4402d2984198" path="/var/lib/kubelet/pods/ac0dbd55-fc64-42ff-8ccb-4402d2984198/volumes"
Jul 14 19:24:57.878340 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:24:57.878307    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7d9cdf95d9-kfs24"]
Jul 14 19:24:57.878734 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:24:57.878690    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ac0dbd55-fc64-42ff-8ccb-4402d2984198" containerName="limitador"
Jul 14 19:24:57.878734 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:24:57.878700    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="ac0dbd55-fc64-42ff-8ccb-4402d2984198" containerName="limitador"
Jul 14 19:24:57.878807 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:24:57.878773    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="ac0dbd55-fc64-42ff-8ccb-4402d2984198" containerName="limitador"
Jul 14 19:24:57.882974 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:24:57.882957    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7d9cdf95d9-kfs24"
Jul 14 19:24:57.885519 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:24:57.885490    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 14 19:24:57.885519 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:24:57.885508    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-7565g\""
Jul 14 19:24:57.885683 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:24:57.885615    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 14 19:24:57.888401 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:24:57.888322    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7kj85\" (UniqueName: \"kubernetes.io/projected/fe9887de-99c5-4b14-a133-58a2c59ed48d-kube-api-access-7kj85\") pod \"maas-controller-7d9cdf95d9-kfs24\" (UID: \"fe9887de-99c5-4b14-a133-58a2c59ed48d\") " pod="opendatahub/maas-controller-7d9cdf95d9-kfs24"
Jul 14 19:24:57.888571 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:24:57.888471    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fe9887de-99c5-4b14-a133-58a2c59ed48d-webhook-cert\") pod \"maas-controller-7d9cdf95d9-kfs24\" (UID: \"fe9887de-99c5-4b14-a133-58a2c59ed48d\") " pod="opendatahub/maas-controller-7d9cdf95d9-kfs24"
Jul 14 19:24:57.891031 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:24:57.891010    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7d9cdf95d9-kfs24"]
Jul 14 19:24:57.989462 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:24:57.989419    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7kj85\" (UniqueName: \"kubernetes.io/projected/fe9887de-99c5-4b14-a133-58a2c59ed48d-kube-api-access-7kj85\") pod \"maas-controller-7d9cdf95d9-kfs24\" (UID: \"fe9887de-99c5-4b14-a133-58a2c59ed48d\") " pod="opendatahub/maas-controller-7d9cdf95d9-kfs24"
Jul 14 19:24:57.989675 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:24:57.989505    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fe9887de-99c5-4b14-a133-58a2c59ed48d-webhook-cert\") pod \"maas-controller-7d9cdf95d9-kfs24\" (UID: \"fe9887de-99c5-4b14-a133-58a2c59ed48d\") " pod="opendatahub/maas-controller-7d9cdf95d9-kfs24"
Jul 14 19:24:57.989675 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:24:57.989597    2565 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found
Jul 14 19:24:57.989675 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:24:57.989665    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fe9887de-99c5-4b14-a133-58a2c59ed48d-webhook-cert podName:fe9887de-99c5-4b14-a133-58a2c59ed48d nodeName:}" failed. No retries permitted until 2026-07-14 19:24:58.489648686 +0000 UTC m=+845.050505556 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/fe9887de-99c5-4b14-a133-58a2c59ed48d-webhook-cert") pod "maas-controller-7d9cdf95d9-kfs24" (UID: "fe9887de-99c5-4b14-a133-58a2c59ed48d") : secret "maas-controller-webhook-cert" not found
Jul 14 19:24:57.998456 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:24:57.998435    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7kj85\" (UniqueName: \"kubernetes.io/projected/fe9887de-99c5-4b14-a133-58a2c59ed48d-kube-api-access-7kj85\") pod \"maas-controller-7d9cdf95d9-kfs24\" (UID: \"fe9887de-99c5-4b14-a133-58a2c59ed48d\") " pod="opendatahub/maas-controller-7d9cdf95d9-kfs24"
Jul 14 19:24:58.050841 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:24:58.050810    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5b78ddfc45-f5jwj"]
Jul 14 19:24:58.053188 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:24:58.053148    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5b78ddfc45-f5jwj"
Jul 14 19:24:58.064035 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:24:58.064009    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5b78ddfc45-f5jwj"]
Jul 14 19:24:58.090755 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:24:58.090721    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w27mv\" (UniqueName: \"kubernetes.io/projected/fe0c37df-384a-42b3-9865-0a576d052d33-kube-api-access-w27mv\") pod \"maas-controller-5b78ddfc45-f5jwj\" (UID: \"fe0c37df-384a-42b3-9865-0a576d052d33\") " pod="opendatahub/maas-controller-5b78ddfc45-f5jwj"
Jul 14 19:24:58.090920 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:24:58.090784    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fe0c37df-384a-42b3-9865-0a576d052d33-webhook-cert\") pod \"maas-controller-5b78ddfc45-f5jwj\" (UID: \"fe0c37df-384a-42b3-9865-0a576d052d33\") " pod="opendatahub/maas-controller-5b78ddfc45-f5jwj"
Jul 14 19:24:58.192170 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:24:58.192061    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w27mv\" (UniqueName: \"kubernetes.io/projected/fe0c37df-384a-42b3-9865-0a576d052d33-kube-api-access-w27mv\") pod \"maas-controller-5b78ddfc45-f5jwj\" (UID: \"fe0c37df-384a-42b3-9865-0a576d052d33\") " pod="opendatahub/maas-controller-5b78ddfc45-f5jwj"
Jul 14 19:24:58.192327 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:24:58.192168    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fe0c37df-384a-42b3-9865-0a576d052d33-webhook-cert\") pod \"maas-controller-5b78ddfc45-f5jwj\" (UID: \"fe0c37df-384a-42b3-9865-0a576d052d33\") " pod="opendatahub/maas-controller-5b78ddfc45-f5jwj"
Jul 14 19:24:58.194782 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:24:58.194756    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fe0c37df-384a-42b3-9865-0a576d052d33-webhook-cert\") pod \"maas-controller-5b78ddfc45-f5jwj\" (UID: \"fe0c37df-384a-42b3-9865-0a576d052d33\") " pod="opendatahub/maas-controller-5b78ddfc45-f5jwj"
Jul 14 19:24:58.200371 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:24:58.200350    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w27mv\" (UniqueName: \"kubernetes.io/projected/fe0c37df-384a-42b3-9865-0a576d052d33-kube-api-access-w27mv\") pod \"maas-controller-5b78ddfc45-f5jwj\" (UID: \"fe0c37df-384a-42b3-9865-0a576d052d33\") " pod="opendatahub/maas-controller-5b78ddfc45-f5jwj"
Jul 14 19:24:58.364903 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:24:58.364866    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5b78ddfc45-f5jwj"
Jul 14 19:24:58.495796 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:24:58.495766    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fe9887de-99c5-4b14-a133-58a2c59ed48d-webhook-cert\") pod \"maas-controller-7d9cdf95d9-kfs24\" (UID: \"fe9887de-99c5-4b14-a133-58a2c59ed48d\") " pod="opendatahub/maas-controller-7d9cdf95d9-kfs24"
Jul 14 19:24:58.498413 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:24:58.498379    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fe9887de-99c5-4b14-a133-58a2c59ed48d-webhook-cert\") pod \"maas-controller-7d9cdf95d9-kfs24\" (UID: \"fe9887de-99c5-4b14-a133-58a2c59ed48d\") " pod="opendatahub/maas-controller-7d9cdf95d9-kfs24"
Jul 14 19:24:58.501681 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:24:58.501661    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5b78ddfc45-f5jwj"]
Jul 14 19:24:58.502926 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:24:58.502906    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe0c37df_384a_42b3_9865_0a576d052d33.slice/crio-629c864b857e221c8d8c6523fd9b045b076e6a5ff152a1044437c67ab55dc4a0 WatchSource:0}: Error finding container 629c864b857e221c8d8c6523fd9b045b076e6a5ff152a1044437c67ab55dc4a0: Status 404 returned error can't find the container with id 629c864b857e221c8d8c6523fd9b045b076e6a5ff152a1044437c67ab55dc4a0
Jul 14 19:24:58.731841 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:24:58.731808    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5b78ddfc45-f5jwj" event={"ID":"fe0c37df-384a-42b3-9865-0a576d052d33","Type":"ContainerStarted","Data":"629c864b857e221c8d8c6523fd9b045b076e6a5ff152a1044437c67ab55dc4a0"}
Jul 14 19:24:58.795334 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:24:58.795293    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7d9cdf95d9-kfs24"
Jul 14 19:24:58.928275 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:24:58.928253    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7d9cdf95d9-kfs24"]
Jul 14 19:24:58.930204 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:24:58.930179    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe9887de_99c5_4b14_a133_58a2c59ed48d.slice/crio-2f38930814dba508914ac980b03bf49a6fe1f5ab4d85f4fe7b0dbf897824b691 WatchSource:0}: Error finding container 2f38930814dba508914ac980b03bf49a6fe1f5ab4d85f4fe7b0dbf897824b691: Status 404 returned error can't find the container with id 2f38930814dba508914ac980b03bf49a6fe1f5ab4d85f4fe7b0dbf897824b691
Jul 14 19:24:59.746983 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:24:59.746940    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7d9cdf95d9-kfs24" event={"ID":"fe9887de-99c5-4b14-a133-58a2c59ed48d","Type":"ContainerStarted","Data":"2f38930814dba508914ac980b03bf49a6fe1f5ab4d85f4fe7b0dbf897824b691"}
Jul 14 19:25:01.760586 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:25:01.760474    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7d9cdf95d9-kfs24" event={"ID":"fe9887de-99c5-4b14-a133-58a2c59ed48d","Type":"ContainerStarted","Data":"a563f68b5f3eb93d1cf5dbdb564ea0a4618bf89e4e12b268c6da4f239ac8ca87"}
Jul 14 19:25:01.760586 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:25:01.760570    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7d9cdf95d9-kfs24"
Jul 14 19:25:01.762143 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:25:01.762106    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5b78ddfc45-f5jwj" event={"ID":"fe0c37df-384a-42b3-9865-0a576d052d33","Type":"ContainerStarted","Data":"1dda511859c8c0395f6efe8a9dcff360f99dc982c9b6a68f69fde429a515cad4"}
Jul 14 19:25:01.762305 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:25:01.762282    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5b78ddfc45-f5jwj"
Jul 14 19:25:01.805223 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:25:01.805174    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7d9cdf95d9-kfs24" podStartSLOduration=2.896341744 podStartE2EDuration="4.805145253s" totalImagesPullingTime="1.908803509s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 19:24:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:25:01.803284972 +0000 UTC m=+848.364141887" watchObservedRunningTime="2026-07-14 19:25:01.805145253 +0000 UTC m=+848.366002144"
Jul 14 19:25:01.844212 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:25:01.844143    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-5b78ddfc45-f5jwj" podStartSLOduration=1.4966538759999999 podStartE2EDuration="3.844127793s" totalImagesPullingTime="2.347473917s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 19:24:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:25:01.842202553 +0000 UTC m=+848.403059447" watchObservedRunningTime="2026-07-14 19:25:01.844127793 +0000 UTC m=+848.404984684"
Jul 14 19:25:12.770061 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:25:12.770033    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7d9cdf95d9-kfs24"
Jul 14 19:25:12.770471 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:25:12.770101    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5b78ddfc45-f5jwj"
Jul 14 19:25:12.831115 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:25:12.831083    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7d9cdf95d9-kfs24"]
Jul 14 19:25:12.831319 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:25:12.831296    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-7d9cdf95d9-kfs24" podUID="fe9887de-99c5-4b14-a133-58a2c59ed48d" containerName="manager" containerID="cri-o://a563f68b5f3eb93d1cf5dbdb564ea0a4618bf89e4e12b268c6da4f239ac8ca87" gracePeriod=30
Jul 14 19:25:13.085780 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:25:13.085746    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7d9cdf95d9-kfs24"
Jul 14 19:25:13.132601 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:25:13.132567    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7kj85\" (UniqueName: \"kubernetes.io/projected/fe9887de-99c5-4b14-a133-58a2c59ed48d-kube-api-access-7kj85\") pod \"fe9887de-99c5-4b14-a133-58a2c59ed48d\" (UID: \"fe9887de-99c5-4b14-a133-58a2c59ed48d\") "
Jul 14 19:25:13.132765 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:25:13.132629    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fe9887de-99c5-4b14-a133-58a2c59ed48d-webhook-cert\") pod \"fe9887de-99c5-4b14-a133-58a2c59ed48d\" (UID: \"fe9887de-99c5-4b14-a133-58a2c59ed48d\") "
Jul 14 19:25:13.134950 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:25:13.134924    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fe9887de-99c5-4b14-a133-58a2c59ed48d-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "fe9887de-99c5-4b14-a133-58a2c59ed48d" (UID: "fe9887de-99c5-4b14-a133-58a2c59ed48d"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 19:25:13.134950 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:25:13.134938    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fe9887de-99c5-4b14-a133-58a2c59ed48d-kube-api-access-7kj85" (OuterVolumeSpecName: "kube-api-access-7kj85") pod "fe9887de-99c5-4b14-a133-58a2c59ed48d" (UID: "fe9887de-99c5-4b14-a133-58a2c59ed48d"). InnerVolumeSpecName "kube-api-access-7kj85". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 19:25:13.233814 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:25:13.233780    2565 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fe9887de-99c5-4b14-a133-58a2c59ed48d-webhook-cert\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Jul 14 19:25:13.233814 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:25:13.233810    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7kj85\" (UniqueName: \"kubernetes.io/projected/fe9887de-99c5-4b14-a133-58a2c59ed48d-kube-api-access-7kj85\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Jul 14 19:25:13.829691 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:25:13.829652    2565 generic.go:356] "Generic (PLEG): container finished" podID="fe9887de-99c5-4b14-a133-58a2c59ed48d" containerID="a563f68b5f3eb93d1cf5dbdb564ea0a4618bf89e4e12b268c6da4f239ac8ca87" exitCode=0
Jul 14 19:25:13.830203 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:25:13.829701    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7d9cdf95d9-kfs24"
Jul 14 19:25:13.830203 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:25:13.829745    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7d9cdf95d9-kfs24" event={"ID":"fe9887de-99c5-4b14-a133-58a2c59ed48d","Type":"ContainerDied","Data":"a563f68b5f3eb93d1cf5dbdb564ea0a4618bf89e4e12b268c6da4f239ac8ca87"}
Jul 14 19:25:13.830203 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:25:13.829816    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7d9cdf95d9-kfs24" event={"ID":"fe9887de-99c5-4b14-a133-58a2c59ed48d","Type":"ContainerDied","Data":"2f38930814dba508914ac980b03bf49a6fe1f5ab4d85f4fe7b0dbf897824b691"}
Jul 14 19:25:13.830203 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:25:13.829851    2565 scope.go:117] "RemoveContainer" containerID="a563f68b5f3eb93d1cf5dbdb564ea0a4618bf89e4e12b268c6da4f239ac8ca87"
Jul 14 19:25:13.840082 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:25:13.839958    2565 scope.go:117] "RemoveContainer" containerID="a563f68b5f3eb93d1cf5dbdb564ea0a4618bf89e4e12b268c6da4f239ac8ca87"
Jul 14 19:25:13.840330 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:25:13.840299    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a563f68b5f3eb93d1cf5dbdb564ea0a4618bf89e4e12b268c6da4f239ac8ca87\": container with ID starting with a563f68b5f3eb93d1cf5dbdb564ea0a4618bf89e4e12b268c6da4f239ac8ca87 not found: ID does not exist" containerID="a563f68b5f3eb93d1cf5dbdb564ea0a4618bf89e4e12b268c6da4f239ac8ca87"
Jul 14 19:25:13.840415 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:25:13.840333    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a563f68b5f3eb93d1cf5dbdb564ea0a4618bf89e4e12b268c6da4f239ac8ca87"} err="failed to get container status \"a563f68b5f3eb93d1cf5dbdb564ea0a4618bf89e4e12b268c6da4f239ac8ca87\": rpc error: code = NotFound desc = could not find container \"a563f68b5f3eb93d1cf5dbdb564ea0a4618bf89e4e12b268c6da4f239ac8ca87\": container with ID starting with a563f68b5f3eb93d1cf5dbdb564ea0a4618bf89e4e12b268c6da4f239ac8ca87 not found: ID does not exist"
Jul 14 19:25:13.851055 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:25:13.851023    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7d9cdf95d9-kfs24"]
Jul 14 19:25:13.854904 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:25:13.854880    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-7d9cdf95d9-kfs24"]
Jul 14 19:25:13.972949 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:25:13.969410    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fe9887de-99c5-4b14-a133-58a2c59ed48d" path="/var/lib/kubelet/pods/fe9887de-99c5-4b14-a133-58a2c59ed48d/volumes"
Jul 14 19:25:32.421352 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:25:32.421320    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-7bc9dcdd9d-7p6lq"]
Jul 14 19:25:32.421816 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:25:32.421708    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fe9887de-99c5-4b14-a133-58a2c59ed48d" containerName="manager"
Jul 14 19:25:32.421816 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:25:32.421719    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="fe9887de-99c5-4b14-a133-58a2c59ed48d" containerName="manager"
Jul 14 19:25:32.421816 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:25:32.421781    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="fe9887de-99c5-4b14-a133-58a2c59ed48d" containerName="manager"
Jul 14 19:25:32.427251 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:25:32.427229    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-7bc9dcdd9d-7p6lq"
Jul 14 19:25:32.430041 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:25:32.430014    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-mjdp5\""
Jul 14 19:25:32.430173 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:25:32.430117    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Jul 14 19:25:32.430944 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:25:32.430925    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 14 19:25:32.431040 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:25:32.430985    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 14 19:25:32.436698 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:25:32.436677    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-7bc9dcdd9d-7p6lq"]
Jul 14 19:25:32.509941 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:25:32.509902    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b8fd5\" (UniqueName: \"kubernetes.io/projected/5cc3d411-fdd7-4729-afb1-e16375350774-kube-api-access-b8fd5\") pod \"maas-api-7bc9dcdd9d-7p6lq\" (UID: \"5cc3d411-fdd7-4729-afb1-e16375350774\") " pod="odh-ai-gateway-infra/maas-api-7bc9dcdd9d-7p6lq"
Jul 14 19:25:32.510116 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:25:32.509985    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5cc3d411-fdd7-4729-afb1-e16375350774-maas-api-tls\") pod \"maas-api-7bc9dcdd9d-7p6lq\" (UID: \"5cc3d411-fdd7-4729-afb1-e16375350774\") " pod="odh-ai-gateway-infra/maas-api-7bc9dcdd9d-7p6lq"
Jul 14 19:25:32.510116 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:25:32.510018    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5cc3d411-fdd7-4729-afb1-e16375350774-openshift-service-ca\") pod \"maas-api-7bc9dcdd9d-7p6lq\" (UID: \"5cc3d411-fdd7-4729-afb1-e16375350774\") " pod="odh-ai-gateway-infra/maas-api-7bc9dcdd9d-7p6lq"
Jul 14 19:25:32.610571 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:25:32.610534    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5cc3d411-fdd7-4729-afb1-e16375350774-maas-api-tls\") pod \"maas-api-7bc9dcdd9d-7p6lq\" (UID: \"5cc3d411-fdd7-4729-afb1-e16375350774\") " pod="odh-ai-gateway-infra/maas-api-7bc9dcdd9d-7p6lq"
Jul 14 19:25:32.610571 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:25:32.610578    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5cc3d411-fdd7-4729-afb1-e16375350774-openshift-service-ca\") pod \"maas-api-7bc9dcdd9d-7p6lq\" (UID: \"5cc3d411-fdd7-4729-afb1-e16375350774\") " pod="odh-ai-gateway-infra/maas-api-7bc9dcdd9d-7p6lq"
Jul 14 19:25:32.610781 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:25:32.610628    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b8fd5\" (UniqueName: \"kubernetes.io/projected/5cc3d411-fdd7-4729-afb1-e16375350774-kube-api-access-b8fd5\") pod \"maas-api-7bc9dcdd9d-7p6lq\" (UID: \"5cc3d411-fdd7-4729-afb1-e16375350774\") " pod="odh-ai-gateway-infra/maas-api-7bc9dcdd9d-7p6lq"
Jul 14 19:25:32.611417 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:25:32.611340    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5cc3d411-fdd7-4729-afb1-e16375350774-openshift-service-ca\") pod \"maas-api-7bc9dcdd9d-7p6lq\" (UID: \"5cc3d411-fdd7-4729-afb1-e16375350774\") " pod="odh-ai-gateway-infra/maas-api-7bc9dcdd9d-7p6lq"
Jul 14 19:25:32.613131 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:25:32.613109    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5cc3d411-fdd7-4729-afb1-e16375350774-maas-api-tls\") pod \"maas-api-7bc9dcdd9d-7p6lq\" (UID: \"5cc3d411-fdd7-4729-afb1-e16375350774\") " pod="odh-ai-gateway-infra/maas-api-7bc9dcdd9d-7p6lq"
Jul 14 19:25:32.618402 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:25:32.618378    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b8fd5\" (UniqueName: \"kubernetes.io/projected/5cc3d411-fdd7-4729-afb1-e16375350774-kube-api-access-b8fd5\") pod \"maas-api-7bc9dcdd9d-7p6lq\" (UID: \"5cc3d411-fdd7-4729-afb1-e16375350774\") " pod="odh-ai-gateway-infra/maas-api-7bc9dcdd9d-7p6lq"
Jul 14 19:25:32.738504 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:25:32.738465    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-7bc9dcdd9d-7p6lq"
Jul 14 19:25:32.891487 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:25:32.891462    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-7bc9dcdd9d-7p6lq"]
Jul 14 19:25:32.934387 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:25:32.934354    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-7bc9dcdd9d-7p6lq" event={"ID":"5cc3d411-fdd7-4729-afb1-e16375350774","Type":"ContainerStarted","Data":"a21d6e9ef7fa696bc1e22a9ca452f35318ef4184298dcc5ffb592c61b4714776"}
Jul 14 19:25:32.955644 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:25:32.955616    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-74584bb9f8-b4jv2"]
Jul 14 19:25:32.961292 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:25:32.961263    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-74584bb9f8-b4jv2"
Jul 14 19:25:32.963783 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:25:32.963757    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 14 19:25:32.963880 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:25:32.963834    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-snsbt\""
Jul 14 19:25:32.969269 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:25:32.969242    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-74584bb9f8-b4jv2"]
Jul 14 19:25:32.985170 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:25:32.985131    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-f9b8d9b9b-vm7fk"]
Jul 14 19:25:32.989249 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:25:32.989196    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-f9b8d9b9b-vm7fk"
Jul 14 19:25:33.003909 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:25:33.003885    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-f9b8d9b9b-vm7fk"]
Jul 14 19:25:33.115263 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:25:33.115226    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f17ce124-5d01-4fe3-ae66-be3813fa2e25-plugins-config-volume\") pod \"payload-pre-processing-74584bb9f8-b4jv2\" (UID: \"f17ce124-5d01-4fe3-ae66-be3813fa2e25\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-b4jv2"
Jul 14 19:25:33.115453 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:25:33.115337    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dhbl9\" (UniqueName: \"kubernetes.io/projected/ae0538c4-1104-47c5-b186-71789e6fab74-kube-api-access-dhbl9\") pod \"payload-processing-f9b8d9b9b-vm7fk\" (UID: \"ae0538c4-1104-47c5-b186-71789e6fab74\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-vm7fk"
Jul 14 19:25:33.115520 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:25:33.115444    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qk55n\" (UniqueName: \"kubernetes.io/projected/f17ce124-5d01-4fe3-ae66-be3813fa2e25-kube-api-access-qk55n\") pod \"payload-pre-processing-74584bb9f8-b4jv2\" (UID: \"f17ce124-5d01-4fe3-ae66-be3813fa2e25\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-b4jv2"
Jul 14 19:25:33.115520 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:25:33.115485    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ae0538c4-1104-47c5-b186-71789e6fab74-plugins-config-volume\") pod \"payload-processing-f9b8d9b9b-vm7fk\" (UID: \"ae0538c4-1104-47c5-b186-71789e6fab74\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-vm7fk"
Jul 14 19:25:33.216323 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:25:33.216290    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qk55n\" (UniqueName: \"kubernetes.io/projected/f17ce124-5d01-4fe3-ae66-be3813fa2e25-kube-api-access-qk55n\") pod \"payload-pre-processing-74584bb9f8-b4jv2\" (UID: \"f17ce124-5d01-4fe3-ae66-be3813fa2e25\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-b4jv2"
Jul 14 19:25:33.216519 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:25:33.216330    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ae0538c4-1104-47c5-b186-71789e6fab74-plugins-config-volume\") pod \"payload-processing-f9b8d9b9b-vm7fk\" (UID: \"ae0538c4-1104-47c5-b186-71789e6fab74\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-vm7fk"
Jul 14 19:25:33.216519 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:25:33.216398    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f17ce124-5d01-4fe3-ae66-be3813fa2e25-plugins-config-volume\") pod \"payload-pre-processing-74584bb9f8-b4jv2\" (UID: \"f17ce124-5d01-4fe3-ae66-be3813fa2e25\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-b4jv2"
Jul 14 19:25:33.216519 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:25:33.216474    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dhbl9\" (UniqueName: \"kubernetes.io/projected/ae0538c4-1104-47c5-b186-71789e6fab74-kube-api-access-dhbl9\") pod \"payload-processing-f9b8d9b9b-vm7fk\" (UID: \"ae0538c4-1104-47c5-b186-71789e6fab74\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-vm7fk"
Jul 14 19:25:33.217326 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:25:33.217301    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ae0538c4-1104-47c5-b186-71789e6fab74-plugins-config-volume\") pod \"payload-processing-f9b8d9b9b-vm7fk\" (UID: \"ae0538c4-1104-47c5-b186-71789e6fab74\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-vm7fk"
Jul 14 19:25:33.217395 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:25:33.217313    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f17ce124-5d01-4fe3-ae66-be3813fa2e25-plugins-config-volume\") pod \"payload-pre-processing-74584bb9f8-b4jv2\" (UID: \"f17ce124-5d01-4fe3-ae66-be3813fa2e25\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-b4jv2"
Jul 14 19:25:33.224108 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:25:33.224070    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dhbl9\" (UniqueName: \"kubernetes.io/projected/ae0538c4-1104-47c5-b186-71789e6fab74-kube-api-access-dhbl9\") pod \"payload-processing-f9b8d9b9b-vm7fk\" (UID: \"ae0538c4-1104-47c5-b186-71789e6fab74\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-vm7fk"
Jul 14 19:25:33.224288 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:25:33.224265    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qk55n\" (UniqueName: \"kubernetes.io/projected/f17ce124-5d01-4fe3-ae66-be3813fa2e25-kube-api-access-qk55n\") pod \"payload-pre-processing-74584bb9f8-b4jv2\" (UID: \"f17ce124-5d01-4fe3-ae66-be3813fa2e25\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-b4jv2"
Jul 14 19:25:33.274376 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:25:33.274306    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-74584bb9f8-b4jv2"
Jul 14 19:25:33.298165 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:25:33.298116    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-f9b8d9b9b-vm7fk"
Jul 14 19:25:33.424758 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:25:33.424730    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-74584bb9f8-b4jv2"]
Jul 14 19:25:33.427592 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:25:33.427547    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf17ce124_5d01_4fe3_ae66_be3813fa2e25.slice/crio-5c6011fe522dccb0249f04dab71fbe584d696310b0c91ee893e2346a4a244ddc WatchSource:0}: Error finding container 5c6011fe522dccb0249f04dab71fbe584d696310b0c91ee893e2346a4a244ddc: Status 404 returned error can't find the container with id 5c6011fe522dccb0249f04dab71fbe584d696310b0c91ee893e2346a4a244ddc
Jul 14 19:25:33.449050 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:25:33.449026    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-f9b8d9b9b-vm7fk"]
Jul 14 19:25:33.450642 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:25:33.450611    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae0538c4_1104_47c5_b186_71789e6fab74.slice/crio-8b896b6c474e2885d4a592bce6013950ef4985c9456bd9691f75b0576cac4626 WatchSource:0}: Error finding container 8b896b6c474e2885d4a592bce6013950ef4985c9456bd9691f75b0576cac4626: Status 404 returned error can't find the container with id 8b896b6c474e2885d4a592bce6013950ef4985c9456bd9691f75b0576cac4626
Jul 14 19:25:33.942819 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:25:33.942781    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-f9b8d9b9b-vm7fk" event={"ID":"ae0538c4-1104-47c5-b186-71789e6fab74","Type":"ContainerStarted","Data":"8b896b6c474e2885d4a592bce6013950ef4985c9456bd9691f75b0576cac4626"}
Jul 14 19:25:33.944272 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:25:33.944238    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-74584bb9f8-b4jv2" event={"ID":"f17ce124-5d01-4fe3-ae66-be3813fa2e25","Type":"ContainerStarted","Data":"5c6011fe522dccb0249f04dab71fbe584d696310b0c91ee893e2346a4a244ddc"}
Jul 14 19:25:34.951904 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:25:34.951865    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-7bc9dcdd9d-7p6lq" event={"ID":"5cc3d411-fdd7-4729-afb1-e16375350774","Type":"ContainerStarted","Data":"19a6149024b664fc8803174fbf14882047f84eac4067bd7b070d2b23edf53370"}
Jul 14 19:25:34.952376 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:25:34.951929    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-7bc9dcdd9d-7p6lq"
Jul 14 19:25:34.953624 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:25:34.953592    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-f9b8d9b9b-vm7fk" event={"ID":"ae0538c4-1104-47c5-b186-71789e6fab74","Type":"ContainerStarted","Data":"d94e81d895e64ddb81a6cb11987b1abd3ce976bf3847aa1debf86ed6405698e6"}
Jul 14 19:25:34.953755 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:25:34.953661    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-f9b8d9b9b-vm7fk"
Jul 14 19:25:34.971927 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:25:34.971881    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-7bc9dcdd9d-7p6lq" podStartSLOduration=1.039200258 podStartE2EDuration="2.971866715s" totalImagesPullingTime="1.932666457s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 19:25:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:25:34.971195381 +0000 UTC m=+881.532052291" watchObservedRunningTime="2026-07-14 19:25:34.971866715 +0000 UTC m=+881.532723648"
Jul 14 19:25:34.989502 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:25:34.989452    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-f9b8d9b9b-vm7fk" podStartSLOduration=1.6200892690000002 podStartE2EDuration="2.989432661s" totalImagesPullingTime="1.369343392s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 19:25:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:25:34.987347683 +0000 UTC m=+881.548204599" watchObservedRunningTime="2026-07-14 19:25:34.989432661 +0000 UTC m=+881.550289554"
Jul 14 19:25:36.966440 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:25:36.966404    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-74584bb9f8-b4jv2" event={"ID":"f17ce124-5d01-4fe3-ae66-be3813fa2e25","Type":"ContainerStarted","Data":"513ad9b1b650fb915787c8fd6a848d56e5783bd420b100da90395dc553346689"}
Jul 14 19:25:36.966819 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:25:36.966521    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-74584bb9f8-b4jv2"
Jul 14 19:25:36.983868 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:25:36.983820    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-74584bb9f8-b4jv2" podStartSLOduration=2.063970923 podStartE2EDuration="4.983803162s" totalImagesPullingTime="2.919832239s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 19:25:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:25:36.981912473 +0000 UTC m=+883.542769366" watchObservedRunningTime="2026-07-14 19:25:36.983803162 +0000 UTC m=+883.544660058"
Jul 14 19:25:40.964112 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:25:40.964083    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-7bc9dcdd9d-7p6lq"
Jul 14 19:25:45.960413 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:25:45.960320    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-f9b8d9b9b-vm7fk"
Jul 14 19:25:47.974836 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:25:47.974807    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-74584bb9f8-b4jv2"
Jul 14 19:25:52.606274 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:25:52.606237    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-br2wd"]
Jul 14 19:25:52.609838 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:25:52.609822    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-br2wd"
Jul 14 19:25:52.612445 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:25:52.612425    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 14 19:25:52.613415 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:25:52.613400    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Jul 14 19:25:52.613514 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:25:52.613407    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-cxkgd\""
Jul 14 19:25:52.613514 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:25:52.613426    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 14 19:25:52.621064 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:25:52.621038    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-br2wd"]
Jul 14 19:25:52.692880 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:25:52.692841    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-85p9h\" (UniqueName: \"kubernetes.io/projected/7bb79158-0469-4f56-89eb-960151e68f68-kube-api-access-85p9h\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-br2wd\" (UID: \"7bb79158-0469-4f56-89eb-960151e68f68\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-br2wd"
Jul 14 19:25:52.693062 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:25:52.692975    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7bb79158-0469-4f56-89eb-960151e68f68-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-br2wd\" (UID: \"7bb79158-0469-4f56-89eb-960151e68f68\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-br2wd"
Jul 14 19:25:52.693062 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:25:52.693000    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7bb79158-0469-4f56-89eb-960151e68f68-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-br2wd\" (UID: \"7bb79158-0469-4f56-89eb-960151e68f68\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-br2wd"
Jul 14 19:25:52.693168 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:25:52.693086    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7bb79158-0469-4f56-89eb-960151e68f68-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-br2wd\" (UID: \"7bb79158-0469-4f56-89eb-960151e68f68\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-br2wd"
Jul 14 19:25:52.693168 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:25:52.693137    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7bb79158-0469-4f56-89eb-960151e68f68-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-br2wd\" (UID: \"7bb79158-0469-4f56-89eb-960151e68f68\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-br2wd"
Jul 14 19:25:52.693251 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:25:52.693194    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7bb79158-0469-4f56-89eb-960151e68f68-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-br2wd\" (UID: \"7bb79158-0469-4f56-89eb-960151e68f68\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-br2wd"
Jul 14 19:25:52.794083 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:25:52.794049    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7bb79158-0469-4f56-89eb-960151e68f68-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-br2wd\" (UID: \"7bb79158-0469-4f56-89eb-960151e68f68\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-br2wd"
Jul 14 19:25:52.794083 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:25:52.794088    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7bb79158-0469-4f56-89eb-960151e68f68-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-br2wd\" (UID: \"7bb79158-0469-4f56-89eb-960151e68f68\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-br2wd"
Jul 14 19:25:52.794333 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:25:52.794124    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-85p9h\" (UniqueName: \"kubernetes.io/projected/7bb79158-0469-4f56-89eb-960151e68f68-kube-api-access-85p9h\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-br2wd\" (UID: \"7bb79158-0469-4f56-89eb-960151e68f68\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-br2wd"
Jul 14 19:25:52.794333 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:25:52.794190    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7bb79158-0469-4f56-89eb-960151e68f68-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-br2wd\" (UID: \"7bb79158-0469-4f56-89eb-960151e68f68\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-br2wd"
Jul 14 19:25:52.794333 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:25:52.794206    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7bb79158-0469-4f56-89eb-960151e68f68-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-br2wd\" (UID: \"7bb79158-0469-4f56-89eb-960151e68f68\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-br2wd"
Jul 14 19:25:52.794333 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:25:52.794249    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7bb79158-0469-4f56-89eb-960151e68f68-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-br2wd\" (UID: \"7bb79158-0469-4f56-89eb-960151e68f68\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-br2wd"
Jul 14 19:25:52.794532 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:25:52.794511    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7bb79158-0469-4f56-89eb-960151e68f68-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-br2wd\" (UID: \"7bb79158-0469-4f56-89eb-960151e68f68\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-br2wd"
Jul 14 19:25:52.794592 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:25:52.794558    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7bb79158-0469-4f56-89eb-960151e68f68-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-br2wd\" (UID: \"7bb79158-0469-4f56-89eb-960151e68f68\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-br2wd"
Jul 14 19:25:52.794684 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:25:52.794661    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7bb79158-0469-4f56-89eb-960151e68f68-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-br2wd\" (UID: \"7bb79158-0469-4f56-89eb-960151e68f68\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-br2wd"
Jul 14 19:25:52.796657 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:25:52.796635    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7bb79158-0469-4f56-89eb-960151e68f68-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-br2wd\" (UID: \"7bb79158-0469-4f56-89eb-960151e68f68\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-br2wd"
Jul 14 19:25:52.796795 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:25:52.796779    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7bb79158-0469-4f56-89eb-960151e68f68-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-br2wd\" (UID: \"7bb79158-0469-4f56-89eb-960151e68f68\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-br2wd"
Jul 14 19:25:52.802262 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:25:52.802238    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-85p9h\" (UniqueName: \"kubernetes.io/projected/7bb79158-0469-4f56-89eb-960151e68f68-kube-api-access-85p9h\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-br2wd\" (UID: \"7bb79158-0469-4f56-89eb-960151e68f68\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-br2wd"
Jul 14 19:25:52.922842 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:25:52.922747    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-br2wd"
Jul 14 19:25:53.068372 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:25:53.068348    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-br2wd"]
Jul 14 19:25:53.069975 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:25:53.069945    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7bb79158_0469_4f56_89eb_960151e68f68.slice/crio-29ba823b1124583c4c2c2d75e67415ecb174e0aa0db99699babf7b4d2f69a308 WatchSource:0}: Error finding container 29ba823b1124583c4c2c2d75e67415ecb174e0aa0db99699babf7b4d2f69a308: Status 404 returned error can't find the container with id 29ba823b1124583c4c2c2d75e67415ecb174e0aa0db99699babf7b4d2f69a308
Jul 14 19:25:54.065537 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:25:54.065492    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-br2wd" event={"ID":"7bb79158-0469-4f56-89eb-960151e68f68","Type":"ContainerStarted","Data":"29ba823b1124583c4c2c2d75e67415ecb174e0aa0db99699babf7b4d2f69a308"}
Jul 14 19:25:54.196424 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:25:54.196399    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-p5lb5_7ab60b2b-a644-4e35-b8b1-49c676e0f63f/console-operator/1.log"
Jul 14 19:25:54.196570 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:25:54.196425    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-p5lb5_7ab60b2b-a644-4e35-b8b1-49c676e0f63f/console-operator/1.log"
Jul 14 19:25:54.200007 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:25:54.199986    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cqqv8_7a447cf6-9373-4497-8028-97d590f38262/ovn-acl-logging/0.log"
Jul 14 19:25:54.200197 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:25:54.200183    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cqqv8_7a447cf6-9373-4497-8028-97d590f38262/ovn-acl-logging/0.log"
Jul 14 19:25:55.073036 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:25:55.073001    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-br2wd" event={"ID":"7bb79158-0469-4f56-89eb-960151e68f68","Type":"ContainerStarted","Data":"0aad41dacb492101aff943d3f60fed9a0e777fab04d72e8a564f80acb68556c1"}
Jul 14 19:25:55.091592 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:25:55.091535    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-br2wd" podStartSLOduration=1.947407647 podStartE2EDuration="3.091518214s" totalImagesPullingTime="1.144110567s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 19:25:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:25:55.091139021 +0000 UTC m=+901.651995913" watchObservedRunningTime="2026-07-14 19:25:55.091518214 +0000 UTC m=+901.652375116"
Jul 14 19:26:02.923635 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:26:02.923601    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-br2wd"
Jul 14 19:26:02.924100 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:26:02.923678    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-br2wd"
Jul 14 19:26:02.936397 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:26:02.936370    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-br2wd"
Jul 14 19:26:03.132969 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:26:03.132935    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-br2wd"
Jul 14 19:26:07.996914 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:26:07.996881    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-4ddwp"]
Jul 14 19:26:08.001033 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:26:08.001008    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4ddwp"
Jul 14 19:26:08.003561 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:26:08.003541    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Jul 14 19:26:08.008662 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:26:08.008500    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-4ddwp"]
Jul 14 19:26:08.131313 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:26:08.131272    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7d4b8bd7-dead-46db-9798-aad909af3259-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4ddwp\" (UID: \"7d4b8bd7-dead-46db-9798-aad909af3259\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4ddwp"
Jul 14 19:26:08.131517 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:26:08.131333    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7d4b8bd7-dead-46db-9798-aad909af3259-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4ddwp\" (UID: \"7d4b8bd7-dead-46db-9798-aad909af3259\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4ddwp"
Jul 14 19:26:08.131517 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:26:08.131398    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7d4b8bd7-dead-46db-9798-aad909af3259-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4ddwp\" (UID: \"7d4b8bd7-dead-46db-9798-aad909af3259\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4ddwp"
Jul 14 19:26:08.131517 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:26:08.131457    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v78zg\" (UniqueName: \"kubernetes.io/projected/7d4b8bd7-dead-46db-9798-aad909af3259-kube-api-access-v78zg\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4ddwp\" (UID: \"7d4b8bd7-dead-46db-9798-aad909af3259\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4ddwp"
Jul 14 19:26:08.131517 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:26:08.131486    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7d4b8bd7-dead-46db-9798-aad909af3259-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4ddwp\" (UID: \"7d4b8bd7-dead-46db-9798-aad909af3259\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4ddwp"
Jul 14 19:26:08.131720 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:26:08.131567    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7d4b8bd7-dead-46db-9798-aad909af3259-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4ddwp\" (UID: \"7d4b8bd7-dead-46db-9798-aad909af3259\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4ddwp"
Jul 14 19:26:08.232913 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:26:08.232875    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7d4b8bd7-dead-46db-9798-aad909af3259-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4ddwp\" (UID: \"7d4b8bd7-dead-46db-9798-aad909af3259\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4ddwp"
Jul 14 19:26:08.232913 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:26:08.232909    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7d4b8bd7-dead-46db-9798-aad909af3259-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4ddwp\" (UID: \"7d4b8bd7-dead-46db-9798-aad909af3259\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4ddwp"
Jul 14 19:26:08.233186 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:26:08.233032    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v78zg\" (UniqueName: \"kubernetes.io/projected/7d4b8bd7-dead-46db-9798-aad909af3259-kube-api-access-v78zg\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4ddwp\" (UID: \"7d4b8bd7-dead-46db-9798-aad909af3259\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4ddwp"
Jul 14 19:26:08.233186 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:26:08.233080    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7d4b8bd7-dead-46db-9798-aad909af3259-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4ddwp\" (UID: \"7d4b8bd7-dead-46db-9798-aad909af3259\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4ddwp"
Jul 14 19:26:08.233186 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:26:08.233126    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7d4b8bd7-dead-46db-9798-aad909af3259-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4ddwp\" (UID: \"7d4b8bd7-dead-46db-9798-aad909af3259\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4ddwp"
Jul 14 19:26:08.233368 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:26:08.233253    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7d4b8bd7-dead-46db-9798-aad909af3259-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4ddwp\" (UID: \"7d4b8bd7-dead-46db-9798-aad909af3259\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4ddwp"
Jul 14 19:26:08.233448 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:26:08.233364    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7d4b8bd7-dead-46db-9798-aad909af3259-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4ddwp\" (UID: \"7d4b8bd7-dead-46db-9798-aad909af3259\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4ddwp"
Jul 14 19:26:08.233498 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:26:08.233459    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7d4b8bd7-dead-46db-9798-aad909af3259-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4ddwp\" (UID: \"7d4b8bd7-dead-46db-9798-aad909af3259\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4ddwp"
Jul 14 19:26:08.233544 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:26:08.233516    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7d4b8bd7-dead-46db-9798-aad909af3259-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4ddwp\" (UID: \"7d4b8bd7-dead-46db-9798-aad909af3259\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4ddwp"
Jul 14 19:26:08.235280 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:26:08.235262    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7d4b8bd7-dead-46db-9798-aad909af3259-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4ddwp\" (UID: \"7d4b8bd7-dead-46db-9798-aad909af3259\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4ddwp"
Jul 14 19:26:08.235669 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:26:08.235653    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7d4b8bd7-dead-46db-9798-aad909af3259-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4ddwp\" (UID: \"7d4b8bd7-dead-46db-9798-aad909af3259\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4ddwp"
Jul 14 19:26:08.244006 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:26:08.243973    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v78zg\" (UniqueName: \"kubernetes.io/projected/7d4b8bd7-dead-46db-9798-aad909af3259-kube-api-access-v78zg\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4ddwp\" (UID: \"7d4b8bd7-dead-46db-9798-aad909af3259\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4ddwp"
Jul 14 19:26:08.312996 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:26:08.312897    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4ddwp"
Jul 14 19:26:08.454451 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:26:08.454426    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-4ddwp"]
Jul 14 19:26:08.456084 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:26:08.456059    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d4b8bd7_dead_46db_9798_aad909af3259.slice/crio-828b7b52706c1459e6a530eb9306ff9ce6067275237f90aa2b5eac9bc2e37f61 WatchSource:0}: Error finding container 828b7b52706c1459e6a530eb9306ff9ce6067275237f90aa2b5eac9bc2e37f61: Status 404 returned error can't find the container with id 828b7b52706c1459e6a530eb9306ff9ce6067275237f90aa2b5eac9bc2e37f61
Jul 14 19:26:09.155486 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:26:09.155438    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4ddwp" event={"ID":"7d4b8bd7-dead-46db-9798-aad909af3259","Type":"ContainerStarted","Data":"7ffa987f615e82b349974ce3924e40167f9115e84bd46e25fb63a5f8a8d1c6aa"}
Jul 14 19:26:09.155875 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:26:09.155504    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4ddwp" event={"ID":"7d4b8bd7-dead-46db-9798-aad909af3259","Type":"ContainerStarted","Data":"828b7b52706c1459e6a530eb9306ff9ce6067275237f90aa2b5eac9bc2e37f61"}
Jul 14 19:26:09.175742 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:26:09.175687    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4ddwp" podStartSLOduration=1.9726110220000002 podStartE2EDuration="2.175671119s" totalImagesPullingTime="203.060097ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 19:26:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:26:09.172702968 +0000 UTC m=+915.733559877" watchObservedRunningTime="2026-07-14 19:26:09.175671119 +0000 UTC m=+915.736528011"
Jul 14 19:26:18.313261 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:26:18.313229    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4ddwp"
Jul 14 19:26:18.313784 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:26:18.313318    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4ddwp"
Jul 14 19:26:18.325443 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:26:18.325413    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4ddwp"
Jul 14 19:26:19.221857 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:26:19.221830    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4ddwp"
Jul 14 19:28:58.716424 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:28:58.716345    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5b78ddfc45-f5jwj"]
Jul 14 19:28:58.717060 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:28:58.716549    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-5b78ddfc45-f5jwj" podUID="fe0c37df-384a-42b3-9865-0a576d052d33" containerName="manager" containerID="cri-o://1dda511859c8c0395f6efe8a9dcff360f99dc982c9b6a68f69fde429a515cad4" gracePeriod=30
Jul 14 19:28:58.981388 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:28:58.981363    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5b78ddfc45-f5jwj"
Jul 14 19:28:59.029763 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:28:59.029734    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fe0c37df-384a-42b3-9865-0a576d052d33-webhook-cert\") pod \"fe0c37df-384a-42b3-9865-0a576d052d33\" (UID: \"fe0c37df-384a-42b3-9865-0a576d052d33\") "
Jul 14 19:28:59.029933 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:28:59.029798    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w27mv\" (UniqueName: \"kubernetes.io/projected/fe0c37df-384a-42b3-9865-0a576d052d33-kube-api-access-w27mv\") pod \"fe0c37df-384a-42b3-9865-0a576d052d33\" (UID: \"fe0c37df-384a-42b3-9865-0a576d052d33\") "
Jul 14 19:28:59.031883 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:28:59.031854    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fe0c37df-384a-42b3-9865-0a576d052d33-kube-api-access-w27mv" (OuterVolumeSpecName: "kube-api-access-w27mv") pod "fe0c37df-384a-42b3-9865-0a576d052d33" (UID: "fe0c37df-384a-42b3-9865-0a576d052d33"). InnerVolumeSpecName "kube-api-access-w27mv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 19:28:59.031989 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:28:59.031942    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fe0c37df-384a-42b3-9865-0a576d052d33-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "fe0c37df-384a-42b3-9865-0a576d052d33" (UID: "fe0c37df-384a-42b3-9865-0a576d052d33"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 19:28:59.119459 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:28:59.119430    2565 generic.go:356] "Generic (PLEG): container finished" podID="fe0c37df-384a-42b3-9865-0a576d052d33" containerID="1dda511859c8c0395f6efe8a9dcff360f99dc982c9b6a68f69fde429a515cad4" exitCode=0
Jul 14 19:28:59.119560 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:28:59.119469    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5b78ddfc45-f5jwj"
Jul 14 19:28:59.119560 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:28:59.119469    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5b78ddfc45-f5jwj" event={"ID":"fe0c37df-384a-42b3-9865-0a576d052d33","Type":"ContainerDied","Data":"1dda511859c8c0395f6efe8a9dcff360f99dc982c9b6a68f69fde429a515cad4"}
Jul 14 19:28:59.119629 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:28:59.119589    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5b78ddfc45-f5jwj" event={"ID":"fe0c37df-384a-42b3-9865-0a576d052d33","Type":"ContainerDied","Data":"629c864b857e221c8d8c6523fd9b045b076e6a5ff152a1044437c67ab55dc4a0"}
Jul 14 19:28:59.119669 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:28:59.119609    2565 scope.go:117] "RemoveContainer" containerID="1dda511859c8c0395f6efe8a9dcff360f99dc982c9b6a68f69fde429a515cad4"
Jul 14 19:28:59.129195 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:28:59.129176    2565 scope.go:117] "RemoveContainer" containerID="1dda511859c8c0395f6efe8a9dcff360f99dc982c9b6a68f69fde429a515cad4"
Jul 14 19:28:59.129442 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:28:59.129425    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1dda511859c8c0395f6efe8a9dcff360f99dc982c9b6a68f69fde429a515cad4\": container with ID starting with 1dda511859c8c0395f6efe8a9dcff360f99dc982c9b6a68f69fde429a515cad4 not found: ID does not exist" containerID="1dda511859c8c0395f6efe8a9dcff360f99dc982c9b6a68f69fde429a515cad4"
Jul 14 19:28:59.129505 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:28:59.129457    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1dda511859c8c0395f6efe8a9dcff360f99dc982c9b6a68f69fde429a515cad4"} err="failed to get container status \"1dda511859c8c0395f6efe8a9dcff360f99dc982c9b6a68f69fde429a515cad4\": rpc error: code = NotFound desc = could not find container \"1dda511859c8c0395f6efe8a9dcff360f99dc982c9b6a68f69fde429a515cad4\": container with ID starting with 1dda511859c8c0395f6efe8a9dcff360f99dc982c9b6a68f69fde429a515cad4 not found: ID does not exist"
Jul 14 19:28:59.130659 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:28:59.130630    2565 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fe0c37df-384a-42b3-9865-0a576d052d33-webhook-cert\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Jul 14 19:28:59.130659 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:28:59.130660    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w27mv\" (UniqueName: \"kubernetes.io/projected/fe0c37df-384a-42b3-9865-0a576d052d33-kube-api-access-w27mv\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Jul 14 19:28:59.141097 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:28:59.141078    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5b78ddfc45-f5jwj"]
Jul 14 19:28:59.143336 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:28:59.143316    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-5b78ddfc45-f5jwj"]
Jul 14 19:28:59.968018 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:28:59.967985    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fe0c37df-384a-42b3-9865-0a576d052d33" path="/var/lib/kubelet/pods/fe0c37df-384a-42b3-9865-0a576d052d33/volumes"
Jul 14 19:28:59.994148 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:28:59.994119    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5b78ddfc45-gt9gb"]
Jul 14 19:28:59.994650 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:28:59.994634    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fe0c37df-384a-42b3-9865-0a576d052d33" containerName="manager"
Jul 14 19:28:59.994708 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:28:59.994653    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="fe0c37df-384a-42b3-9865-0a576d052d33" containerName="manager"
Jul 14 19:28:59.994742 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:28:59.994716    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="fe0c37df-384a-42b3-9865-0a576d052d33" containerName="manager"
Jul 14 19:28:59.998805 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:28:59.998787    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5b78ddfc45-gt9gb"
Jul 14 19:29:00.002375 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:29:00.002357    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-7565g\""
Jul 14 19:29:00.002476 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:29:00.002390    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 14 19:29:00.002476 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:29:00.002397    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 14 19:29:00.008091 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:29:00.008072    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5b78ddfc45-gt9gb"]
Jul 14 19:29:00.037139 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:29:00.037111    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gcl24\" (UniqueName: \"kubernetes.io/projected/4f76d117-82eb-4b68-a42a-59215f66e436-kube-api-access-gcl24\") pod \"maas-controller-5b78ddfc45-gt9gb\" (UID: \"4f76d117-82eb-4b68-a42a-59215f66e436\") " pod="opendatahub/maas-controller-5b78ddfc45-gt9gb"
Jul 14 19:29:00.037262 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:29:00.037177    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4f76d117-82eb-4b68-a42a-59215f66e436-webhook-cert\") pod \"maas-controller-5b78ddfc45-gt9gb\" (UID: \"4f76d117-82eb-4b68-a42a-59215f66e436\") " pod="opendatahub/maas-controller-5b78ddfc45-gt9gb"
Jul 14 19:29:00.137814 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:29:00.137791    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gcl24\" (UniqueName: \"kubernetes.io/projected/4f76d117-82eb-4b68-a42a-59215f66e436-kube-api-access-gcl24\") pod \"maas-controller-5b78ddfc45-gt9gb\" (UID: \"4f76d117-82eb-4b68-a42a-59215f66e436\") " pod="opendatahub/maas-controller-5b78ddfc45-gt9gb"
Jul 14 19:29:00.137918 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:29:00.137830    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4f76d117-82eb-4b68-a42a-59215f66e436-webhook-cert\") pod \"maas-controller-5b78ddfc45-gt9gb\" (UID: \"4f76d117-82eb-4b68-a42a-59215f66e436\") " pod="opendatahub/maas-controller-5b78ddfc45-gt9gb"
Jul 14 19:29:00.140454 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:29:00.140433    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4f76d117-82eb-4b68-a42a-59215f66e436-webhook-cert\") pod \"maas-controller-5b78ddfc45-gt9gb\" (UID: \"4f76d117-82eb-4b68-a42a-59215f66e436\") " pod="opendatahub/maas-controller-5b78ddfc45-gt9gb"
Jul 14 19:29:00.146229 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:29:00.146211    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gcl24\" (UniqueName: \"kubernetes.io/projected/4f76d117-82eb-4b68-a42a-59215f66e436-kube-api-access-gcl24\") pod \"maas-controller-5b78ddfc45-gt9gb\" (UID: \"4f76d117-82eb-4b68-a42a-59215f66e436\") " pod="opendatahub/maas-controller-5b78ddfc45-gt9gb"
Jul 14 19:29:00.309321 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:29:00.309299    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5b78ddfc45-gt9gb"
Jul 14 19:29:00.442553 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:29:00.442528    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5b78ddfc45-gt9gb"]
Jul 14 19:29:00.443373 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:29:00.443347    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f76d117_82eb_4b68_a42a_59215f66e436.slice/crio-a380ffef6ec59962218976f45077dbbb5078441d3ad93c19d284a3dc50ef14aa WatchSource:0}: Error finding container a380ffef6ec59962218976f45077dbbb5078441d3ad93c19d284a3dc50ef14aa: Status 404 returned error can't find the container with id a380ffef6ec59962218976f45077dbbb5078441d3ad93c19d284a3dc50ef14aa
Jul 14 19:29:00.444623 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:29:00.444608    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 14 19:29:01.132538 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:29:01.132451    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5b78ddfc45-gt9gb" event={"ID":"4f76d117-82eb-4b68-a42a-59215f66e436","Type":"ContainerStarted","Data":"f30bf2ee2239da8235f9ea8b6daeda2e6bf41ec267e6405e4d63d6f28a3de01d"}
Jul 14 19:29:01.132538 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:29:01.132501    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5b78ddfc45-gt9gb" event={"ID":"4f76d117-82eb-4b68-a42a-59215f66e436","Type":"ContainerStarted","Data":"a380ffef6ec59962218976f45077dbbb5078441d3ad93c19d284a3dc50ef14aa"}
Jul 14 19:29:01.132538 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:29:01.132525    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5b78ddfc45-gt9gb"
Jul 14 19:29:01.151439 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:29:01.151393    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-5b78ddfc45-gt9gb" podStartSLOduration=1.726327752 podStartE2EDuration="2.151377979s" totalImagesPullingTime="425.050227ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 19:28:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:29:01.148169311 +0000 UTC m=+1087.709026215" watchObservedRunningTime="2026-07-14 19:29:01.151377979 +0000 UTC m=+1087.712234869"
Jul 14 19:29:12.140197 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:29:12.140145    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5b78ddfc45-gt9gb"
Jul 14 19:30:00.146085 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:30:00.146053    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29734290-fmvlg"]
Jul 14 19:30:00.150475 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:30:00.150458    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29734290-fmvlg"
Jul 14 19:30:00.153264 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:30:00.153231    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-br5f6\""
Jul 14 19:30:00.156262 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:30:00.156228    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29734290-fmvlg"]
Jul 14 19:30:00.161906 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:30:00.161891    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29734290-fmvlg"
Jul 14 19:30:00.297601 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:30:00.297109    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29734290-fmvlg"]
Jul 14 19:30:00.299602 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:30:00.299564    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56ecd4ec_affb_4f99_a737_c003170de533.slice/crio-10e8cbc9ab19ddbb8edf891a1a4796b83c1f694ec4eefc88b4a8d06c41653469 WatchSource:0}: Error finding container 10e8cbc9ab19ddbb8edf891a1a4796b83c1f694ec4eefc88b4a8d06c41653469: Status 404 returned error can't find the container with id 10e8cbc9ab19ddbb8edf891a1a4796b83c1f694ec4eefc88b4a8d06c41653469
Jul 14 19:30:00.459144 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:30:00.459065    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29734290-fmvlg" event={"ID":"56ecd4ec-affb-4f99-a737-c003170de533","Type":"ContainerStarted","Data":"10e8cbc9ab19ddbb8edf891a1a4796b83c1f694ec4eefc88b4a8d06c41653469"}
Jul 14 19:30:03.481076 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:30:03.481043    2565 generic.go:356] "Generic (PLEG): container finished" podID="56ecd4ec-affb-4f99-a737-c003170de533" containerID="7a9e801a3889cd9bdd9d157321bba3be9e881a789998a820dd76ccfeeb6d89b0" exitCode=0
Jul 14 19:30:03.481549 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:30:03.481120    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29734290-fmvlg" event={"ID":"56ecd4ec-affb-4f99-a737-c003170de533","Type":"ContainerDied","Data":"7a9e801a3889cd9bdd9d157321bba3be9e881a789998a820dd76ccfeeb6d89b0"}
Jul 14 19:30:04.629023 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:30:04.628999    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29734290-fmvlg"
Jul 14 19:30:05.493729 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:30:05.493695    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29734290-fmvlg"
Jul 14 19:30:05.493906 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:30:05.493750    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29734290-fmvlg" event={"ID":"56ecd4ec-affb-4f99-a737-c003170de533","Type":"ContainerDied","Data":"10e8cbc9ab19ddbb8edf891a1a4796b83c1f694ec4eefc88b4a8d06c41653469"}
Jul 14 19:30:05.493906 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:30:05.493796    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="10e8cbc9ab19ddbb8edf891a1a4796b83c1f694ec4eefc88b4a8d06c41653469"
Jul 14 19:30:54.238285 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:30:54.238251    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-p5lb5_7ab60b2b-a644-4e35-b8b1-49c676e0f63f/console-operator/1.log"
Jul 14 19:30:54.240287 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:30:54.240268    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-p5lb5_7ab60b2b-a644-4e35-b8b1-49c676e0f63f/console-operator/1.log"
Jul 14 19:30:54.241633 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:30:54.241608    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cqqv8_7a447cf6-9373-4497-8028-97d590f38262/ovn-acl-logging/0.log"
Jul 14 19:30:54.243996 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:30:54.243979    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cqqv8_7a447cf6-9373-4497-8028-97d590f38262/ovn-acl-logging/0.log"
Jul 14 19:35:54.283149 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:35:54.283118    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-p5lb5_7ab60b2b-a644-4e35-b8b1-49c676e0f63f/console-operator/1.log"
Jul 14 19:35:54.283674 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:35:54.283441    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-p5lb5_7ab60b2b-a644-4e35-b8b1-49c676e0f63f/console-operator/1.log"
Jul 14 19:35:54.286547 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:35:54.286520    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cqqv8_7a447cf6-9373-4497-8028-97d590f38262/ovn-acl-logging/0.log"
Jul 14 19:35:54.286705 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:35:54.286687    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cqqv8_7a447cf6-9373-4497-8028-97d590f38262/ovn-acl-logging/0.log"
Jul 14 19:40:54.321460 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:40:54.321434    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-p5lb5_7ab60b2b-a644-4e35-b8b1-49c676e0f63f/console-operator/1.log"
Jul 14 19:40:54.322963 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:40:54.322938    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-p5lb5_7ab60b2b-a644-4e35-b8b1-49c676e0f63f/console-operator/1.log"
Jul 14 19:40:54.324792 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:40:54.324777    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cqqv8_7a447cf6-9373-4497-8028-97d590f38262/ovn-acl-logging/0.log"
Jul 14 19:40:54.329752 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:40:54.329732    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cqqv8_7a447cf6-9373-4497-8028-97d590f38262/ovn-acl-logging/0.log"
Jul 14 19:41:21.413741 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:41:21.413708    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-102a2069-658486d9fd-hbl95"]
Jul 14 19:41:21.414392 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:41:21.414374    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="56ecd4ec-affb-4f99-a737-c003170de533" containerName="cleanup"
Jul 14 19:41:21.414456 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:41:21.414394    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="56ecd4ec-affb-4f99-a737-c003170de533" containerName="cleanup"
Jul 14 19:41:21.414533 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:41:21.414522    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="56ecd4ec-affb-4f99-a737-c003170de533" containerName="cleanup"
Jul 14 19:41:21.418067 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:41:21.418047    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-102a2069-658486d9fd-hbl95"
Jul 14 19:41:21.420596 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:41:21.420577    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-102a2069-serving-cert\""
Jul 14 19:41:21.426979 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:41:21.426958    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-102a2069-658486d9fd-hbl95"]
Jul 14 19:41:21.444905 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:41:21.444879    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/18b90637-62c0-4b99-a5af-a44011c10aca-maas-api-tls\") pod \"maas-api-e2e-ait-102a2069-658486d9fd-hbl95\" (UID: \"18b90637-62c0-4b99-a5af-a44011c10aca\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-102a2069-658486d9fd-hbl95"
Jul 14 19:41:21.445006 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:41:21.444929    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nssct\" (UniqueName: \"kubernetes.io/projected/18b90637-62c0-4b99-a5af-a44011c10aca-kube-api-access-nssct\") pod \"maas-api-e2e-ait-102a2069-658486d9fd-hbl95\" (UID: \"18b90637-62c0-4b99-a5af-a44011c10aca\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-102a2069-658486d9fd-hbl95"
Jul 14 19:41:21.445051 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:41:21.445017    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/18b90637-62c0-4b99-a5af-a44011c10aca-openshift-service-ca\") pod \"maas-api-e2e-ait-102a2069-658486d9fd-hbl95\" (UID: \"18b90637-62c0-4b99-a5af-a44011c10aca\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-102a2069-658486d9fd-hbl95"
Jul 14 19:41:21.546123 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:41:21.546097    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nssct\" (UniqueName: \"kubernetes.io/projected/18b90637-62c0-4b99-a5af-a44011c10aca-kube-api-access-nssct\") pod \"maas-api-e2e-ait-102a2069-658486d9fd-hbl95\" (UID: \"18b90637-62c0-4b99-a5af-a44011c10aca\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-102a2069-658486d9fd-hbl95"
Jul 14 19:41:21.546313 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:41:21.546139    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/18b90637-62c0-4b99-a5af-a44011c10aca-openshift-service-ca\") pod \"maas-api-e2e-ait-102a2069-658486d9fd-hbl95\" (UID: \"18b90637-62c0-4b99-a5af-a44011c10aca\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-102a2069-658486d9fd-hbl95"
Jul 14 19:41:21.546313 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:41:21.546246    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/18b90637-62c0-4b99-a5af-a44011c10aca-maas-api-tls\") pod \"maas-api-e2e-ait-102a2069-658486d9fd-hbl95\" (UID: \"18b90637-62c0-4b99-a5af-a44011c10aca\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-102a2069-658486d9fd-hbl95"
Jul 14 19:41:21.546818 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:41:21.546794    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/18b90637-62c0-4b99-a5af-a44011c10aca-openshift-service-ca\") pod \"maas-api-e2e-ait-102a2069-658486d9fd-hbl95\" (UID: \"18b90637-62c0-4b99-a5af-a44011c10aca\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-102a2069-658486d9fd-hbl95"
Jul 14 19:41:21.549021 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:41:21.548998    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/18b90637-62c0-4b99-a5af-a44011c10aca-maas-api-tls\") pod \"maas-api-e2e-ait-102a2069-658486d9fd-hbl95\" (UID: \"18b90637-62c0-4b99-a5af-a44011c10aca\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-102a2069-658486d9fd-hbl95"
Jul 14 19:41:21.555028 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:41:21.555002    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nssct\" (UniqueName: \"kubernetes.io/projected/18b90637-62c0-4b99-a5af-a44011c10aca-kube-api-access-nssct\") pod \"maas-api-e2e-ait-102a2069-658486d9fd-hbl95\" (UID: \"18b90637-62c0-4b99-a5af-a44011c10aca\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-102a2069-658486d9fd-hbl95"
Jul 14 19:41:21.730501 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:41:21.730467    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-102a2069-658486d9fd-hbl95"
Jul 14 19:41:21.873485 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:41:21.873451    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-102a2069-658486d9fd-hbl95"]
Jul 14 19:41:21.874776 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:41:21.874735    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18b90637_62c0_4b99_a5af_a44011c10aca.slice/crio-64f3c42f74ba80c80fb4fc2ce6a8f23a15c12c2661759549493c4e8733a431fd WatchSource:0}: Error finding container 64f3c42f74ba80c80fb4fc2ce6a8f23a15c12c2661759549493c4e8733a431fd: Status 404 returned error can't find the container with id 64f3c42f74ba80c80fb4fc2ce6a8f23a15c12c2661759549493c4e8733a431fd
Jul 14 19:41:21.875979 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:41:21.875963    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 14 19:41:22.411867 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:41:22.411829    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-102a2069-658486d9fd-hbl95" event={"ID":"18b90637-62c0-4b99-a5af-a44011c10aca","Type":"ContainerStarted","Data":"64f3c42f74ba80c80fb4fc2ce6a8f23a15c12c2661759549493c4e8733a431fd"}
Jul 14 19:41:23.419901 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:41:23.419867    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-102a2069-658486d9fd-hbl95" event={"ID":"18b90637-62c0-4b99-a5af-a44011c10aca","Type":"ContainerStarted","Data":"5fd190aa8f42f553a07308fd0d2345e61832a191d3b7bc121749118c31f725b8"}
Jul 14 19:41:23.420348 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:41:23.419940    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-102a2069-658486d9fd-hbl95"
Jul 14 19:41:23.441745 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:41:23.441701    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-102a2069-658486d9fd-hbl95" podStartSLOduration=1.6375609070000001 podStartE2EDuration="2.441687684s" totalImagesPullingTime="804.126777ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 19:41:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:41:23.438441544 +0000 UTC m=+1829.999298457" watchObservedRunningTime="2026-07-14 19:41:23.441687684 +0000 UTC m=+1830.002544573"
Jul 14 19:41:29.432516 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:41:29.432484    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-102a2069-658486d9fd-hbl95"
Jul 14 19:41:36.895596 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:41:36.895547    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-102a2069-658486d9fd-hbl95"]
Jul 14 19:41:36.896081 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:41:36.895800    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-102a2069-658486d9fd-hbl95" podUID="18b90637-62c0-4b99-a5af-a44011c10aca" containerName="maas-api" containerID="cri-o://5fd190aa8f42f553a07308fd0d2345e61832a191d3b7bc121749118c31f725b8" gracePeriod=30
Jul 14 19:41:37.143061 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:41:37.143039    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-102a2069-658486d9fd-hbl95"
Jul 14 19:41:37.279429 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:41:37.279395    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/18b90637-62c0-4b99-a5af-a44011c10aca-maas-api-tls\") pod \"18b90637-62c0-4b99-a5af-a44011c10aca\" (UID: \"18b90637-62c0-4b99-a5af-a44011c10aca\") "
Jul 14 19:41:37.279582 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:41:37.279450    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nssct\" (UniqueName: \"kubernetes.io/projected/18b90637-62c0-4b99-a5af-a44011c10aca-kube-api-access-nssct\") pod \"18b90637-62c0-4b99-a5af-a44011c10aca\" (UID: \"18b90637-62c0-4b99-a5af-a44011c10aca\") "
Jul 14 19:41:37.279582 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:41:37.279494    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/18b90637-62c0-4b99-a5af-a44011c10aca-openshift-service-ca\") pod \"18b90637-62c0-4b99-a5af-a44011c10aca\" (UID: \"18b90637-62c0-4b99-a5af-a44011c10aca\") "
Jul 14 19:41:37.279912 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:41:37.279889    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/18b90637-62c0-4b99-a5af-a44011c10aca-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "18b90637-62c0-4b99-a5af-a44011c10aca" (UID: "18b90637-62c0-4b99-a5af-a44011c10aca"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 19:41:37.281668 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:41:37.281646    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/18b90637-62c0-4b99-a5af-a44011c10aca-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "18b90637-62c0-4b99-a5af-a44011c10aca" (UID: "18b90637-62c0-4b99-a5af-a44011c10aca"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 19:41:37.281797 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:41:37.281777    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/18b90637-62c0-4b99-a5af-a44011c10aca-kube-api-access-nssct" (OuterVolumeSpecName: "kube-api-access-nssct") pod "18b90637-62c0-4b99-a5af-a44011c10aca" (UID: "18b90637-62c0-4b99-a5af-a44011c10aca"). InnerVolumeSpecName "kube-api-access-nssct". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 19:41:37.380328 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:41:37.380303    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nssct\" (UniqueName: \"kubernetes.io/projected/18b90637-62c0-4b99-a5af-a44011c10aca-kube-api-access-nssct\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Jul 14 19:41:37.380328 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:41:37.380325    2565 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/18b90637-62c0-4b99-a5af-a44011c10aca-openshift-service-ca\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Jul 14 19:41:37.380450 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:41:37.380336    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/18b90637-62c0-4b99-a5af-a44011c10aca-maas-api-tls\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Jul 14 19:41:37.502372 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:41:37.502349    2565 generic.go:356] "Generic (PLEG): container finished" podID="18b90637-62c0-4b99-a5af-a44011c10aca" containerID="5fd190aa8f42f553a07308fd0d2345e61832a191d3b7bc121749118c31f725b8" exitCode=0
Jul 14 19:41:37.502479 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:41:37.502423    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-102a2069-658486d9fd-hbl95"
Jul 14 19:41:37.502479 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:41:37.502458    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-102a2069-658486d9fd-hbl95" event={"ID":"18b90637-62c0-4b99-a5af-a44011c10aca","Type":"ContainerDied","Data":"5fd190aa8f42f553a07308fd0d2345e61832a191d3b7bc121749118c31f725b8"}
Jul 14 19:41:37.502565 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:41:37.502505    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-102a2069-658486d9fd-hbl95" event={"ID":"18b90637-62c0-4b99-a5af-a44011c10aca","Type":"ContainerDied","Data":"64f3c42f74ba80c80fb4fc2ce6a8f23a15c12c2661759549493c4e8733a431fd"}
Jul 14 19:41:37.502565 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:41:37.502530    2565 scope.go:117] "RemoveContainer" containerID="5fd190aa8f42f553a07308fd0d2345e61832a191d3b7bc121749118c31f725b8"
Jul 14 19:41:37.515524 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:41:37.515339    2565 scope.go:117] "RemoveContainer" containerID="5fd190aa8f42f553a07308fd0d2345e61832a191d3b7bc121749118c31f725b8"
Jul 14 19:41:37.515860 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:41:37.515692    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5fd190aa8f42f553a07308fd0d2345e61832a191d3b7bc121749118c31f725b8\": container with ID starting with 5fd190aa8f42f553a07308fd0d2345e61832a191d3b7bc121749118c31f725b8 not found: ID does not exist" containerID="5fd190aa8f42f553a07308fd0d2345e61832a191d3b7bc121749118c31f725b8"
Jul 14 19:41:37.515946 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:41:37.515880    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5fd190aa8f42f553a07308fd0d2345e61832a191d3b7bc121749118c31f725b8"} err="failed to get container status \"5fd190aa8f42f553a07308fd0d2345e61832a191d3b7bc121749118c31f725b8\": rpc error: code = NotFound desc = could not find container \"5fd190aa8f42f553a07308fd0d2345e61832a191d3b7bc121749118c31f725b8\": container with ID starting with 5fd190aa8f42f553a07308fd0d2345e61832a191d3b7bc121749118c31f725b8 not found: ID does not exist"
Jul 14 19:41:37.531698 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:41:37.531641    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-102a2069-658486d9fd-hbl95"]
Jul 14 19:41:37.533966 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:41:37.533947    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-102a2069-658486d9fd-hbl95"]
Jul 14 19:41:37.969777 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:41:37.969750    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="18b90637-62c0-4b99-a5af-a44011c10aca" path="/var/lib/kubelet/pods/18b90637-62c0-4b99-a5af-a44011c10aca/volumes"
Jul 14 19:41:53.720236 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:41:53.720203    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-0bc32ee5-6979c6fdd7-clz9t"]
Jul 14 19:41:53.720689 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:41:53.720636    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="18b90637-62c0-4b99-a5af-a44011c10aca" containerName="maas-api"
Jul 14 19:41:53.720689 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:41:53.720650    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="18b90637-62c0-4b99-a5af-a44011c10aca" containerName="maas-api"
Jul 14 19:41:53.720778 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:41:53.720730    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="18b90637-62c0-4b99-a5af-a44011c10aca" containerName="maas-api"
Jul 14 19:41:53.724961 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:41:53.724940    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-0bc32ee5-6979c6fdd7-clz9t"
Jul 14 19:41:53.727483 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:41:53.727464    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-migrate-0bc32ee5-serving-cert\""
Jul 14 19:41:53.735016 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:41:53.734996    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-0bc32ee5-6979c6fdd7-clz9t"]
Jul 14 19:41:53.810933 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:41:53.810907    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8dvwv\" (UniqueName: \"kubernetes.io/projected/62dfb18d-52b0-4d4a-b28d-96e8427f187c-kube-api-access-8dvwv\") pod \"maas-api-e2e-migrate-0bc32ee5-6979c6fdd7-clz9t\" (UID: \"62dfb18d-52b0-4d4a-b28d-96e8427f187c\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-0bc32ee5-6979c6fdd7-clz9t"
Jul 14 19:41:53.811056 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:41:53.810983    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/62dfb18d-52b0-4d4a-b28d-96e8427f187c-openshift-service-ca\") pod \"maas-api-e2e-migrate-0bc32ee5-6979c6fdd7-clz9t\" (UID: \"62dfb18d-52b0-4d4a-b28d-96e8427f187c\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-0bc32ee5-6979c6fdd7-clz9t"
Jul 14 19:41:53.811056 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:41:53.811028    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/62dfb18d-52b0-4d4a-b28d-96e8427f187c-maas-api-tls\") pod \"maas-api-e2e-migrate-0bc32ee5-6979c6fdd7-clz9t\" (UID: \"62dfb18d-52b0-4d4a-b28d-96e8427f187c\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-0bc32ee5-6979c6fdd7-clz9t"
Jul 14 19:41:53.911669 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:41:53.911643    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/62dfb18d-52b0-4d4a-b28d-96e8427f187c-openshift-service-ca\") pod \"maas-api-e2e-migrate-0bc32ee5-6979c6fdd7-clz9t\" (UID: \"62dfb18d-52b0-4d4a-b28d-96e8427f187c\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-0bc32ee5-6979c6fdd7-clz9t"
Jul 14 19:41:53.911814 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:41:53.911717    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/62dfb18d-52b0-4d4a-b28d-96e8427f187c-maas-api-tls\") pod \"maas-api-e2e-migrate-0bc32ee5-6979c6fdd7-clz9t\" (UID: \"62dfb18d-52b0-4d4a-b28d-96e8427f187c\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-0bc32ee5-6979c6fdd7-clz9t"
Jul 14 19:41:53.911814 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:41:53.911742    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8dvwv\" (UniqueName: \"kubernetes.io/projected/62dfb18d-52b0-4d4a-b28d-96e8427f187c-kube-api-access-8dvwv\") pod \"maas-api-e2e-migrate-0bc32ee5-6979c6fdd7-clz9t\" (UID: \"62dfb18d-52b0-4d4a-b28d-96e8427f187c\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-0bc32ee5-6979c6fdd7-clz9t"
Jul 14 19:41:53.912347 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:41:53.912325    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/62dfb18d-52b0-4d4a-b28d-96e8427f187c-openshift-service-ca\") pod \"maas-api-e2e-migrate-0bc32ee5-6979c6fdd7-clz9t\" (UID: \"62dfb18d-52b0-4d4a-b28d-96e8427f187c\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-0bc32ee5-6979c6fdd7-clz9t"
Jul 14 19:41:53.914475 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:41:53.914456    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-migrate-0bc32ee5-serving-cert\""
Jul 14 19:41:53.921555 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:41:53.921533    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8dvwv\" (UniqueName: \"kubernetes.io/projected/62dfb18d-52b0-4d4a-b28d-96e8427f187c-kube-api-access-8dvwv\") pod \"maas-api-e2e-migrate-0bc32ee5-6979c6fdd7-clz9t\" (UID: \"62dfb18d-52b0-4d4a-b28d-96e8427f187c\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-0bc32ee5-6979c6fdd7-clz9t"
Jul 14 19:41:53.924308 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:41:53.924292    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/62dfb18d-52b0-4d4a-b28d-96e8427f187c-maas-api-tls\") pod \"maas-api-e2e-migrate-0bc32ee5-6979c6fdd7-clz9t\" (UID: \"62dfb18d-52b0-4d4a-b28d-96e8427f187c\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-0bc32ee5-6979c6fdd7-clz9t"
Jul 14 19:41:54.038207 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:41:54.038106    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-0bc32ee5-6979c6fdd7-clz9t"
Jul 14 19:41:54.183105 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:41:54.183076    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-0bc32ee5-6979c6fdd7-clz9t"]
Jul 14 19:41:54.184024 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:41:54.183993    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62dfb18d_52b0_4d4a_b28d_96e8427f187c.slice/crio-1fd703a3144a5bf8ebf40b30c93b14bfef175ba4696c63c59ab545df5e6e9002 WatchSource:0}: Error finding container 1fd703a3144a5bf8ebf40b30c93b14bfef175ba4696c63c59ab545df5e6e9002: Status 404 returned error can't find the container with id 1fd703a3144a5bf8ebf40b30c93b14bfef175ba4696c63c59ab545df5e6e9002
Jul 14 19:41:54.607316 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:41:54.607215    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-0bc32ee5-6979c6fdd7-clz9t" event={"ID":"62dfb18d-52b0-4d4a-b28d-96e8427f187c","Type":"ContainerStarted","Data":"b159e876b90c4bcfce8455678108a2a78afaf941e637c8307debf25fd1dc0f5d"}
Jul 14 19:41:54.607443 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:41:54.607347    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-0bc32ee5-6979c6fdd7-clz9t"
Jul 14 19:41:54.607443 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:41:54.607404    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-0bc32ee5-6979c6fdd7-clz9t" event={"ID":"62dfb18d-52b0-4d4a-b28d-96e8427f187c","Type":"ContainerStarted","Data":"1fd703a3144a5bf8ebf40b30c93b14bfef175ba4696c63c59ab545df5e6e9002"}
Jul 14 19:41:54.628977 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:41:54.628933    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-0bc32ee5-6979c6fdd7-clz9t" podStartSLOduration=1.334435837 podStartE2EDuration="1.628920657s" totalImagesPullingTime="294.48482ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 19:41:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:41:54.625919472 +0000 UTC m=+1861.186776382" watchObservedRunningTime="2026-07-14 19:41:54.628920657 +0000 UTC m=+1861.189777551"
Jul 14 19:42:00.619344 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:42:00.619308    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-0bc32ee5-6979c6fdd7-clz9t"
Jul 14 19:42:08.566834 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:42:08.566802    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-0bc32ee5-6979c6fdd7-clz9t"]
Jul 14 19:42:08.567286 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:42:08.567010    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-0bc32ee5-6979c6fdd7-clz9t" podUID="62dfb18d-52b0-4d4a-b28d-96e8427f187c" containerName="maas-api" containerID="cri-o://b159e876b90c4bcfce8455678108a2a78afaf941e637c8307debf25fd1dc0f5d" gracePeriod=30
Jul 14 19:42:08.699226 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:42:08.699185    2565 generic.go:356] "Generic (PLEG): container finished" podID="62dfb18d-52b0-4d4a-b28d-96e8427f187c" containerID="b159e876b90c4bcfce8455678108a2a78afaf941e637c8307debf25fd1dc0f5d" exitCode=0
Jul 14 19:42:08.699378 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:42:08.699266    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-0bc32ee5-6979c6fdd7-clz9t" event={"ID":"62dfb18d-52b0-4d4a-b28d-96e8427f187c","Type":"ContainerDied","Data":"b159e876b90c4bcfce8455678108a2a78afaf941e637c8307debf25fd1dc0f5d"}
Jul 14 19:42:08.819660 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:42:08.819608    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-0bc32ee5-6979c6fdd7-clz9t"
Jul 14 19:42:08.950439 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:42:08.950405    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/62dfb18d-52b0-4d4a-b28d-96e8427f187c-openshift-service-ca\") pod \"62dfb18d-52b0-4d4a-b28d-96e8427f187c\" (UID: \"62dfb18d-52b0-4d4a-b28d-96e8427f187c\") "
Jul 14 19:42:08.950439 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:42:08.950438    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/62dfb18d-52b0-4d4a-b28d-96e8427f187c-maas-api-tls\") pod \"62dfb18d-52b0-4d4a-b28d-96e8427f187c\" (UID: \"62dfb18d-52b0-4d4a-b28d-96e8427f187c\") "
Jul 14 19:42:08.950682 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:42:08.950466    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8dvwv\" (UniqueName: \"kubernetes.io/projected/62dfb18d-52b0-4d4a-b28d-96e8427f187c-kube-api-access-8dvwv\") pod \"62dfb18d-52b0-4d4a-b28d-96e8427f187c\" (UID: \"62dfb18d-52b0-4d4a-b28d-96e8427f187c\") "
Jul 14 19:42:08.950839 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:42:08.950814    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/62dfb18d-52b0-4d4a-b28d-96e8427f187c-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "62dfb18d-52b0-4d4a-b28d-96e8427f187c" (UID: "62dfb18d-52b0-4d4a-b28d-96e8427f187c"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 19:42:08.952724 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:42:08.952701    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/62dfb18d-52b0-4d4a-b28d-96e8427f187c-kube-api-access-8dvwv" (OuterVolumeSpecName: "kube-api-access-8dvwv") pod "62dfb18d-52b0-4d4a-b28d-96e8427f187c" (UID: "62dfb18d-52b0-4d4a-b28d-96e8427f187c"). InnerVolumeSpecName "kube-api-access-8dvwv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 19:42:08.952828 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:42:08.952744    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/62dfb18d-52b0-4d4a-b28d-96e8427f187c-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "62dfb18d-52b0-4d4a-b28d-96e8427f187c" (UID: "62dfb18d-52b0-4d4a-b28d-96e8427f187c"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 19:42:09.051104 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:42:09.051079    2565 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/62dfb18d-52b0-4d4a-b28d-96e8427f187c-openshift-service-ca\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Jul 14 19:42:09.051104 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:42:09.051103    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/62dfb18d-52b0-4d4a-b28d-96e8427f187c-maas-api-tls\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Jul 14 19:42:09.051264 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:42:09.051113    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8dvwv\" (UniqueName: \"kubernetes.io/projected/62dfb18d-52b0-4d4a-b28d-96e8427f187c-kube-api-access-8dvwv\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Jul 14 19:42:09.706639 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:42:09.706611    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-0bc32ee5-6979c6fdd7-clz9t"
Jul 14 19:42:09.707114 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:42:09.706641    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-0bc32ee5-6979c6fdd7-clz9t" event={"ID":"62dfb18d-52b0-4d4a-b28d-96e8427f187c","Type":"ContainerDied","Data":"1fd703a3144a5bf8ebf40b30c93b14bfef175ba4696c63c59ab545df5e6e9002"}
Jul 14 19:42:09.707114 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:42:09.706710    2565 scope.go:117] "RemoveContainer" containerID="b159e876b90c4bcfce8455678108a2a78afaf941e637c8307debf25fd1dc0f5d"
Jul 14 19:42:09.729030 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:42:09.729004    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-0bc32ee5-6979c6fdd7-clz9t"]
Jul 14 19:42:09.735568 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:42:09.735547    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-0bc32ee5-6979c6fdd7-clz9t"]
Jul 14 19:42:09.969023 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:42:09.969000    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="62dfb18d-52b0-4d4a-b28d-96e8427f187c" path="/var/lib/kubelet/pods/62dfb18d-52b0-4d4a-b28d-96e8427f187c/volumes"
Jul 14 19:42:24.910300 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:42:24.910264    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-f61c44f4-6b67f984d7-l8qdq"]
Jul 14 19:42:24.910964 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:42:24.910945    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="62dfb18d-52b0-4d4a-b28d-96e8427f187c" containerName="maas-api"
Jul 14 19:42:24.910964 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:42:24.910965    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="62dfb18d-52b0-4d4a-b28d-96e8427f187c" containerName="maas-api"
Jul 14 19:42:24.911112 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:42:24.911078    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="62dfb18d-52b0-4d4a-b28d-96e8427f187c" containerName="maas-api"
Jul 14 19:42:24.915859 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:42:24.915839    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-f61c44f4-6b67f984d7-l8qdq"
Jul 14 19:42:24.918341 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:42:24.918315    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-f61c44f4-serving-cert\""
Jul 14 19:42:24.923462 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:42:24.923441    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-f61c44f4-6b67f984d7-l8qdq"]
Jul 14 19:42:24.980100 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:42:24.980071    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2f0cba1a-f385-4160-b165-975cef7e2e35-maas-api-tls\") pod \"maas-api-e2e-ait-f61c44f4-6b67f984d7-l8qdq\" (UID: \"2f0cba1a-f385-4160-b165-975cef7e2e35\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-f61c44f4-6b67f984d7-l8qdq"
Jul 14 19:42:24.980260 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:42:24.980112    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tktzt\" (UniqueName: \"kubernetes.io/projected/2f0cba1a-f385-4160-b165-975cef7e2e35-kube-api-access-tktzt\") pod \"maas-api-e2e-ait-f61c44f4-6b67f984d7-l8qdq\" (UID: \"2f0cba1a-f385-4160-b165-975cef7e2e35\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-f61c44f4-6b67f984d7-l8qdq"
Jul 14 19:42:24.980322 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:42:24.980290    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2f0cba1a-f385-4160-b165-975cef7e2e35-openshift-service-ca\") pod \"maas-api-e2e-ait-f61c44f4-6b67f984d7-l8qdq\" (UID: \"2f0cba1a-f385-4160-b165-975cef7e2e35\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-f61c44f4-6b67f984d7-l8qdq"
Jul 14 19:42:25.081373 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:42:25.081343    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2f0cba1a-f385-4160-b165-975cef7e2e35-maas-api-tls\") pod \"maas-api-e2e-ait-f61c44f4-6b67f984d7-l8qdq\" (UID: \"2f0cba1a-f385-4160-b165-975cef7e2e35\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-f61c44f4-6b67f984d7-l8qdq"
Jul 14 19:42:25.081548 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:42:25.081400    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tktzt\" (UniqueName: \"kubernetes.io/projected/2f0cba1a-f385-4160-b165-975cef7e2e35-kube-api-access-tktzt\") pod \"maas-api-e2e-ait-f61c44f4-6b67f984d7-l8qdq\" (UID: \"2f0cba1a-f385-4160-b165-975cef7e2e35\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-f61c44f4-6b67f984d7-l8qdq"
Jul 14 19:42:25.081548 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:42:25.081496    2565 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-f61c44f4-serving-cert: secret "maas-api-e2e-ait-f61c44f4-serving-cert" not found
Jul 14 19:42:25.081548 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:42:25.081540    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2f0cba1a-f385-4160-b165-975cef7e2e35-openshift-service-ca\") pod \"maas-api-e2e-ait-f61c44f4-6b67f984d7-l8qdq\" (UID: \"2f0cba1a-f385-4160-b165-975cef7e2e35\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-f61c44f4-6b67f984d7-l8qdq"
Jul 14 19:42:25.081788 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:42:25.081567    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2f0cba1a-f385-4160-b165-975cef7e2e35-maas-api-tls podName:2f0cba1a-f385-4160-b165-975cef7e2e35 nodeName:}" failed. No retries permitted until 2026-07-14 19:42:25.581552198 +0000 UTC m=+1892.142409069 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/2f0cba1a-f385-4160-b165-975cef7e2e35-maas-api-tls") pod "maas-api-e2e-ait-f61c44f4-6b67f984d7-l8qdq" (UID: "2f0cba1a-f385-4160-b165-975cef7e2e35") : secret "maas-api-e2e-ait-f61c44f4-serving-cert" not found
Jul 14 19:42:25.082184 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:42:25.082142    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2f0cba1a-f385-4160-b165-975cef7e2e35-openshift-service-ca\") pod \"maas-api-e2e-ait-f61c44f4-6b67f984d7-l8qdq\" (UID: \"2f0cba1a-f385-4160-b165-975cef7e2e35\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-f61c44f4-6b67f984d7-l8qdq"
Jul 14 19:42:25.096951 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:42:25.096913    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tktzt\" (UniqueName: \"kubernetes.io/projected/2f0cba1a-f385-4160-b165-975cef7e2e35-kube-api-access-tktzt\") pod \"maas-api-e2e-ait-f61c44f4-6b67f984d7-l8qdq\" (UID: \"2f0cba1a-f385-4160-b165-975cef7e2e35\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-f61c44f4-6b67f984d7-l8qdq"
Jul 14 19:42:25.586892 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:42:25.586860    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2f0cba1a-f385-4160-b165-975cef7e2e35-maas-api-tls\") pod \"maas-api-e2e-ait-f61c44f4-6b67f984d7-l8qdq\" (UID: \"2f0cba1a-f385-4160-b165-975cef7e2e35\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-f61c44f4-6b67f984d7-l8qdq"
Jul 14 19:42:25.589509 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:42:25.589485    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2f0cba1a-f385-4160-b165-975cef7e2e35-maas-api-tls\") pod \"maas-api-e2e-ait-f61c44f4-6b67f984d7-l8qdq\" (UID: \"2f0cba1a-f385-4160-b165-975cef7e2e35\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-f61c44f4-6b67f984d7-l8qdq"
Jul 14 19:42:25.829068 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:42:25.829032    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-f61c44f4-6b67f984d7-l8qdq"
Jul 14 19:42:25.971173 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:42:25.971128    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-f61c44f4-6b67f984d7-l8qdq"]
Jul 14 19:42:25.974429 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:42:25.974400    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f0cba1a_f385_4160_b165_975cef7e2e35.slice/crio-d7d57b458c589e41f4c1ecba93375a0c78ae6440377908d299dcc43e4177800b WatchSource:0}: Error finding container d7d57b458c589e41f4c1ecba93375a0c78ae6440377908d299dcc43e4177800b: Status 404 returned error can't find the container with id d7d57b458c589e41f4c1ecba93375a0c78ae6440377908d299dcc43e4177800b
Jul 14 19:42:26.811556 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:42:26.811514    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-f61c44f4-6b67f984d7-l8qdq" event={"ID":"2f0cba1a-f385-4160-b165-975cef7e2e35","Type":"ContainerStarted","Data":"306488f678a34418040f43a66e6535323e14b6f055a7d8d3a635d3381a695662"}
Jul 14 19:42:26.811704 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:42:26.811606    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-f61c44f4-6b67f984d7-l8qdq" event={"ID":"2f0cba1a-f385-4160-b165-975cef7e2e35","Type":"ContainerStarted","Data":"d7d57b458c589e41f4c1ecba93375a0c78ae6440377908d299dcc43e4177800b"}
Jul 14 19:42:26.811704 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:42:26.811649    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-f61c44f4-6b67f984d7-l8qdq"
Jul 14 19:42:26.831503 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:42:26.831456    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-f61c44f4-6b67f984d7-l8qdq" podStartSLOduration=2.404336645 podStartE2EDuration="2.831440308s" totalImagesPullingTime="427.103663ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 19:42:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:42:26.830217243 +0000 UTC m=+1893.391074146" watchObservedRunningTime="2026-07-14 19:42:26.831440308 +0000 UTC m=+1893.392297203"
Jul 14 19:42:32.825104 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:42:32.825071    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-f61c44f4-6b67f984d7-l8qdq"
Jul 14 19:42:40.403282 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:42:40.403249    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-f61c44f4-6b67f984d7-l8qdq"]
Jul 14 19:42:40.403736 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:42:40.403492    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-f61c44f4-6b67f984d7-l8qdq" podUID="2f0cba1a-f385-4160-b165-975cef7e2e35" containerName="maas-api" containerID="cri-o://306488f678a34418040f43a66e6535323e14b6f055a7d8d3a635d3381a695662" gracePeriod=30
Jul 14 19:42:40.662014 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:42:40.661961    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-f61c44f4-6b67f984d7-l8qdq"
Jul 14 19:42:40.711774 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:42:40.711747    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2f0cba1a-f385-4160-b165-975cef7e2e35-openshift-service-ca\") pod \"2f0cba1a-f385-4160-b165-975cef7e2e35\" (UID: \"2f0cba1a-f385-4160-b165-975cef7e2e35\") "
Jul 14 19:42:40.711884 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:42:40.711790    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2f0cba1a-f385-4160-b165-975cef7e2e35-maas-api-tls\") pod \"2f0cba1a-f385-4160-b165-975cef7e2e35\" (UID: \"2f0cba1a-f385-4160-b165-975cef7e2e35\") "
Jul 14 19:42:40.711927 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:42:40.711909    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tktzt\" (UniqueName: \"kubernetes.io/projected/2f0cba1a-f385-4160-b165-975cef7e2e35-kube-api-access-tktzt\") pod \"2f0cba1a-f385-4160-b165-975cef7e2e35\" (UID: \"2f0cba1a-f385-4160-b165-975cef7e2e35\") "
Jul 14 19:42:40.712136 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:42:40.712109    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2f0cba1a-f385-4160-b165-975cef7e2e35-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "2f0cba1a-f385-4160-b165-975cef7e2e35" (UID: "2f0cba1a-f385-4160-b165-975cef7e2e35"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 19:42:40.713924 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:42:40.713902    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2f0cba1a-f385-4160-b165-975cef7e2e35-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "2f0cba1a-f385-4160-b165-975cef7e2e35" (UID: "2f0cba1a-f385-4160-b165-975cef7e2e35"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 19:42:40.714034 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:42:40.714021    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2f0cba1a-f385-4160-b165-975cef7e2e35-kube-api-access-tktzt" (OuterVolumeSpecName: "kube-api-access-tktzt") pod "2f0cba1a-f385-4160-b165-975cef7e2e35" (UID: "2f0cba1a-f385-4160-b165-975cef7e2e35"). InnerVolumeSpecName "kube-api-access-tktzt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 19:42:40.813352 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:42:40.813329    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2f0cba1a-f385-4160-b165-975cef7e2e35-maas-api-tls\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Jul 14 19:42:40.813352 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:42:40.813350    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tktzt\" (UniqueName: \"kubernetes.io/projected/2f0cba1a-f385-4160-b165-975cef7e2e35-kube-api-access-tktzt\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Jul 14 19:42:40.813497 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:42:40.813359    2565 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2f0cba1a-f385-4160-b165-975cef7e2e35-openshift-service-ca\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Jul 14 19:42:40.899320 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:42:40.899286    2565 generic.go:356] "Generic (PLEG): container finished" podID="2f0cba1a-f385-4160-b165-975cef7e2e35" containerID="306488f678a34418040f43a66e6535323e14b6f055a7d8d3a635d3381a695662" exitCode=0
Jul 14 19:42:40.899430 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:42:40.899328    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-f61c44f4-6b67f984d7-l8qdq"
Jul 14 19:42:40.899430 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:42:40.899378    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-f61c44f4-6b67f984d7-l8qdq" event={"ID":"2f0cba1a-f385-4160-b165-975cef7e2e35","Type":"ContainerDied","Data":"306488f678a34418040f43a66e6535323e14b6f055a7d8d3a635d3381a695662"}
Jul 14 19:42:40.899430 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:42:40.899421    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-f61c44f4-6b67f984d7-l8qdq" event={"ID":"2f0cba1a-f385-4160-b165-975cef7e2e35","Type":"ContainerDied","Data":"d7d57b458c589e41f4c1ecba93375a0c78ae6440377908d299dcc43e4177800b"}
Jul 14 19:42:40.899555 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:42:40.899442    2565 scope.go:117] "RemoveContainer" containerID="306488f678a34418040f43a66e6535323e14b6f055a7d8d3a635d3381a695662"
Jul 14 19:42:40.909031 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:42:40.909015    2565 scope.go:117] "RemoveContainer" containerID="306488f678a34418040f43a66e6535323e14b6f055a7d8d3a635d3381a695662"
Jul 14 19:42:40.909323 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:42:40.909305    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"306488f678a34418040f43a66e6535323e14b6f055a7d8d3a635d3381a695662\": container with ID starting with 306488f678a34418040f43a66e6535323e14b6f055a7d8d3a635d3381a695662 not found: ID does not exist" containerID="306488f678a34418040f43a66e6535323e14b6f055a7d8d3a635d3381a695662"
Jul 14 19:42:40.909395 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:42:40.909334    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"306488f678a34418040f43a66e6535323e14b6f055a7d8d3a635d3381a695662"} err="failed to get container status \"306488f678a34418040f43a66e6535323e14b6f055a7d8d3a635d3381a695662\": rpc error: code = NotFound desc = could not find container \"306488f678a34418040f43a66e6535323e14b6f055a7d8d3a635d3381a695662\": container with ID starting with 306488f678a34418040f43a66e6535323e14b6f055a7d8d3a635d3381a695662 not found: ID does not exist"
Jul 14 19:42:40.922308 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:42:40.922257    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-f61c44f4-6b67f984d7-l8qdq"]
Jul 14 19:42:40.924585 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:42:40.924566    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-f61c44f4-6b67f984d7-l8qdq"]
Jul 14 19:42:41.968906 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:42:41.968868    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2f0cba1a-f385-4160-b165-975cef7e2e35" path="/var/lib/kubelet/pods/2f0cba1a-f385-4160-b165-975cef7e2e35/volumes"
Jul 14 19:42:58.074943 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:42:58.074910    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-9d072882-67c5dfb594-4d6gk"]
Jul 14 19:42:58.075463 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:42:58.075363    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2f0cba1a-f385-4160-b165-975cef7e2e35" containerName="maas-api"
Jul 14 19:42:58.075463 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:42:58.075375    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="2f0cba1a-f385-4160-b165-975cef7e2e35" containerName="maas-api"
Jul 14 19:42:58.075463 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:42:58.075459    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="2f0cba1a-f385-4160-b165-975cef7e2e35" containerName="maas-api"
Jul 14 19:42:58.079639 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:42:58.079621    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-9d072882-67c5dfb594-4d6gk"
Jul 14 19:42:58.082680 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:42:58.082660    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-9d072882-serving-cert\""
Jul 14 19:42:58.095640 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:42:58.095620    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-9d072882-67c5dfb594-4d6gk"]
Jul 14 19:42:58.158259 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:42:58.158230    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/65b6569f-ac52-40e6-9f42-c3ec0f1a181e-maas-api-tls\") pod \"maas-api-e2e-derive-9d072882-67c5dfb594-4d6gk\" (UID: \"65b6569f-ac52-40e6-9f42-c3ec0f1a181e\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-9d072882-67c5dfb594-4d6gk"
Jul 14 19:42:58.158362 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:42:58.158300    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dh4jf\" (UniqueName: \"kubernetes.io/projected/65b6569f-ac52-40e6-9f42-c3ec0f1a181e-kube-api-access-dh4jf\") pod \"maas-api-e2e-derive-9d072882-67c5dfb594-4d6gk\" (UID: \"65b6569f-ac52-40e6-9f42-c3ec0f1a181e\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-9d072882-67c5dfb594-4d6gk"
Jul 14 19:42:58.158421 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:42:58.158403    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/65b6569f-ac52-40e6-9f42-c3ec0f1a181e-openshift-service-ca\") pod \"maas-api-e2e-derive-9d072882-67c5dfb594-4d6gk\" (UID: \"65b6569f-ac52-40e6-9f42-c3ec0f1a181e\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-9d072882-67c5dfb594-4d6gk"
Jul 14 19:42:58.259588 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:42:58.259548    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/65b6569f-ac52-40e6-9f42-c3ec0f1a181e-openshift-service-ca\") pod \"maas-api-e2e-derive-9d072882-67c5dfb594-4d6gk\" (UID: \"65b6569f-ac52-40e6-9f42-c3ec0f1a181e\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-9d072882-67c5dfb594-4d6gk"
Jul 14 19:42:58.259725 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:42:58.259608    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/65b6569f-ac52-40e6-9f42-c3ec0f1a181e-maas-api-tls\") pod \"maas-api-e2e-derive-9d072882-67c5dfb594-4d6gk\" (UID: \"65b6569f-ac52-40e6-9f42-c3ec0f1a181e\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-9d072882-67c5dfb594-4d6gk"
Jul 14 19:42:58.259725 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:42:58.259662    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dh4jf\" (UniqueName: \"kubernetes.io/projected/65b6569f-ac52-40e6-9f42-c3ec0f1a181e-kube-api-access-dh4jf\") pod \"maas-api-e2e-derive-9d072882-67c5dfb594-4d6gk\" (UID: \"65b6569f-ac52-40e6-9f42-c3ec0f1a181e\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-9d072882-67c5dfb594-4d6gk"
Jul 14 19:42:58.260296 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:42:58.260277    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/65b6569f-ac52-40e6-9f42-c3ec0f1a181e-openshift-service-ca\") pod \"maas-api-e2e-derive-9d072882-67c5dfb594-4d6gk\" (UID: \"65b6569f-ac52-40e6-9f42-c3ec0f1a181e\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-9d072882-67c5dfb594-4d6gk"
Jul 14 19:42:58.262304 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:42:58.262283    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/65b6569f-ac52-40e6-9f42-c3ec0f1a181e-maas-api-tls\") pod \"maas-api-e2e-derive-9d072882-67c5dfb594-4d6gk\" (UID: \"65b6569f-ac52-40e6-9f42-c3ec0f1a181e\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-9d072882-67c5dfb594-4d6gk"
Jul 14 19:42:58.270885 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:42:58.270858    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dh4jf\" (UniqueName: \"kubernetes.io/projected/65b6569f-ac52-40e6-9f42-c3ec0f1a181e-kube-api-access-dh4jf\") pod \"maas-api-e2e-derive-9d072882-67c5dfb594-4d6gk\" (UID: \"65b6569f-ac52-40e6-9f42-c3ec0f1a181e\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-9d072882-67c5dfb594-4d6gk"
Jul 14 19:42:58.390104 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:42:58.390031    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-9d072882-67c5dfb594-4d6gk"
Jul 14 19:42:58.535972 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:42:58.535942    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-9d072882-67c5dfb594-4d6gk"]
Jul 14 19:42:58.537059 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:42:58.537036    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65b6569f_ac52_40e6_9f42_c3ec0f1a181e.slice/crio-3db060aebed2c473d613789da3364555a010d16c32ce9a8a6002272422ae30ec WatchSource:0}: Error finding container 3db060aebed2c473d613789da3364555a010d16c32ce9a8a6002272422ae30ec: Status 404 returned error can't find the container with id 3db060aebed2c473d613789da3364555a010d16c32ce9a8a6002272422ae30ec
Jul 14 19:42:59.007108 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:42:59.007068    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-9d072882-67c5dfb594-4d6gk" event={"ID":"65b6569f-ac52-40e6-9f42-c3ec0f1a181e","Type":"ContainerStarted","Data":"3db060aebed2c473d613789da3364555a010d16c32ce9a8a6002272422ae30ec"}
Jul 14 19:43:00.014415 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:43:00.014375    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-9d072882-67c5dfb594-4d6gk" event={"ID":"65b6569f-ac52-40e6-9f42-c3ec0f1a181e","Type":"ContainerStarted","Data":"19afbc265dc8f41b1e59a86c06f327ff1d5a9cc7499f9a26b580104b019a02fb"}
Jul 14 19:43:00.014802 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:43:00.014444    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-9d072882-67c5dfb594-4d6gk"
Jul 14 19:43:00.034536 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:43:00.034487    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-9d072882-67c5dfb594-4d6gk" podStartSLOduration=1.312855484 podStartE2EDuration="2.034471598s" totalImagesPullingTime="721.616114ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 19:42:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:43:00.03303336 +0000 UTC m=+1926.593890276" watchObservedRunningTime="2026-07-14 19:43:00.034471598 +0000 UTC m=+1926.595328490"
Jul 14 19:43:06.025901 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:43:06.025873    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-9d072882-67c5dfb594-4d6gk"
Jul 14 19:44:02.691321 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:44:02.691239    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-9d072882-67c5dfb594-4d6gk"]
Jul 14 19:44:02.691877 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:44:02.691435    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-9d072882-67c5dfb594-4d6gk" podUID="65b6569f-ac52-40e6-9f42-c3ec0f1a181e" containerName="maas-api" containerID="cri-o://19afbc265dc8f41b1e59a86c06f327ff1d5a9cc7499f9a26b580104b019a02fb" gracePeriod=30
Jul 14 19:44:02.948543 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:44:02.948484    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-9d072882-67c5dfb594-4d6gk"
Jul 14 19:44:03.086961 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:44:03.086929    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dh4jf\" (UniqueName: \"kubernetes.io/projected/65b6569f-ac52-40e6-9f42-c3ec0f1a181e-kube-api-access-dh4jf\") pod \"65b6569f-ac52-40e6-9f42-c3ec0f1a181e\" (UID: \"65b6569f-ac52-40e6-9f42-c3ec0f1a181e\") "
Jul 14 19:44:03.087131 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:44:03.087024    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/65b6569f-ac52-40e6-9f42-c3ec0f1a181e-maas-api-tls\") pod \"65b6569f-ac52-40e6-9f42-c3ec0f1a181e\" (UID: \"65b6569f-ac52-40e6-9f42-c3ec0f1a181e\") "
Jul 14 19:44:03.087131 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:44:03.087042    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/65b6569f-ac52-40e6-9f42-c3ec0f1a181e-openshift-service-ca\") pod \"65b6569f-ac52-40e6-9f42-c3ec0f1a181e\" (UID: \"65b6569f-ac52-40e6-9f42-c3ec0f1a181e\") "
Jul 14 19:44:03.087587 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:44:03.087555    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/65b6569f-ac52-40e6-9f42-c3ec0f1a181e-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "65b6569f-ac52-40e6-9f42-c3ec0f1a181e" (UID: "65b6569f-ac52-40e6-9f42-c3ec0f1a181e"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 19:44:03.089325 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:44:03.089298    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/65b6569f-ac52-40e6-9f42-c3ec0f1a181e-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "65b6569f-ac52-40e6-9f42-c3ec0f1a181e" (UID: "65b6569f-ac52-40e6-9f42-c3ec0f1a181e"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 19:44:03.089449 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:44:03.089341    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/65b6569f-ac52-40e6-9f42-c3ec0f1a181e-kube-api-access-dh4jf" (OuterVolumeSpecName: "kube-api-access-dh4jf") pod "65b6569f-ac52-40e6-9f42-c3ec0f1a181e" (UID: "65b6569f-ac52-40e6-9f42-c3ec0f1a181e"). InnerVolumeSpecName "kube-api-access-dh4jf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 19:44:03.188292 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:44:03.188260    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dh4jf\" (UniqueName: \"kubernetes.io/projected/65b6569f-ac52-40e6-9f42-c3ec0f1a181e-kube-api-access-dh4jf\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Jul 14 19:44:03.188292 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:44:03.188288    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/65b6569f-ac52-40e6-9f42-c3ec0f1a181e-maas-api-tls\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Jul 14 19:44:03.188469 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:44:03.188301    2565 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/65b6569f-ac52-40e6-9f42-c3ec0f1a181e-openshift-service-ca\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Jul 14 19:44:03.389267 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:44:03.389228    2565 generic.go:356] "Generic (PLEG): container finished" podID="65b6569f-ac52-40e6-9f42-c3ec0f1a181e" containerID="19afbc265dc8f41b1e59a86c06f327ff1d5a9cc7499f9a26b580104b019a02fb" exitCode=0
Jul 14 19:44:03.389445 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:44:03.389296    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-9d072882-67c5dfb594-4d6gk"
Jul 14 19:44:03.389445 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:44:03.389323    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-9d072882-67c5dfb594-4d6gk" event={"ID":"65b6569f-ac52-40e6-9f42-c3ec0f1a181e","Type":"ContainerDied","Data":"19afbc265dc8f41b1e59a86c06f327ff1d5a9cc7499f9a26b580104b019a02fb"}
Jul 14 19:44:03.389445 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:44:03.389429    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-9d072882-67c5dfb594-4d6gk" event={"ID":"65b6569f-ac52-40e6-9f42-c3ec0f1a181e","Type":"ContainerDied","Data":"3db060aebed2c473d613789da3364555a010d16c32ce9a8a6002272422ae30ec"}
Jul 14 19:44:03.389556 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:44:03.389445    2565 scope.go:117] "RemoveContainer" containerID="19afbc265dc8f41b1e59a86c06f327ff1d5a9cc7499f9a26b580104b019a02fb"
Jul 14 19:44:03.401580 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:44:03.401561    2565 scope.go:117] "RemoveContainer" containerID="19afbc265dc8f41b1e59a86c06f327ff1d5a9cc7499f9a26b580104b019a02fb"
Jul 14 19:44:03.401893 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:44:03.401865    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"19afbc265dc8f41b1e59a86c06f327ff1d5a9cc7499f9a26b580104b019a02fb\": container with ID starting with 19afbc265dc8f41b1e59a86c06f327ff1d5a9cc7499f9a26b580104b019a02fb not found: ID does not exist" containerID="19afbc265dc8f41b1e59a86c06f327ff1d5a9cc7499f9a26b580104b019a02fb"
Jul 14 19:44:03.401990 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:44:03.401901    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"19afbc265dc8f41b1e59a86c06f327ff1d5a9cc7499f9a26b580104b019a02fb"} err="failed to get container status \"19afbc265dc8f41b1e59a86c06f327ff1d5a9cc7499f9a26b580104b019a02fb\": rpc error: code = NotFound desc = could not find container \"19afbc265dc8f41b1e59a86c06f327ff1d5a9cc7499f9a26b580104b019a02fb\": container with ID starting with 19afbc265dc8f41b1e59a86c06f327ff1d5a9cc7499f9a26b580104b019a02fb not found: ID does not exist"
Jul 14 19:44:03.412877 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:44:03.412845    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-9d072882-67c5dfb594-4d6gk"]
Jul 14 19:44:03.416822 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:44:03.416803    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-9d072882-67c5dfb594-4d6gk"]
Jul 14 19:44:03.969567 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:44:03.969536    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="65b6569f-ac52-40e6-9f42-c3ec0f1a181e" path="/var/lib/kubelet/pods/65b6569f-ac52-40e6-9f42-c3ec0f1a181e/volumes"
Jul 14 19:45:00.158995 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:45:00.158956    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29734305-84vvm"]
Jul 14 19:45:00.159585 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:45:00.159565    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="65b6569f-ac52-40e6-9f42-c3ec0f1a181e" containerName="maas-api"
Jul 14 19:45:00.159676 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:45:00.159588    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="65b6569f-ac52-40e6-9f42-c3ec0f1a181e" containerName="maas-api"
Jul 14 19:45:00.159737 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:45:00.159715    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="65b6569f-ac52-40e6-9f42-c3ec0f1a181e" containerName="maas-api"
Jul 14 19:45:00.162839 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:45:00.162816    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29734305-84vvm"
Jul 14 19:45:00.166002 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:45:00.165984    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-br5f6\""
Jul 14 19:45:00.172740 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:45:00.172721    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29734305-84vvm"
Jul 14 19:45:00.174338 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:45:00.174319    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29734305-84vvm"]
Jul 14 19:45:00.515185 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:45:00.515141    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29734305-84vvm"]
Jul 14 19:45:00.517356 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:45:00.517329    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podedba4ece_28c7_4c4d_96f3_6448601ffcd0.slice/crio-231b112a33e9e4aabcf37282c3c70ed756c4fb4cacf1751abcd4ff898e9e33f2 WatchSource:0}: Error finding container 231b112a33e9e4aabcf37282c3c70ed756c4fb4cacf1751abcd4ff898e9e33f2: Status 404 returned error can't find the container with id 231b112a33e9e4aabcf37282c3c70ed756c4fb4cacf1751abcd4ff898e9e33f2
Jul 14 19:45:00.709911 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:45:00.709878    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29734305-84vvm" event={"ID":"edba4ece-28c7-4c4d-96f3-6448601ffcd0","Type":"ContainerStarted","Data":"231b112a33e9e4aabcf37282c3c70ed756c4fb4cacf1751abcd4ff898e9e33f2"}
Jul 14 19:45:01.716689 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:45:01.716608    2565 generic.go:356] "Generic (PLEG): container finished" podID="edba4ece-28c7-4c4d-96f3-6448601ffcd0" containerID="1f114a66e36041e85a910deca40968a59cb66e9d4dd0b51d19ad2e104194edb3" exitCode=0
Jul 14 19:45:01.716998 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:45:01.716698    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29734305-84vvm" event={"ID":"edba4ece-28c7-4c4d-96f3-6448601ffcd0","Type":"ContainerDied","Data":"1f114a66e36041e85a910deca40968a59cb66e9d4dd0b51d19ad2e104194edb3"}
Jul 14 19:45:02.858810 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:45:02.858787    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29734305-84vvm"
Jul 14 19:45:03.728914 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:45:03.728884    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29734305-84vvm"
Jul 14 19:45:03.729068 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:45:03.728934    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29734305-84vvm" event={"ID":"edba4ece-28c7-4c4d-96f3-6448601ffcd0","Type":"ContainerDied","Data":"231b112a33e9e4aabcf37282c3c70ed756c4fb4cacf1751abcd4ff898e9e33f2"}
Jul 14 19:45:03.729068 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:45:03.728979    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="231b112a33e9e4aabcf37282c3c70ed756c4fb4cacf1751abcd4ff898e9e33f2"
Jul 14 19:45:54.367735 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:45:54.367694    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-p5lb5_7ab60b2b-a644-4e35-b8b1-49c676e0f63f/console-operator/1.log"
Jul 14 19:45:54.371660 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:45:54.371639    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cqqv8_7a447cf6-9373-4497-8028-97d590f38262/ovn-acl-logging/0.log"
Jul 14 19:45:54.372137 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:45:54.372108    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-p5lb5_7ab60b2b-a644-4e35-b8b1-49c676e0f63f/console-operator/1.log"
Jul 14 19:45:54.375327 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:45:54.375309    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cqqv8_7a447cf6-9373-4497-8028-97d590f38262/ovn-acl-logging/0.log"
Jul 14 19:46:00.489604 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:46:00.489568    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-9b84c5bc-54c6c986f6-7nr4h"]
Jul 14 19:46:00.490003 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:46:00.489993    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="edba4ece-28c7-4c4d-96f3-6448601ffcd0" containerName="cleanup"
Jul 14 19:46:00.490058 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:46:00.490005    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="edba4ece-28c7-4c4d-96f3-6448601ffcd0" containerName="cleanup"
Jul 14 19:46:00.490094 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:46:00.490089    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="edba4ece-28c7-4c4d-96f3-6448601ffcd0" containerName="cleanup"
Jul 14 19:46:00.493237 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:46:00.493221    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-9b84c5bc-54c6c986f6-7nr4h"
Jul 14 19:46:00.496399 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:46:00.496374    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-9b84c5bc-serving-cert\""
Jul 14 19:46:00.529188 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:46:00.529165    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-9b84c5bc-54c6c986f6-7nr4h"]
Jul 14 19:46:00.647123 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:46:00.647091    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9b4245ac-b2d0-4e3e-a102-117bea11fe11-maas-api-tls\") pod \"maas-api-e2e-mt-9b84c5bc-54c6c986f6-7nr4h\" (UID: \"9b4245ac-b2d0-4e3e-a102-117bea11fe11\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-9b84c5bc-54c6c986f6-7nr4h"
Jul 14 19:46:00.647290 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:46:00.647137    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cdctv\" (UniqueName: \"kubernetes.io/projected/9b4245ac-b2d0-4e3e-a102-117bea11fe11-kube-api-access-cdctv\") pod \"maas-api-e2e-mt-9b84c5bc-54c6c986f6-7nr4h\" (UID: \"9b4245ac-b2d0-4e3e-a102-117bea11fe11\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-9b84c5bc-54c6c986f6-7nr4h"
Jul 14 19:46:00.647290 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:46:00.647178    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9b4245ac-b2d0-4e3e-a102-117bea11fe11-openshift-service-ca\") pod \"maas-api-e2e-mt-9b84c5bc-54c6c986f6-7nr4h\" (UID: \"9b4245ac-b2d0-4e3e-a102-117bea11fe11\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-9b84c5bc-54c6c986f6-7nr4h"
Jul 14 19:46:00.748254 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:46:00.748186    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9b4245ac-b2d0-4e3e-a102-117bea11fe11-maas-api-tls\") pod \"maas-api-e2e-mt-9b84c5bc-54c6c986f6-7nr4h\" (UID: \"9b4245ac-b2d0-4e3e-a102-117bea11fe11\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-9b84c5bc-54c6c986f6-7nr4h"
Jul 14 19:46:00.748254 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:46:00.748229    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cdctv\" (UniqueName: \"kubernetes.io/projected/9b4245ac-b2d0-4e3e-a102-117bea11fe11-kube-api-access-cdctv\") pod \"maas-api-e2e-mt-9b84c5bc-54c6c986f6-7nr4h\" (UID: \"9b4245ac-b2d0-4e3e-a102-117bea11fe11\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-9b84c5bc-54c6c986f6-7nr4h"
Jul 14 19:46:00.748254 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:46:00.748249    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9b4245ac-b2d0-4e3e-a102-117bea11fe11-openshift-service-ca\") pod \"maas-api-e2e-mt-9b84c5bc-54c6c986f6-7nr4h\" (UID: \"9b4245ac-b2d0-4e3e-a102-117bea11fe11\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-9b84c5bc-54c6c986f6-7nr4h"
Jul 14 19:46:00.748460 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:46:00.748328    2565 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-9b84c5bc-serving-cert: secret "maas-api-e2e-mt-9b84c5bc-serving-cert" not found
Jul 14 19:46:00.748460 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:46:00.748396    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9b4245ac-b2d0-4e3e-a102-117bea11fe11-maas-api-tls podName:9b4245ac-b2d0-4e3e-a102-117bea11fe11 nodeName:}" failed. No retries permitted until 2026-07-14 19:46:01.248381685 +0000 UTC m=+2107.809238555 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/9b4245ac-b2d0-4e3e-a102-117bea11fe11-maas-api-tls") pod "maas-api-e2e-mt-9b84c5bc-54c6c986f6-7nr4h" (UID: "9b4245ac-b2d0-4e3e-a102-117bea11fe11") : secret "maas-api-e2e-mt-9b84c5bc-serving-cert" not found
Jul 14 19:46:00.748817 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:46:00.748801    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9b4245ac-b2d0-4e3e-a102-117bea11fe11-openshift-service-ca\") pod \"maas-api-e2e-mt-9b84c5bc-54c6c986f6-7nr4h\" (UID: \"9b4245ac-b2d0-4e3e-a102-117bea11fe11\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-9b84c5bc-54c6c986f6-7nr4h"
Jul 14 19:46:00.757802 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:46:00.757776    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cdctv\" (UniqueName: \"kubernetes.io/projected/9b4245ac-b2d0-4e3e-a102-117bea11fe11-kube-api-access-cdctv\") pod \"maas-api-e2e-mt-9b84c5bc-54c6c986f6-7nr4h\" (UID: \"9b4245ac-b2d0-4e3e-a102-117bea11fe11\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-9b84c5bc-54c6c986f6-7nr4h"
Jul 14 19:46:01.254140 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:46:01.254107    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9b4245ac-b2d0-4e3e-a102-117bea11fe11-maas-api-tls\") pod \"maas-api-e2e-mt-9b84c5bc-54c6c986f6-7nr4h\" (UID: \"9b4245ac-b2d0-4e3e-a102-117bea11fe11\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-9b84c5bc-54c6c986f6-7nr4h"
Jul 14 19:46:01.256630 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:46:01.256601    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9b4245ac-b2d0-4e3e-a102-117bea11fe11-maas-api-tls\") pod \"maas-api-e2e-mt-9b84c5bc-54c6c986f6-7nr4h\" (UID: \"9b4245ac-b2d0-4e3e-a102-117bea11fe11\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-9b84c5bc-54c6c986f6-7nr4h"
Jul 14 19:46:01.403922 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:46:01.403888    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-9b84c5bc-54c6c986f6-7nr4h"
Jul 14 19:46:01.551569 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:46:01.551531    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-9b84c5bc-54c6c986f6-7nr4h"]
Jul 14 19:46:01.553674 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:46:01.553645    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b4245ac_b2d0_4e3e_a102_117bea11fe11.slice/crio-d41bf98632e47cb7bf9df42e9f4304600aac45f33613564a93f8f08a4d50c542 WatchSource:0}: Error finding container d41bf98632e47cb7bf9df42e9f4304600aac45f33613564a93f8f08a4d50c542: Status 404 returned error can't find the container with id d41bf98632e47cb7bf9df42e9f4304600aac45f33613564a93f8f08a4d50c542
Jul 14 19:46:02.075913 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:46:02.075873    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-9b84c5bc-54c6c986f6-7nr4h" event={"ID":"9b4245ac-b2d0-4e3e-a102-117bea11fe11","Type":"ContainerStarted","Data":"d41bf98632e47cb7bf9df42e9f4304600aac45f33613564a93f8f08a4d50c542"}
Jul 14 19:46:04.089419 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:46:04.089381    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-9b84c5bc-54c6c986f6-7nr4h" event={"ID":"9b4245ac-b2d0-4e3e-a102-117bea11fe11","Type":"ContainerStarted","Data":"a93abb39126fbb6ec669891d8d3d74844579fd3b8a0b4705d19bcc7f45d581ce"}
Jul 14 19:46:04.089798 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:46:04.089468    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-9b84c5bc-54c6c986f6-7nr4h"
Jul 14 19:46:04.106676 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:46:04.106605    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-9b84c5bc-54c6c986f6-7nr4h" podStartSLOduration=1.786830185 podStartE2EDuration="4.106578936s" totalImagesPullingTime="2.319748751s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 19:46:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:46:04.10632391 +0000 UTC m=+2110.667180803" watchObservedRunningTime="2026-07-14 19:46:04.106578936 +0000 UTC m=+2110.667435854"
Jul 14 19:46:10.100540 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:46:10.100510    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-9b84c5bc-54c6c986f6-7nr4h"
Jul 14 19:46:22.833417 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:46:22.833386    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-9b84c5bc-54c6c986f6-7nr4h"]
Jul 14 19:46:22.834038 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:46:22.833620    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-9b84c5bc-54c6c986f6-7nr4h" podUID="9b4245ac-b2d0-4e3e-a102-117bea11fe11" containerName="maas-api" containerID="cri-o://a93abb39126fbb6ec669891d8d3d74844579fd3b8a0b4705d19bcc7f45d581ce" gracePeriod=30
Jul 14 19:46:23.086837 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:46:23.086780    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-9b84c5bc-54c6c986f6-7nr4h"
Jul 14 19:46:23.208500 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:46:23.208468    2565 generic.go:356] "Generic (PLEG): container finished" podID="9b4245ac-b2d0-4e3e-a102-117bea11fe11" containerID="a93abb39126fbb6ec669891d8d3d74844579fd3b8a0b4705d19bcc7f45d581ce" exitCode=0
Jul 14 19:46:23.208644 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:46:23.208510    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-9b84c5bc-54c6c986f6-7nr4h"
Jul 14 19:46:23.208644 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:46:23.208559    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-9b84c5bc-54c6c986f6-7nr4h" event={"ID":"9b4245ac-b2d0-4e3e-a102-117bea11fe11","Type":"ContainerDied","Data":"a93abb39126fbb6ec669891d8d3d74844579fd3b8a0b4705d19bcc7f45d581ce"}
Jul 14 19:46:23.208644 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:46:23.208605    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-9b84c5bc-54c6c986f6-7nr4h" event={"ID":"9b4245ac-b2d0-4e3e-a102-117bea11fe11","Type":"ContainerDied","Data":"d41bf98632e47cb7bf9df42e9f4304600aac45f33613564a93f8f08a4d50c542"}
Jul 14 19:46:23.208644 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:46:23.208627    2565 scope.go:117] "RemoveContainer" containerID="a93abb39126fbb6ec669891d8d3d74844579fd3b8a0b4705d19bcc7f45d581ce"
Jul 14 19:46:23.217840 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:46:23.217825    2565 scope.go:117] "RemoveContainer" containerID="a93abb39126fbb6ec669891d8d3d74844579fd3b8a0b4705d19bcc7f45d581ce"
Jul 14 19:46:23.218126 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:46:23.218096    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a93abb39126fbb6ec669891d8d3d74844579fd3b8a0b4705d19bcc7f45d581ce\": container with ID starting with a93abb39126fbb6ec669891d8d3d74844579fd3b8a0b4705d19bcc7f45d581ce not found: ID does not exist" containerID="a93abb39126fbb6ec669891d8d3d74844579fd3b8a0b4705d19bcc7f45d581ce"
Jul 14 19:46:23.218207 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:46:23.218139    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a93abb39126fbb6ec669891d8d3d74844579fd3b8a0b4705d19bcc7f45d581ce"} err="failed to get container status \"a93abb39126fbb6ec669891d8d3d74844579fd3b8a0b4705d19bcc7f45d581ce\": rpc error: code = NotFound desc = could not find container \"a93abb39126fbb6ec669891d8d3d74844579fd3b8a0b4705d19bcc7f45d581ce\": container with ID starting with a93abb39126fbb6ec669891d8d3d74844579fd3b8a0b4705d19bcc7f45d581ce not found: ID does not exist"
Jul 14 19:46:23.238442 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:46:23.238420    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9b4245ac-b2d0-4e3e-a102-117bea11fe11-maas-api-tls\") pod \"9b4245ac-b2d0-4e3e-a102-117bea11fe11\" (UID: \"9b4245ac-b2d0-4e3e-a102-117bea11fe11\") "
Jul 14 19:46:23.238507 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:46:23.238447    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cdctv\" (UniqueName: \"kubernetes.io/projected/9b4245ac-b2d0-4e3e-a102-117bea11fe11-kube-api-access-cdctv\") pod \"9b4245ac-b2d0-4e3e-a102-117bea11fe11\" (UID: \"9b4245ac-b2d0-4e3e-a102-117bea11fe11\") "
Jul 14 19:46:23.238507 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:46:23.238492    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9b4245ac-b2d0-4e3e-a102-117bea11fe11-openshift-service-ca\") pod \"9b4245ac-b2d0-4e3e-a102-117bea11fe11\" (UID: \"9b4245ac-b2d0-4e3e-a102-117bea11fe11\") "
Jul 14 19:46:23.238850 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:46:23.238831    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9b4245ac-b2d0-4e3e-a102-117bea11fe11-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "9b4245ac-b2d0-4e3e-a102-117bea11fe11" (UID: "9b4245ac-b2d0-4e3e-a102-117bea11fe11"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 19:46:23.240586 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:46:23.240563    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9b4245ac-b2d0-4e3e-a102-117bea11fe11-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "9b4245ac-b2d0-4e3e-a102-117bea11fe11" (UID: "9b4245ac-b2d0-4e3e-a102-117bea11fe11"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 19:46:23.240682 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:46:23.240646    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9b4245ac-b2d0-4e3e-a102-117bea11fe11-kube-api-access-cdctv" (OuterVolumeSpecName: "kube-api-access-cdctv") pod "9b4245ac-b2d0-4e3e-a102-117bea11fe11" (UID: "9b4245ac-b2d0-4e3e-a102-117bea11fe11"). InnerVolumeSpecName "kube-api-access-cdctv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 19:46:23.339434 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:46:23.339384    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9b4245ac-b2d0-4e3e-a102-117bea11fe11-maas-api-tls\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Jul 14 19:46:23.339434 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:46:23.339404    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cdctv\" (UniqueName: \"kubernetes.io/projected/9b4245ac-b2d0-4e3e-a102-117bea11fe11-kube-api-access-cdctv\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Jul 14 19:46:23.339434 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:46:23.339415    2565 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9b4245ac-b2d0-4e3e-a102-117bea11fe11-openshift-service-ca\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Jul 14 19:46:23.531373 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:46:23.531341    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-9b84c5bc-54c6c986f6-7nr4h"]
Jul 14 19:46:23.536774 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:46:23.536750    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-9b84c5bc-54c6c986f6-7nr4h"]
Jul 14 19:46:23.970699 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:46:23.970666    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9b4245ac-b2d0-4e3e-a102-117bea11fe11" path="/var/lib/kubelet/pods/9b4245ac-b2d0-4e3e-a102-117bea11fe11/volumes"
Jul 14 19:47:02.650622 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:47:02.650582    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-ea441188-6499d47c8d-pscl7"]
Jul 14 19:47:02.651062 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:47:02.651022    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9b4245ac-b2d0-4e3e-a102-117bea11fe11" containerName="maas-api"
Jul 14 19:47:02.651062 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:47:02.651033    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="9b4245ac-b2d0-4e3e-a102-117bea11fe11" containerName="maas-api"
Jul 14 19:47:02.651137 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:47:02.651113    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="9b4245ac-b2d0-4e3e-a102-117bea11fe11" containerName="maas-api"
Jul 14 19:47:02.654382 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:47:02.654360    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ea441188-6499d47c8d-pscl7"
Jul 14 19:47:02.656913 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:47:02.656888    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-ea441188-serving-cert\""
Jul 14 19:47:02.665553 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:47:02.665521    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-ea441188-6499d47c8d-pscl7"]
Jul 14 19:47:02.773667 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:47:02.773641    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/eb11edbc-4d9d-497a-a2d2-223d1360de90-maas-api-tls\") pod \"maas-api-e2e-mt-ea441188-6499d47c8d-pscl7\" (UID: \"eb11edbc-4d9d-497a-a2d2-223d1360de90\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-ea441188-6499d47c8d-pscl7"
Jul 14 19:47:02.773836 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:47:02.773678    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v9vmz\" (UniqueName: \"kubernetes.io/projected/eb11edbc-4d9d-497a-a2d2-223d1360de90-kube-api-access-v9vmz\") pod \"maas-api-e2e-mt-ea441188-6499d47c8d-pscl7\" (UID: \"eb11edbc-4d9d-497a-a2d2-223d1360de90\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-ea441188-6499d47c8d-pscl7"
Jul 14 19:47:02.773836 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:47:02.773709    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/eb11edbc-4d9d-497a-a2d2-223d1360de90-openshift-service-ca\") pod \"maas-api-e2e-mt-ea441188-6499d47c8d-pscl7\" (UID: \"eb11edbc-4d9d-497a-a2d2-223d1360de90\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-ea441188-6499d47c8d-pscl7"
Jul 14 19:47:02.874510 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:47:02.874474    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/eb11edbc-4d9d-497a-a2d2-223d1360de90-openshift-service-ca\") pod \"maas-api-e2e-mt-ea441188-6499d47c8d-pscl7\" (UID: \"eb11edbc-4d9d-497a-a2d2-223d1360de90\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-ea441188-6499d47c8d-pscl7"
Jul 14 19:47:02.874685 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:47:02.874563    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/eb11edbc-4d9d-497a-a2d2-223d1360de90-maas-api-tls\") pod \"maas-api-e2e-mt-ea441188-6499d47c8d-pscl7\" (UID: \"eb11edbc-4d9d-497a-a2d2-223d1360de90\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-ea441188-6499d47c8d-pscl7"
Jul 14 19:47:02.874685 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:47:02.874590    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v9vmz\" (UniqueName: \"kubernetes.io/projected/eb11edbc-4d9d-497a-a2d2-223d1360de90-kube-api-access-v9vmz\") pod \"maas-api-e2e-mt-ea441188-6499d47c8d-pscl7\" (UID: \"eb11edbc-4d9d-497a-a2d2-223d1360de90\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-ea441188-6499d47c8d-pscl7"
Jul 14 19:47:02.874759 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:47:02.874699    2565 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-ea441188-serving-cert: secret "maas-api-e2e-mt-ea441188-serving-cert" not found
Jul 14 19:47:02.874759 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:47:02.874758    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eb11edbc-4d9d-497a-a2d2-223d1360de90-maas-api-tls podName:eb11edbc-4d9d-497a-a2d2-223d1360de90 nodeName:}" failed. No retries permitted until 2026-07-14 19:47:03.374740581 +0000 UTC m=+2169.935597450 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/eb11edbc-4d9d-497a-a2d2-223d1360de90-maas-api-tls") pod "maas-api-e2e-mt-ea441188-6499d47c8d-pscl7" (UID: "eb11edbc-4d9d-497a-a2d2-223d1360de90") : secret "maas-api-e2e-mt-ea441188-serving-cert" not found
Jul 14 19:47:02.875107 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:47:02.875086    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/eb11edbc-4d9d-497a-a2d2-223d1360de90-openshift-service-ca\") pod \"maas-api-e2e-mt-ea441188-6499d47c8d-pscl7\" (UID: \"eb11edbc-4d9d-497a-a2d2-223d1360de90\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-ea441188-6499d47c8d-pscl7"
Jul 14 19:47:02.891019 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:47:02.890995    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v9vmz\" (UniqueName: \"kubernetes.io/projected/eb11edbc-4d9d-497a-a2d2-223d1360de90-kube-api-access-v9vmz\") pod \"maas-api-e2e-mt-ea441188-6499d47c8d-pscl7\" (UID: \"eb11edbc-4d9d-497a-a2d2-223d1360de90\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-ea441188-6499d47c8d-pscl7"
Jul 14 19:47:03.378969 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:47:03.378931    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/eb11edbc-4d9d-497a-a2d2-223d1360de90-maas-api-tls\") pod \"maas-api-e2e-mt-ea441188-6499d47c8d-pscl7\" (UID: \"eb11edbc-4d9d-497a-a2d2-223d1360de90\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-ea441188-6499d47c8d-pscl7"
Jul 14 19:47:03.381621 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:47:03.381595    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/eb11edbc-4d9d-497a-a2d2-223d1360de90-maas-api-tls\") pod \"maas-api-e2e-mt-ea441188-6499d47c8d-pscl7\" (UID: \"eb11edbc-4d9d-497a-a2d2-223d1360de90\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-ea441188-6499d47c8d-pscl7"
Jul 14 19:47:03.566861 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:47:03.566822    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ea441188-6499d47c8d-pscl7"
Jul 14 19:47:03.714169 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:47:03.714130    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-ea441188-6499d47c8d-pscl7"]
Jul 14 19:47:03.715687 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:47:03.715657    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb11edbc_4d9d_497a_a2d2_223d1360de90.slice/crio-f380027837bc6edc48fa198665a579ce6c04bfc93519679e7eda304eee36b086 WatchSource:0}: Error finding container f380027837bc6edc48fa198665a579ce6c04bfc93519679e7eda304eee36b086: Status 404 returned error can't find the container with id f380027837bc6edc48fa198665a579ce6c04bfc93519679e7eda304eee36b086
Jul 14 19:47:03.717093 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:47:03.717077    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 14 19:47:04.466857 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:47:04.466822    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ea441188-6499d47c8d-pscl7" event={"ID":"eb11edbc-4d9d-497a-a2d2-223d1360de90","Type":"ContainerStarted","Data":"f380027837bc6edc48fa198665a579ce6c04bfc93519679e7eda304eee36b086"}
Jul 14 19:47:05.474738 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:47:05.474702    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ea441188-6499d47c8d-pscl7" event={"ID":"eb11edbc-4d9d-497a-a2d2-223d1360de90","Type":"ContainerStarted","Data":"0f3ab06d4a185d0d9947fa9a9139459d08675d02bf99404fec55c26cbd7f631b"}
Jul 14 19:47:05.475113 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:47:05.474769    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ea441188-6499d47c8d-pscl7"
Jul 14 19:47:11.487474 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:47:11.487446    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ea441188-6499d47c8d-pscl7"
Jul 14 19:47:11.505389 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:47:11.505343    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ea441188-6499d47c8d-pscl7" podStartSLOduration=8.342938738 podStartE2EDuration="9.505329215s" totalImagesPullingTime="1.162390477s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 19:47:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:47:05.493670144 +0000 UTC m=+2172.054527056" watchObservedRunningTime="2026-07-14 19:47:11.505329215 +0000 UTC m=+2178.066186106"
Jul 14 19:47:51.498619 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:47:51.498577    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-ea441188-6499d47c8d-pscl7"]
Jul 14 19:47:51.499244 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:47:51.498896    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ea441188-6499d47c8d-pscl7" podUID="eb11edbc-4d9d-497a-a2d2-223d1360de90" containerName="maas-api" containerID="cri-o://0f3ab06d4a185d0d9947fa9a9139459d08675d02bf99404fec55c26cbd7f631b" gracePeriod=30
Jul 14 19:47:51.746865 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:47:51.746834    2565 generic.go:356] "Generic (PLEG): container finished" podID="eb11edbc-4d9d-497a-a2d2-223d1360de90" containerID="0f3ab06d4a185d0d9947fa9a9139459d08675d02bf99404fec55c26cbd7f631b" exitCode=0
Jul 14 19:47:51.747017 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:47:51.746909    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ea441188-6499d47c8d-pscl7" event={"ID":"eb11edbc-4d9d-497a-a2d2-223d1360de90","Type":"ContainerDied","Data":"0f3ab06d4a185d0d9947fa9a9139459d08675d02bf99404fec55c26cbd7f631b"}
Jul 14 19:47:51.764229 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:47:51.764171    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ea441188-6499d47c8d-pscl7"
Jul 14 19:47:51.872670 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:47:51.872643    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/eb11edbc-4d9d-497a-a2d2-223d1360de90-openshift-service-ca\") pod \"eb11edbc-4d9d-497a-a2d2-223d1360de90\" (UID: \"eb11edbc-4d9d-497a-a2d2-223d1360de90\") "
Jul 14 19:47:51.872818 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:47:51.872677    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v9vmz\" (UniqueName: \"kubernetes.io/projected/eb11edbc-4d9d-497a-a2d2-223d1360de90-kube-api-access-v9vmz\") pod \"eb11edbc-4d9d-497a-a2d2-223d1360de90\" (UID: \"eb11edbc-4d9d-497a-a2d2-223d1360de90\") "
Jul 14 19:47:51.872818 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:47:51.872696    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/eb11edbc-4d9d-497a-a2d2-223d1360de90-maas-api-tls\") pod \"eb11edbc-4d9d-497a-a2d2-223d1360de90\" (UID: \"eb11edbc-4d9d-497a-a2d2-223d1360de90\") "
Jul 14 19:47:51.873017 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:47:51.872993    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eb11edbc-4d9d-497a-a2d2-223d1360de90-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "eb11edbc-4d9d-497a-a2d2-223d1360de90" (UID: "eb11edbc-4d9d-497a-a2d2-223d1360de90"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 19:47:51.875024 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:47:51.874993    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eb11edbc-4d9d-497a-a2d2-223d1360de90-kube-api-access-v9vmz" (OuterVolumeSpecName: "kube-api-access-v9vmz") pod "eb11edbc-4d9d-497a-a2d2-223d1360de90" (UID: "eb11edbc-4d9d-497a-a2d2-223d1360de90"). InnerVolumeSpecName "kube-api-access-v9vmz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 19:47:51.875024 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:47:51.875008    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eb11edbc-4d9d-497a-a2d2-223d1360de90-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "eb11edbc-4d9d-497a-a2d2-223d1360de90" (UID: "eb11edbc-4d9d-497a-a2d2-223d1360de90"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 19:47:51.973430 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:47:51.973403    2565 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/eb11edbc-4d9d-497a-a2d2-223d1360de90-openshift-service-ca\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Jul 14 19:47:51.973430 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:47:51.973432    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v9vmz\" (UniqueName: \"kubernetes.io/projected/eb11edbc-4d9d-497a-a2d2-223d1360de90-kube-api-access-v9vmz\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Jul 14 19:47:51.973575 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:47:51.973447    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/eb11edbc-4d9d-497a-a2d2-223d1360de90-maas-api-tls\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Jul 14 19:47:52.754249 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:47:52.754221    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ea441188-6499d47c8d-pscl7"
Jul 14 19:47:52.754692 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:47:52.754263    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ea441188-6499d47c8d-pscl7" event={"ID":"eb11edbc-4d9d-497a-a2d2-223d1360de90","Type":"ContainerDied","Data":"f380027837bc6edc48fa198665a579ce6c04bfc93519679e7eda304eee36b086"}
Jul 14 19:47:52.754692 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:47:52.754328    2565 scope.go:117] "RemoveContainer" containerID="0f3ab06d4a185d0d9947fa9a9139459d08675d02bf99404fec55c26cbd7f631b"
Jul 14 19:47:52.776163 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:47:52.776129    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-ea441188-6499d47c8d-pscl7"]
Jul 14 19:47:52.779814 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:47:52.779789    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-ea441188-6499d47c8d-pscl7"]
Jul 14 19:47:53.969072 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:47:53.969043    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eb11edbc-4d9d-497a-a2d2-223d1360de90" path="/var/lib/kubelet/pods/eb11edbc-4d9d-497a-a2d2-223d1360de90/volumes"
Jul 14 19:50:08.527280 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:50:08.527192    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-0c147a-6ff755644-jms5l"]
Jul 14 19:50:08.527877 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:50:08.527857    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eb11edbc-4d9d-497a-a2d2-223d1360de90" containerName="maas-api"
Jul 14 19:50:08.527945 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:50:08.527880    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="eb11edbc-4d9d-497a-a2d2-223d1360de90" containerName="maas-api"
Jul 14 19:50:08.527984 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:50:08.527947    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="eb11edbc-4d9d-497a-a2d2-223d1360de90" containerName="maas-api"
Jul 14 19:50:08.531003 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:50:08.530985    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-0c147a-6ff755644-jms5l"
Jul 14 19:50:08.533817 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:50:08.533793    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-0c147a-serving-cert\""
Jul 14 19:50:08.543501 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:50:08.543475    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/dc9105f1-3502-4b33-93db-7a7c4ecb19d3-openshift-service-ca\") pod \"maas-api-e2e-inf-a-0c147a-6ff755644-jms5l\" (UID: \"dc9105f1-3502-4b33-93db-7a7c4ecb19d3\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-0c147a-6ff755644-jms5l"
Jul 14 19:50:08.543613 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:50:08.543566    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5n6fh\" (UniqueName: \"kubernetes.io/projected/dc9105f1-3502-4b33-93db-7a7c4ecb19d3-kube-api-access-5n6fh\") pod \"maas-api-e2e-inf-a-0c147a-6ff755644-jms5l\" (UID: \"dc9105f1-3502-4b33-93db-7a7c4ecb19d3\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-0c147a-6ff755644-jms5l"
Jul 14 19:50:08.543675 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:50:08.543614    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dc9105f1-3502-4b33-93db-7a7c4ecb19d3-maas-api-tls\") pod \"maas-api-e2e-inf-a-0c147a-6ff755644-jms5l\" (UID: \"dc9105f1-3502-4b33-93db-7a7c4ecb19d3\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-0c147a-6ff755644-jms5l"
Jul 14 19:50:08.545915 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:50:08.545459    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-0c147a-6ff755644-jms5l"]
Jul 14 19:50:08.644439 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:50:08.644408    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5n6fh\" (UniqueName: \"kubernetes.io/projected/dc9105f1-3502-4b33-93db-7a7c4ecb19d3-kube-api-access-5n6fh\") pod \"maas-api-e2e-inf-a-0c147a-6ff755644-jms5l\" (UID: \"dc9105f1-3502-4b33-93db-7a7c4ecb19d3\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-0c147a-6ff755644-jms5l"
Jul 14 19:50:08.644609 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:50:08.644449    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dc9105f1-3502-4b33-93db-7a7c4ecb19d3-maas-api-tls\") pod \"maas-api-e2e-inf-a-0c147a-6ff755644-jms5l\" (UID: \"dc9105f1-3502-4b33-93db-7a7c4ecb19d3\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-0c147a-6ff755644-jms5l"
Jul 14 19:50:08.644609 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:50:08.644506    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/dc9105f1-3502-4b33-93db-7a7c4ecb19d3-openshift-service-ca\") pod \"maas-api-e2e-inf-a-0c147a-6ff755644-jms5l\" (UID: \"dc9105f1-3502-4b33-93db-7a7c4ecb19d3\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-0c147a-6ff755644-jms5l"
Jul 14 19:50:08.644609 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:50:08.644586    2565 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-a-0c147a-serving-cert: secret "maas-api-e2e-inf-a-0c147a-serving-cert" not found
Jul 14 19:50:08.644774 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:50:08.644651    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dc9105f1-3502-4b33-93db-7a7c4ecb19d3-maas-api-tls podName:dc9105f1-3502-4b33-93db-7a7c4ecb19d3 nodeName:}" failed. No retries permitted until 2026-07-14 19:50:09.144636589 +0000 UTC m=+2355.705493459 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/dc9105f1-3502-4b33-93db-7a7c4ecb19d3-maas-api-tls") pod "maas-api-e2e-inf-a-0c147a-6ff755644-jms5l" (UID: "dc9105f1-3502-4b33-93db-7a7c4ecb19d3") : secret "maas-api-e2e-inf-a-0c147a-serving-cert" not found
Jul 14 19:50:08.645088 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:50:08.645070    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/dc9105f1-3502-4b33-93db-7a7c4ecb19d3-openshift-service-ca\") pod \"maas-api-e2e-inf-a-0c147a-6ff755644-jms5l\" (UID: \"dc9105f1-3502-4b33-93db-7a7c4ecb19d3\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-0c147a-6ff755644-jms5l"
Jul 14 19:50:08.654375 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:50:08.654351    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5n6fh\" (UniqueName: \"kubernetes.io/projected/dc9105f1-3502-4b33-93db-7a7c4ecb19d3-kube-api-access-5n6fh\") pod \"maas-api-e2e-inf-a-0c147a-6ff755644-jms5l\" (UID: \"dc9105f1-3502-4b33-93db-7a7c4ecb19d3\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-0c147a-6ff755644-jms5l"
Jul 14 19:50:09.148937 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:50:09.148902    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dc9105f1-3502-4b33-93db-7a7c4ecb19d3-maas-api-tls\") pod \"maas-api-e2e-inf-a-0c147a-6ff755644-jms5l\" (UID: \"dc9105f1-3502-4b33-93db-7a7c4ecb19d3\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-0c147a-6ff755644-jms5l"
Jul 14 19:50:09.151328 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:50:09.151300    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dc9105f1-3502-4b33-93db-7a7c4ecb19d3-maas-api-tls\") pod \"maas-api-e2e-inf-a-0c147a-6ff755644-jms5l\" (UID: \"dc9105f1-3502-4b33-93db-7a7c4ecb19d3\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-0c147a-6ff755644-jms5l"
Jul 14 19:50:09.443144 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:50:09.443060    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-0c147a-6ff755644-jms5l"
Jul 14 19:50:09.794646 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:50:09.794615    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-0c147a-6ff755644-jms5l"]
Jul 14 19:50:09.796350 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:50:09.796317    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc9105f1_3502_4b33_93db_7a7c4ecb19d3.slice/crio-0eb31d98413f0aebac67969891c5041a910189f4d18c89549268b1584ddef9e1 WatchSource:0}: Error finding container 0eb31d98413f0aebac67969891c5041a910189f4d18c89549268b1584ddef9e1: Status 404 returned error can't find the container with id 0eb31d98413f0aebac67969891c5041a910189f4d18c89549268b1584ddef9e1
Jul 14 19:50:10.536726 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:50:10.536691    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-0c147a-6ff755644-jms5l" event={"ID":"dc9105f1-3502-4b33-93db-7a7c4ecb19d3","Type":"ContainerStarted","Data":"85bcc4e2e453cca9e10ba232dbb1da90b87a570894d35bf68bd16d9b496781eb"}
Jul 14 19:50:10.536877 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:50:10.536750    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-0c147a-6ff755644-jms5l" event={"ID":"dc9105f1-3502-4b33-93db-7a7c4ecb19d3","Type":"ContainerStarted","Data":"0eb31d98413f0aebac67969891c5041a910189f4d18c89549268b1584ddef9e1"}
Jul 14 19:50:10.536877 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:50:10.536790    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-0c147a-6ff755644-jms5l"
Jul 14 19:50:10.556291 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:50:10.556247    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-0c147a-6ff755644-jms5l" podStartSLOduration=1.997543969 podStartE2EDuration="2.556226854s" totalImagesPullingTime="558.682885ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 19:50:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:50:10.554446674 +0000 UTC m=+2357.115303584" watchObservedRunningTime="2026-07-14 19:50:10.556226854 +0000 UTC m=+2357.117083781"
Jul 14 19:50:16.549506 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:50:16.549463    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-0c147a-6ff755644-jms5l"
Jul 14 19:50:16.553372 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:50:16.553340    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-7fc5dd-97b5c74b6-lnkww"]
Jul 14 19:50:16.557831 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:50:16.557808    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-7fc5dd-97b5c74b6-lnkww"
Jul 14 19:50:16.560300 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:50:16.560271    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-7fc5dd-serving-cert\""
Jul 14 19:50:16.565320 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:50:16.565293    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-7fc5dd-97b5c74b6-lnkww"]
Jul 14 19:50:16.612025 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:50:16.611993    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/df0e5982-2f28-4d3d-8dcf-d8b65ecf9abc-openshift-service-ca\") pod \"maas-api-e2e-inf-b-7fc5dd-97b5c74b6-lnkww\" (UID: \"df0e5982-2f28-4d3d-8dcf-d8b65ecf9abc\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-7fc5dd-97b5c74b6-lnkww"
Jul 14 19:50:16.612205 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:50:16.612183    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/df0e5982-2f28-4d3d-8dcf-d8b65ecf9abc-maas-api-tls\") pod \"maas-api-e2e-inf-b-7fc5dd-97b5c74b6-lnkww\" (UID: \"df0e5982-2f28-4d3d-8dcf-d8b65ecf9abc\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-7fc5dd-97b5c74b6-lnkww"
Jul 14 19:50:16.612261 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:50:16.612246    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qgls4\" (UniqueName: \"kubernetes.io/projected/df0e5982-2f28-4d3d-8dcf-d8b65ecf9abc-kube-api-access-qgls4\") pod \"maas-api-e2e-inf-b-7fc5dd-97b5c74b6-lnkww\" (UID: \"df0e5982-2f28-4d3d-8dcf-d8b65ecf9abc\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-7fc5dd-97b5c74b6-lnkww"
Jul 14 19:50:16.713187 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:50:16.713120    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/df0e5982-2f28-4d3d-8dcf-d8b65ecf9abc-openshift-service-ca\") pod \"maas-api-e2e-inf-b-7fc5dd-97b5c74b6-lnkww\" (UID: \"df0e5982-2f28-4d3d-8dcf-d8b65ecf9abc\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-7fc5dd-97b5c74b6-lnkww"
Jul 14 19:50:16.713367 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:50:16.713241    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/df0e5982-2f28-4d3d-8dcf-d8b65ecf9abc-maas-api-tls\") pod \"maas-api-e2e-inf-b-7fc5dd-97b5c74b6-lnkww\" (UID: \"df0e5982-2f28-4d3d-8dcf-d8b65ecf9abc\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-7fc5dd-97b5c74b6-lnkww"
Jul 14 19:50:16.713367 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:50:16.713286    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qgls4\" (UniqueName: \"kubernetes.io/projected/df0e5982-2f28-4d3d-8dcf-d8b65ecf9abc-kube-api-access-qgls4\") pod \"maas-api-e2e-inf-b-7fc5dd-97b5c74b6-lnkww\" (UID: \"df0e5982-2f28-4d3d-8dcf-d8b65ecf9abc\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-7fc5dd-97b5c74b6-lnkww"
Jul 14 19:50:16.713458 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:50:16.713386    2565 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-b-7fc5dd-serving-cert: secret "maas-api-e2e-inf-b-7fc5dd-serving-cert" not found
Jul 14 19:50:16.713458 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:50:16.713447    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/df0e5982-2f28-4d3d-8dcf-d8b65ecf9abc-maas-api-tls podName:df0e5982-2f28-4d3d-8dcf-d8b65ecf9abc nodeName:}" failed. No retries permitted until 2026-07-14 19:50:17.213433352 +0000 UTC m=+2363.774290221 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/df0e5982-2f28-4d3d-8dcf-d8b65ecf9abc-maas-api-tls") pod "maas-api-e2e-inf-b-7fc5dd-97b5c74b6-lnkww" (UID: "df0e5982-2f28-4d3d-8dcf-d8b65ecf9abc") : secret "maas-api-e2e-inf-b-7fc5dd-serving-cert" not found
Jul 14 19:50:16.713740 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:50:16.713722    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/df0e5982-2f28-4d3d-8dcf-d8b65ecf9abc-openshift-service-ca\") pod \"maas-api-e2e-inf-b-7fc5dd-97b5c74b6-lnkww\" (UID: \"df0e5982-2f28-4d3d-8dcf-d8b65ecf9abc\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-7fc5dd-97b5c74b6-lnkww"
Jul 14 19:50:16.725401 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:50:16.725371    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qgls4\" (UniqueName: \"kubernetes.io/projected/df0e5982-2f28-4d3d-8dcf-d8b65ecf9abc-kube-api-access-qgls4\") pod \"maas-api-e2e-inf-b-7fc5dd-97b5c74b6-lnkww\" (UID: \"df0e5982-2f28-4d3d-8dcf-d8b65ecf9abc\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-7fc5dd-97b5c74b6-lnkww"
Jul 14 19:50:17.217461 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:50:17.217430    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/df0e5982-2f28-4d3d-8dcf-d8b65ecf9abc-maas-api-tls\") pod \"maas-api-e2e-inf-b-7fc5dd-97b5c74b6-lnkww\" (UID: \"df0e5982-2f28-4d3d-8dcf-d8b65ecf9abc\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-7fc5dd-97b5c74b6-lnkww"
Jul 14 19:50:17.219950 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:50:17.219932    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/df0e5982-2f28-4d3d-8dcf-d8b65ecf9abc-maas-api-tls\") pod \"maas-api-e2e-inf-b-7fc5dd-97b5c74b6-lnkww\" (UID: \"df0e5982-2f28-4d3d-8dcf-d8b65ecf9abc\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-7fc5dd-97b5c74b6-lnkww"
Jul 14 19:50:17.471325 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:50:17.471295    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-7fc5dd-97b5c74b6-lnkww"
Jul 14 19:50:17.620874 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:50:17.620846    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-7fc5dd-97b5c74b6-lnkww"]
Jul 14 19:50:17.622199 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:50:17.622169    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf0e5982_2f28_4d3d_8dcf_d8b65ecf9abc.slice/crio-f6d1b107dcc25c3dc21685bf6c98c7583e134da51a0721ad56e847d35c3659c4 WatchSource:0}: Error finding container f6d1b107dcc25c3dc21685bf6c98c7583e134da51a0721ad56e847d35c3659c4: Status 404 returned error can't find the container with id f6d1b107dcc25c3dc21685bf6c98c7583e134da51a0721ad56e847d35c3659c4
Jul 14 19:50:18.584823 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:50:18.584790    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-7fc5dd-97b5c74b6-lnkww" event={"ID":"df0e5982-2f28-4d3d-8dcf-d8b65ecf9abc","Type":"ContainerStarted","Data":"a5ecb7582e765c443b0699f2eb9a39712a78c0832c614c0cd70bb466d4adf7c3"}
Jul 14 19:50:18.584991 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:50:18.584852    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-7fc5dd-97b5c74b6-lnkww"
Jul 14 19:50:18.584991 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:50:18.584872    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-7fc5dd-97b5c74b6-lnkww" event={"ID":"df0e5982-2f28-4d3d-8dcf-d8b65ecf9abc","Type":"ContainerStarted","Data":"f6d1b107dcc25c3dc21685bf6c98c7583e134da51a0721ad56e847d35c3659c4"}
Jul 14 19:50:18.619383 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:50:18.619342    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-7fc5dd-97b5c74b6-lnkww" podStartSLOduration=2.32289307 podStartE2EDuration="2.619328255s" totalImagesPullingTime="296.435185ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 19:50:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:50:18.616863434 +0000 UTC m=+2365.177720340" watchObservedRunningTime="2026-07-14 19:50:18.619328255 +0000 UTC m=+2365.180185197"
Jul 14 19:50:24.595298 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:50:24.595271    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-7fc5dd-97b5c74b6-lnkww"
Jul 14 19:50:54.407518 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:50:54.407493    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-p5lb5_7ab60b2b-a644-4e35-b8b1-49c676e0f63f/console-operator/1.log"
Jul 14 19:50:54.410980 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:50:54.410959    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cqqv8_7a447cf6-9373-4497-8028-97d590f38262/ovn-acl-logging/0.log"
Jul 14 19:50:54.413175 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:50:54.413128    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-p5lb5_7ab60b2b-a644-4e35-b8b1-49c676e0f63f/console-operator/1.log"
Jul 14 19:50:54.416497 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:50:54.416479    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cqqv8_7a447cf6-9373-4497-8028-97d590f38262/ovn-acl-logging/0.log"
Jul 14 19:51:15.648032 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:51:15.647934    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-0c147a-8cm49"]
Jul 14 19:51:15.651694 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:51:15.651672    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-0c147a-8cm49"
Jul 14 19:51:15.654678 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:51:15.654652    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-br5f6\""
Jul 14 19:51:15.660429 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:51:15.660369    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-0c147a-8cm49"]
Jul 14 19:51:15.683529 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:51:15.683502    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e68a11aa-53af-4e30-b533-bdfabc89ad29-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-0c147a-8cm49\" (UID: \"e68a11aa-53af-4e30-b533-bdfabc89ad29\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-0c147a-8cm49"
Jul 14 19:51:15.784176 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:51:15.784117    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e68a11aa-53af-4e30-b533-bdfabc89ad29-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-0c147a-8cm49\" (UID: \"e68a11aa-53af-4e30-b533-bdfabc89ad29\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-0c147a-8cm49"
Jul 14 19:51:15.784762 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:51:15.784737    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e68a11aa-53af-4e30-b533-bdfabc89ad29-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-0c147a-8cm49\" (UID: \"e68a11aa-53af-4e30-b533-bdfabc89ad29\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-0c147a-8cm49"
Jul 14 19:51:15.965618 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:51:15.965542    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-0c147a-8cm49"
Jul 14 19:51:16.106015 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:51:16.105988    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-0c147a-8cm49"]
Jul 14 19:51:16.107432 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:51:16.107402    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode68a11aa_53af_4e30_b533_bdfabc89ad29.slice/crio-dd0ac6ddb5b997b980f1b9d999cd167d19ac1ea5c790c1888cbd562a9c6cbb78 WatchSource:0}: Error finding container dd0ac6ddb5b997b980f1b9d999cd167d19ac1ea5c790c1888cbd562a9c6cbb78: Status 404 returned error can't find the container with id dd0ac6ddb5b997b980f1b9d999cd167d19ac1ea5c790c1888cbd562a9c6cbb78
Jul 14 19:51:16.917839 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:51:16.917799    2565 generic.go:356] "Generic (PLEG): container finished" podID="e68a11aa-53af-4e30-b533-bdfabc89ad29" containerID="8240398f098a13e88621b1e489d7de6ac57a33ca30c9d372d344d050216d621b" exitCode=0
Jul 14 19:51:16.918169 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:51:16.917870    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-0c147a-8cm49" event={"ID":"e68a11aa-53af-4e30-b533-bdfabc89ad29","Type":"ContainerDied","Data":"8240398f098a13e88621b1e489d7de6ac57a33ca30c9d372d344d050216d621b"}
Jul 14 19:51:16.918169 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:51:16.917956    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-0c147a-8cm49" event={"ID":"e68a11aa-53af-4e30-b533-bdfabc89ad29","Type":"ContainerStarted","Data":"dd0ac6ddb5b997b980f1b9d999cd167d19ac1ea5c790c1888cbd562a9c6cbb78"}
Jul 14 19:51:18.062195 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:51:18.062143    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-0c147a-8cm49"
Jul 14 19:51:18.104975 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:51:18.104952    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e68a11aa-53af-4e30-b533-bdfabc89ad29-maas-api-service-ca\") pod \"e68a11aa-53af-4e30-b533-bdfabc89ad29\" (UID: \"e68a11aa-53af-4e30-b533-bdfabc89ad29\") "
Jul 14 19:51:18.105284 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:51:18.105265    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e68a11aa-53af-4e30-b533-bdfabc89ad29-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "e68a11aa-53af-4e30-b533-bdfabc89ad29" (UID: "e68a11aa-53af-4e30-b533-bdfabc89ad29"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 19:51:18.206014 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:51:18.205954    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e68a11aa-53af-4e30-b533-bdfabc89ad29-maas-api-service-ca\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Jul 14 19:51:18.931005 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:51:18.930982    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-0c147a-8cm49"
Jul 14 19:51:18.931183 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:51:18.931025    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-0c147a-8cm49" event={"ID":"e68a11aa-53af-4e30-b533-bdfabc89ad29","Type":"ContainerDied","Data":"dd0ac6ddb5b997b980f1b9d999cd167d19ac1ea5c790c1888cbd562a9c6cbb78"}
Jul 14 19:51:18.931183 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:51:18.931069    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="dd0ac6ddb5b997b980f1b9d999cd167d19ac1ea5c790c1888cbd562a9c6cbb78"
Jul 14 19:51:26.212210 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:51:26.212171    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-0c147a-6ff755644-jms5l"]
Jul 14 19:51:26.212679 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:51:26.212440    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-0c147a-6ff755644-jms5l" podUID="dc9105f1-3502-4b33-93db-7a7c4ecb19d3" containerName="maas-api" containerID="cri-o://85bcc4e2e453cca9e10ba232dbb1da90b87a570894d35bf68bd16d9b496781eb" gracePeriod=30
Jul 14 19:51:26.469432 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:51:26.469407    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-0c147a-6ff755644-jms5l"
Jul 14 19:51:26.573397 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:51:26.573360    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dc9105f1-3502-4b33-93db-7a7c4ecb19d3-maas-api-tls\") pod \"dc9105f1-3502-4b33-93db-7a7c4ecb19d3\" (UID: \"dc9105f1-3502-4b33-93db-7a7c4ecb19d3\") "
Jul 14 19:51:26.573554 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:51:26.573412    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5n6fh\" (UniqueName: \"kubernetes.io/projected/dc9105f1-3502-4b33-93db-7a7c4ecb19d3-kube-api-access-5n6fh\") pod \"dc9105f1-3502-4b33-93db-7a7c4ecb19d3\" (UID: \"dc9105f1-3502-4b33-93db-7a7c4ecb19d3\") "
Jul 14 19:51:26.573554 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:51:26.573433    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/dc9105f1-3502-4b33-93db-7a7c4ecb19d3-openshift-service-ca\") pod \"dc9105f1-3502-4b33-93db-7a7c4ecb19d3\" (UID: \"dc9105f1-3502-4b33-93db-7a7c4ecb19d3\") "
Jul 14 19:51:26.573855 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:51:26.573833    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dc9105f1-3502-4b33-93db-7a7c4ecb19d3-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "dc9105f1-3502-4b33-93db-7a7c4ecb19d3" (UID: "dc9105f1-3502-4b33-93db-7a7c4ecb19d3"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 19:51:26.575557 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:51:26.575529    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dc9105f1-3502-4b33-93db-7a7c4ecb19d3-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "dc9105f1-3502-4b33-93db-7a7c4ecb19d3" (UID: "dc9105f1-3502-4b33-93db-7a7c4ecb19d3"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 19:51:26.575673 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:51:26.575648    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dc9105f1-3502-4b33-93db-7a7c4ecb19d3-kube-api-access-5n6fh" (OuterVolumeSpecName: "kube-api-access-5n6fh") pod "dc9105f1-3502-4b33-93db-7a7c4ecb19d3" (UID: "dc9105f1-3502-4b33-93db-7a7c4ecb19d3"). InnerVolumeSpecName "kube-api-access-5n6fh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 19:51:26.674910 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:51:26.674887    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dc9105f1-3502-4b33-93db-7a7c4ecb19d3-maas-api-tls\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Jul 14 19:51:26.674910 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:51:26.674909    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5n6fh\" (UniqueName: \"kubernetes.io/projected/dc9105f1-3502-4b33-93db-7a7c4ecb19d3-kube-api-access-5n6fh\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Jul 14 19:51:26.675034 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:51:26.674917    2565 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/dc9105f1-3502-4b33-93db-7a7c4ecb19d3-openshift-service-ca\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Jul 14 19:51:26.976981 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:51:26.976952    2565 generic.go:356] "Generic (PLEG): container finished" podID="dc9105f1-3502-4b33-93db-7a7c4ecb19d3" containerID="85bcc4e2e453cca9e10ba232dbb1da90b87a570894d35bf68bd16d9b496781eb" exitCode=0
Jul 14 19:51:26.977101 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:51:26.976993    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-0c147a-6ff755644-jms5l"
Jul 14 19:51:26.977101 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:51:26.977041    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-0c147a-6ff755644-jms5l" event={"ID":"dc9105f1-3502-4b33-93db-7a7c4ecb19d3","Type":"ContainerDied","Data":"85bcc4e2e453cca9e10ba232dbb1da90b87a570894d35bf68bd16d9b496781eb"}
Jul 14 19:51:26.977101 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:51:26.977094    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-0c147a-6ff755644-jms5l" event={"ID":"dc9105f1-3502-4b33-93db-7a7c4ecb19d3","Type":"ContainerDied","Data":"0eb31d98413f0aebac67969891c5041a910189f4d18c89549268b1584ddef9e1"}
Jul 14 19:51:26.977240 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:51:26.977121    2565 scope.go:117] "RemoveContainer" containerID="85bcc4e2e453cca9e10ba232dbb1da90b87a570894d35bf68bd16d9b496781eb"
Jul 14 19:51:26.986799 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:51:26.986784    2565 scope.go:117] "RemoveContainer" containerID="85bcc4e2e453cca9e10ba232dbb1da90b87a570894d35bf68bd16d9b496781eb"
Jul 14 19:51:26.987027 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:51:26.987010    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"85bcc4e2e453cca9e10ba232dbb1da90b87a570894d35bf68bd16d9b496781eb\": container with ID starting with 85bcc4e2e453cca9e10ba232dbb1da90b87a570894d35bf68bd16d9b496781eb not found: ID does not exist" containerID="85bcc4e2e453cca9e10ba232dbb1da90b87a570894d35bf68bd16d9b496781eb"
Jul 14 19:51:26.987075 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:51:26.987033    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"85bcc4e2e453cca9e10ba232dbb1da90b87a570894d35bf68bd16d9b496781eb"} err="failed to get container status \"85bcc4e2e453cca9e10ba232dbb1da90b87a570894d35bf68bd16d9b496781eb\": rpc error: code = NotFound desc = could not find container \"85bcc4e2e453cca9e10ba232dbb1da90b87a570894d35bf68bd16d9b496781eb\": container with ID starting with 85bcc4e2e453cca9e10ba232dbb1da90b87a570894d35bf68bd16d9b496781eb not found: ID does not exist"
Jul 14 19:51:26.999303 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:51:26.999283    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-0c147a-6ff755644-jms5l"]
Jul 14 19:51:27.003699 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:51:27.003679    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-0c147a-6ff755644-jms5l"]
Jul 14 19:51:27.969565 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:51:27.969538    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dc9105f1-3502-4b33-93db-7a7c4ecb19d3" path="/var/lib/kubelet/pods/dc9105f1-3502-4b33-93db-7a7c4ecb19d3/volumes"
Jul 14 19:51:41.833196 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:51:41.833145    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-7fc5dd-892pr"]
Jul 14 19:51:41.833682 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:51:41.833666    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dc9105f1-3502-4b33-93db-7a7c4ecb19d3" containerName="maas-api"
Jul 14 19:51:41.833729 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:51:41.833686    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="dc9105f1-3502-4b33-93db-7a7c4ecb19d3" containerName="maas-api"
Jul 14 19:51:41.833729 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:51:41.833715    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e68a11aa-53af-4e30-b533-bdfabc89ad29" containerName="revoke-keys"
Jul 14 19:51:41.833729 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:51:41.833721    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="e68a11aa-53af-4e30-b533-bdfabc89ad29" containerName="revoke-keys"
Jul 14 19:51:41.833818 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:51:41.833803    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="dc9105f1-3502-4b33-93db-7a7c4ecb19d3" containerName="maas-api"
Jul 14 19:51:41.833818 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:51:41.833812    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="e68a11aa-53af-4e30-b533-bdfabc89ad29" containerName="revoke-keys"
Jul 14 19:51:41.837065 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:51:41.837047    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-7fc5dd-892pr"
Jul 14 19:51:41.839886 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:51:41.839863    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-br5f6\""
Jul 14 19:51:41.847067 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:51:41.847034    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-7fc5dd-892pr"]
Jul 14 19:51:41.901577 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:51:41.901542    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/97eafccc-25ca-4907-9641-7d1ae4921672-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-7fc5dd-892pr\" (UID: \"97eafccc-25ca-4907-9641-7d1ae4921672\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-7fc5dd-892pr"
Jul 14 19:51:42.003011 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:51:42.002984    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/97eafccc-25ca-4907-9641-7d1ae4921672-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-7fc5dd-892pr\" (UID: \"97eafccc-25ca-4907-9641-7d1ae4921672\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-7fc5dd-892pr"
Jul 14 19:51:42.003674 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:51:42.003650    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/97eafccc-25ca-4907-9641-7d1ae4921672-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-7fc5dd-892pr\" (UID: \"97eafccc-25ca-4907-9641-7d1ae4921672\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-7fc5dd-892pr"
Jul 14 19:51:42.150235 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:51:42.150123    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-7fc5dd-892pr"
Jul 14 19:51:42.283894 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:51:42.283865    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-7fc5dd-892pr"]
Jul 14 19:51:42.285672 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:51:42.285641    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97eafccc_25ca_4907_9641_7d1ae4921672.slice/crio-d79a61bf605dfe9d26d170769f94a7cb3e2f2f3977d34c36ad63b3cfb03f50df WatchSource:0}: Error finding container d79a61bf605dfe9d26d170769f94a7cb3e2f2f3977d34c36ad63b3cfb03f50df: Status 404 returned error can't find the container with id d79a61bf605dfe9d26d170769f94a7cb3e2f2f3977d34c36ad63b3cfb03f50df
Jul 14 19:51:43.073066 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:51:43.073036    2565 generic.go:356] "Generic (PLEG): container finished" podID="97eafccc-25ca-4907-9641-7d1ae4921672" containerID="32b3cdf35b5d0a082dc4333f1a044b133d5164e617a0419cf9c8ec383b54a4f6" exitCode=0
Jul 14 19:51:43.073454 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:51:43.073082    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-7fc5dd-892pr" event={"ID":"97eafccc-25ca-4907-9641-7d1ae4921672","Type":"ContainerDied","Data":"32b3cdf35b5d0a082dc4333f1a044b133d5164e617a0419cf9c8ec383b54a4f6"}
Jul 14 19:51:43.073454 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:51:43.073125    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-7fc5dd-892pr" event={"ID":"97eafccc-25ca-4907-9641-7d1ae4921672","Type":"ContainerStarted","Data":"d79a61bf605dfe9d26d170769f94a7cb3e2f2f3977d34c36ad63b3cfb03f50df"}
Jul 14 19:51:44.213420 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:51:44.213396    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-7fc5dd-892pr"
Jul 14 19:51:44.323242 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:51:44.323211    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/97eafccc-25ca-4907-9641-7d1ae4921672-maas-api-service-ca\") pod \"97eafccc-25ca-4907-9641-7d1ae4921672\" (UID: \"97eafccc-25ca-4907-9641-7d1ae4921672\") "
Jul 14 19:51:44.323564 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:51:44.323541    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/97eafccc-25ca-4907-9641-7d1ae4921672-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "97eafccc-25ca-4907-9641-7d1ae4921672" (UID: "97eafccc-25ca-4907-9641-7d1ae4921672"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 19:51:44.424181 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:51:44.424103    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/97eafccc-25ca-4907-9641-7d1ae4921672-maas-api-service-ca\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Jul 14 19:51:45.086078 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:51:45.086044    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-7fc5dd-892pr"
Jul 14 19:51:45.086078 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:51:45.086065    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-7fc5dd-892pr" event={"ID":"97eafccc-25ca-4907-9641-7d1ae4921672","Type":"ContainerDied","Data":"d79a61bf605dfe9d26d170769f94a7cb3e2f2f3977d34c36ad63b3cfb03f50df"}
Jul 14 19:51:45.086314 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:51:45.086114    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d79a61bf605dfe9d26d170769f94a7cb3e2f2f3977d34c36ad63b3cfb03f50df"
Jul 14 19:51:52.259052 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:51:52.259020    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-7fc5dd-97b5c74b6-lnkww"]
Jul 14 19:51:52.259647 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:51:52.259233    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-7fc5dd-97b5c74b6-lnkww" podUID="df0e5982-2f28-4d3d-8dcf-d8b65ecf9abc" containerName="maas-api" containerID="cri-o://a5ecb7582e765c443b0699f2eb9a39712a78c0832c614c0cd70bb466d4adf7c3" gracePeriod=30
Jul 14 19:51:52.523554 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:51:52.523488    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-7fc5dd-97b5c74b6-lnkww"
Jul 14 19:51:52.699754 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:51:52.699721    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/df0e5982-2f28-4d3d-8dcf-d8b65ecf9abc-maas-api-tls\") pod \"df0e5982-2f28-4d3d-8dcf-d8b65ecf9abc\" (UID: \"df0e5982-2f28-4d3d-8dcf-d8b65ecf9abc\") "
Jul 14 19:51:52.699956 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:51:52.699786    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/df0e5982-2f28-4d3d-8dcf-d8b65ecf9abc-openshift-service-ca\") pod \"df0e5982-2f28-4d3d-8dcf-d8b65ecf9abc\" (UID: \"df0e5982-2f28-4d3d-8dcf-d8b65ecf9abc\") "
Jul 14 19:51:52.699956 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:51:52.699843    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qgls4\" (UniqueName: \"kubernetes.io/projected/df0e5982-2f28-4d3d-8dcf-d8b65ecf9abc-kube-api-access-qgls4\") pod \"df0e5982-2f28-4d3d-8dcf-d8b65ecf9abc\" (UID: \"df0e5982-2f28-4d3d-8dcf-d8b65ecf9abc\") "
Jul 14 19:51:52.700189 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:51:52.700132    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/df0e5982-2f28-4d3d-8dcf-d8b65ecf9abc-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "df0e5982-2f28-4d3d-8dcf-d8b65ecf9abc" (UID: "df0e5982-2f28-4d3d-8dcf-d8b65ecf9abc"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 19:51:52.702014 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:51:52.701989    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/df0e5982-2f28-4d3d-8dcf-d8b65ecf9abc-kube-api-access-qgls4" (OuterVolumeSpecName: "kube-api-access-qgls4") pod "df0e5982-2f28-4d3d-8dcf-d8b65ecf9abc" (UID: "df0e5982-2f28-4d3d-8dcf-d8b65ecf9abc"). InnerVolumeSpecName "kube-api-access-qgls4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 19:51:52.702114 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:51:52.702061    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/df0e5982-2f28-4d3d-8dcf-d8b65ecf9abc-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "df0e5982-2f28-4d3d-8dcf-d8b65ecf9abc" (UID: "df0e5982-2f28-4d3d-8dcf-d8b65ecf9abc"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 19:51:52.800606 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:51:52.800540    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/df0e5982-2f28-4d3d-8dcf-d8b65ecf9abc-maas-api-tls\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Jul 14 19:51:52.800606 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:51:52.800568    2565 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/df0e5982-2f28-4d3d-8dcf-d8b65ecf9abc-openshift-service-ca\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Jul 14 19:51:52.800606 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:51:52.800578    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qgls4\" (UniqueName: \"kubernetes.io/projected/df0e5982-2f28-4d3d-8dcf-d8b65ecf9abc-kube-api-access-qgls4\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Jul 14 19:51:53.132655 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:51:53.132562    2565 generic.go:356] "Generic (PLEG): container finished" podID="df0e5982-2f28-4d3d-8dcf-d8b65ecf9abc" containerID="a5ecb7582e765c443b0699f2eb9a39712a78c0832c614c0cd70bb466d4adf7c3" exitCode=0
Jul 14 19:51:53.132655 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:51:53.132607    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-7fc5dd-97b5c74b6-lnkww"
Jul 14 19:51:53.132872 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:51:53.132649    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-7fc5dd-97b5c74b6-lnkww" event={"ID":"df0e5982-2f28-4d3d-8dcf-d8b65ecf9abc","Type":"ContainerDied","Data":"a5ecb7582e765c443b0699f2eb9a39712a78c0832c614c0cd70bb466d4adf7c3"}
Jul 14 19:51:53.132872 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:51:53.132700    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-7fc5dd-97b5c74b6-lnkww" event={"ID":"df0e5982-2f28-4d3d-8dcf-d8b65ecf9abc","Type":"ContainerDied","Data":"f6d1b107dcc25c3dc21685bf6c98c7583e134da51a0721ad56e847d35c3659c4"}
Jul 14 19:51:53.132872 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:51:53.132722    2565 scope.go:117] "RemoveContainer" containerID="a5ecb7582e765c443b0699f2eb9a39712a78c0832c614c0cd70bb466d4adf7c3"
Jul 14 19:51:53.142593 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:51:53.142576    2565 scope.go:117] "RemoveContainer" containerID="a5ecb7582e765c443b0699f2eb9a39712a78c0832c614c0cd70bb466d4adf7c3"
Jul 14 19:51:53.142847 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:51:53.142830    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a5ecb7582e765c443b0699f2eb9a39712a78c0832c614c0cd70bb466d4adf7c3\": container with ID starting with a5ecb7582e765c443b0699f2eb9a39712a78c0832c614c0cd70bb466d4adf7c3 not found: ID does not exist" containerID="a5ecb7582e765c443b0699f2eb9a39712a78c0832c614c0cd70bb466d4adf7c3"
Jul 14 19:51:53.142903 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:51:53.142857    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a5ecb7582e765c443b0699f2eb9a39712a78c0832c614c0cd70bb466d4adf7c3"} err="failed to get container status \"a5ecb7582e765c443b0699f2eb9a39712a78c0832c614c0cd70bb466d4adf7c3\": rpc error: code = NotFound desc = could not find container \"a5ecb7582e765c443b0699f2eb9a39712a78c0832c614c0cd70bb466d4adf7c3\": container with ID starting with a5ecb7582e765c443b0699f2eb9a39712a78c0832c614c0cd70bb466d4adf7c3 not found: ID does not exist"
Jul 14 19:51:53.157739 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:51:53.157714    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-7fc5dd-97b5c74b6-lnkww"]
Jul 14 19:51:53.161267 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:51:53.161245    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-7fc5dd-97b5c74b6-lnkww"]
Jul 14 19:51:53.968848 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:51:53.968815    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="df0e5982-2f28-4d3d-8dcf-d8b65ecf9abc" path="/var/lib/kubelet/pods/df0e5982-2f28-4d3d-8dcf-d8b65ecf9abc/volumes"
Jul 14 19:52:11.358178 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:52:11.357238    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-922b98-96fb9b6ff-29xl4"]
Jul 14 19:52:11.358685 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:52:11.358229    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="df0e5982-2f28-4d3d-8dcf-d8b65ecf9abc" containerName="maas-api"
Jul 14 19:52:11.358685 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:52:11.358250    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="df0e5982-2f28-4d3d-8dcf-d8b65ecf9abc" containerName="maas-api"
Jul 14 19:52:11.358685 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:52:11.358273    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="97eafccc-25ca-4907-9641-7d1ae4921672" containerName="revoke-keys"
Jul 14 19:52:11.358685 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:52:11.358284    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="97eafccc-25ca-4907-9641-7d1ae4921672" containerName="revoke-keys"
Jul 14 19:52:11.358685 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:52:11.358514    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="df0e5982-2f28-4d3d-8dcf-d8b65ecf9abc" containerName="maas-api"
Jul 14 19:52:11.358685 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:52:11.358537    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="97eafccc-25ca-4907-9641-7d1ae4921672" containerName="revoke-keys"
Jul 14 19:52:11.362522 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:52:11.362496    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-922b98-96fb9b6ff-29xl4"
Jul 14 19:52:11.367671 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:52:11.366551    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-922b98-serving-cert\""
Jul 14 19:52:11.369767 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:52:11.369738    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-922b98-96fb9b6ff-29xl4"]
Jul 14 19:52:11.454913 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:52:11.454884    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c7cf2c12-c0f4-41b0-8603-a290c563ae47-openshift-service-ca\") pod \"maas-api-e2e-api-a-922b98-96fb9b6ff-29xl4\" (UID: \"c7cf2c12-c0f4-41b0-8603-a290c563ae47\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-922b98-96fb9b6ff-29xl4"
Jul 14 19:52:11.455073 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:52:11.454919    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sh744\" (UniqueName: \"kubernetes.io/projected/c7cf2c12-c0f4-41b0-8603-a290c563ae47-kube-api-access-sh744\") pod \"maas-api-e2e-api-a-922b98-96fb9b6ff-29xl4\" (UID: \"c7cf2c12-c0f4-41b0-8603-a290c563ae47\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-922b98-96fb9b6ff-29xl4"
Jul 14 19:52:11.455073 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:52:11.454990    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c7cf2c12-c0f4-41b0-8603-a290c563ae47-maas-api-tls\") pod \"maas-api-e2e-api-a-922b98-96fb9b6ff-29xl4\" (UID: \"c7cf2c12-c0f4-41b0-8603-a290c563ae47\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-922b98-96fb9b6ff-29xl4"
Jul 14 19:52:11.556032 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:52:11.555998    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c7cf2c12-c0f4-41b0-8603-a290c563ae47-openshift-service-ca\") pod \"maas-api-e2e-api-a-922b98-96fb9b6ff-29xl4\" (UID: \"c7cf2c12-c0f4-41b0-8603-a290c563ae47\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-922b98-96fb9b6ff-29xl4"
Jul 14 19:52:11.556032 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:52:11.556036    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sh744\" (UniqueName: \"kubernetes.io/projected/c7cf2c12-c0f4-41b0-8603-a290c563ae47-kube-api-access-sh744\") pod \"maas-api-e2e-api-a-922b98-96fb9b6ff-29xl4\" (UID: \"c7cf2c12-c0f4-41b0-8603-a290c563ae47\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-922b98-96fb9b6ff-29xl4"
Jul 14 19:52:11.556254 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:52:11.556079    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c7cf2c12-c0f4-41b0-8603-a290c563ae47-maas-api-tls\") pod \"maas-api-e2e-api-a-922b98-96fb9b6ff-29xl4\" (UID: \"c7cf2c12-c0f4-41b0-8603-a290c563ae47\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-922b98-96fb9b6ff-29xl4"
Jul 14 19:52:11.556254 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:52:11.556227    2565 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-a-922b98-serving-cert: secret "maas-api-e2e-api-a-922b98-serving-cert" not found
Jul 14 19:52:11.556320 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:52:11.556289    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c7cf2c12-c0f4-41b0-8603-a290c563ae47-maas-api-tls podName:c7cf2c12-c0f4-41b0-8603-a290c563ae47 nodeName:}" failed. No retries permitted until 2026-07-14 19:52:12.056272844 +0000 UTC m=+2478.617129715 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/c7cf2c12-c0f4-41b0-8603-a290c563ae47-maas-api-tls") pod "maas-api-e2e-api-a-922b98-96fb9b6ff-29xl4" (UID: "c7cf2c12-c0f4-41b0-8603-a290c563ae47") : secret "maas-api-e2e-api-a-922b98-serving-cert" not found
Jul 14 19:52:11.556703 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:52:11.556684    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c7cf2c12-c0f4-41b0-8603-a290c563ae47-openshift-service-ca\") pod \"maas-api-e2e-api-a-922b98-96fb9b6ff-29xl4\" (UID: \"c7cf2c12-c0f4-41b0-8603-a290c563ae47\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-922b98-96fb9b6ff-29xl4"
Jul 14 19:52:11.566789 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:52:11.566767    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sh744\" (UniqueName: \"kubernetes.io/projected/c7cf2c12-c0f4-41b0-8603-a290c563ae47-kube-api-access-sh744\") pod \"maas-api-e2e-api-a-922b98-96fb9b6ff-29xl4\" (UID: \"c7cf2c12-c0f4-41b0-8603-a290c563ae47\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-922b98-96fb9b6ff-29xl4"
Jul 14 19:52:12.062251 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:52:12.062213    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c7cf2c12-c0f4-41b0-8603-a290c563ae47-maas-api-tls\") pod \"maas-api-e2e-api-a-922b98-96fb9b6ff-29xl4\" (UID: \"c7cf2c12-c0f4-41b0-8603-a290c563ae47\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-922b98-96fb9b6ff-29xl4"
Jul 14 19:52:12.064761 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:52:12.064728    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c7cf2c12-c0f4-41b0-8603-a290c563ae47-maas-api-tls\") pod \"maas-api-e2e-api-a-922b98-96fb9b6ff-29xl4\" (UID: \"c7cf2c12-c0f4-41b0-8603-a290c563ae47\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-922b98-96fb9b6ff-29xl4"
Jul 14 19:52:12.276186 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:52:12.276131    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-922b98-96fb9b6ff-29xl4"
Jul 14 19:52:12.435051 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:52:12.435027    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-922b98-96fb9b6ff-29xl4"]
Jul 14 19:52:12.435929 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:52:12.435900    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc7cf2c12_c0f4_41b0_8603_a290c563ae47.slice/crio-4710bec427a7cf51e75e88e6708782c104af998ea90b431e421ca0a6360ad1b8 WatchSource:0}: Error finding container 4710bec427a7cf51e75e88e6708782c104af998ea90b431e421ca0a6360ad1b8: Status 404 returned error can't find the container with id 4710bec427a7cf51e75e88e6708782c104af998ea90b431e421ca0a6360ad1b8
Jul 14 19:52:12.437289 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:52:12.437271    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 14 19:52:13.258874 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:52:13.258842    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-922b98-96fb9b6ff-29xl4" event={"ID":"c7cf2c12-c0f4-41b0-8603-a290c563ae47","Type":"ContainerStarted","Data":"481149b412572d70243a58eafa4e6049e86b4ebf8298f9f049f8bd083d7ade88"}
Jul 14 19:52:13.259027 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:52:13.258902    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-922b98-96fb9b6ff-29xl4"
Jul 14 19:52:13.259027 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:52:13.258918    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-922b98-96fb9b6ff-29xl4" event={"ID":"c7cf2c12-c0f4-41b0-8603-a290c563ae47","Type":"ContainerStarted","Data":"4710bec427a7cf51e75e88e6708782c104af998ea90b431e421ca0a6360ad1b8"}
Jul 14 19:52:13.279286 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:52:13.279232    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-922b98-96fb9b6ff-29xl4" podStartSLOduration=1.580386533 podStartE2EDuration="2.279216265s" totalImagesPullingTime="698.829732ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 19:52:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:52:13.277517859 +0000 UTC m=+2479.838374767" watchObservedRunningTime="2026-07-14 19:52:13.279216265 +0000 UTC m=+2479.840073157"
Jul 14 19:52:19.289396 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:52:19.289357    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-922b98-96fb9b6ff-29xl4"
Jul 14 19:52:19.290909 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:52:19.290883    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-57e988-7ddf7d45f6-fk8nr"]
Jul 14 19:52:19.293948 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:52:19.293925    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-57e988-7ddf7d45f6-fk8nr"
Jul 14 19:52:19.296612 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:52:19.296590    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-57e988-serving-cert\""
Jul 14 19:52:19.301880 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:52:19.301854    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-57e988-7ddf7d45f6-fk8nr"]
Jul 14 19:52:19.333126 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:52:19.333097    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9bd27577-6134-4115-97b0-f8660e03473a-openshift-service-ca\") pod \"maas-api-e2e-api-b-57e988-7ddf7d45f6-fk8nr\" (UID: \"9bd27577-6134-4115-97b0-f8660e03473a\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-57e988-7ddf7d45f6-fk8nr"
Jul 14 19:52:19.333272 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:52:19.333256    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9bd27577-6134-4115-97b0-f8660e03473a-maas-api-tls\") pod \"maas-api-e2e-api-b-57e988-7ddf7d45f6-fk8nr\" (UID: \"9bd27577-6134-4115-97b0-f8660e03473a\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-57e988-7ddf7d45f6-fk8nr"
Jul 14 19:52:19.333347 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:52:19.333304    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w77p7\" (UniqueName: \"kubernetes.io/projected/9bd27577-6134-4115-97b0-f8660e03473a-kube-api-access-w77p7\") pod \"maas-api-e2e-api-b-57e988-7ddf7d45f6-fk8nr\" (UID: \"9bd27577-6134-4115-97b0-f8660e03473a\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-57e988-7ddf7d45f6-fk8nr"
Jul 14 19:52:19.434336 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:52:19.434294    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9bd27577-6134-4115-97b0-f8660e03473a-openshift-service-ca\") pod \"maas-api-e2e-api-b-57e988-7ddf7d45f6-fk8nr\" (UID: \"9bd27577-6134-4115-97b0-f8660e03473a\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-57e988-7ddf7d45f6-fk8nr"
Jul 14 19:52:19.434512 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:52:19.434384    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9bd27577-6134-4115-97b0-f8660e03473a-maas-api-tls\") pod \"maas-api-e2e-api-b-57e988-7ddf7d45f6-fk8nr\" (UID: \"9bd27577-6134-4115-97b0-f8660e03473a\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-57e988-7ddf7d45f6-fk8nr"
Jul 14 19:52:19.434512 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:52:19.434426    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w77p7\" (UniqueName: \"kubernetes.io/projected/9bd27577-6134-4115-97b0-f8660e03473a-kube-api-access-w77p7\") pod \"maas-api-e2e-api-b-57e988-7ddf7d45f6-fk8nr\" (UID: \"9bd27577-6134-4115-97b0-f8660e03473a\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-57e988-7ddf7d45f6-fk8nr"
Jul 14 19:52:19.434641 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:52:19.434541    2565 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-b-57e988-serving-cert: secret "maas-api-e2e-api-b-57e988-serving-cert" not found
Jul 14 19:52:19.434641 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:52:19.434602    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9bd27577-6134-4115-97b0-f8660e03473a-maas-api-tls podName:9bd27577-6134-4115-97b0-f8660e03473a nodeName:}" failed. No retries permitted until 2026-07-14 19:52:19.93458557 +0000 UTC m=+2486.495442441 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/9bd27577-6134-4115-97b0-f8660e03473a-maas-api-tls") pod "maas-api-e2e-api-b-57e988-7ddf7d45f6-fk8nr" (UID: "9bd27577-6134-4115-97b0-f8660e03473a") : secret "maas-api-e2e-api-b-57e988-serving-cert" not found
Jul 14 19:52:19.435101 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:52:19.435078    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9bd27577-6134-4115-97b0-f8660e03473a-openshift-service-ca\") pod \"maas-api-e2e-api-b-57e988-7ddf7d45f6-fk8nr\" (UID: \"9bd27577-6134-4115-97b0-f8660e03473a\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-57e988-7ddf7d45f6-fk8nr"
Jul 14 19:52:19.444581 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:52:19.444552    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w77p7\" (UniqueName: \"kubernetes.io/projected/9bd27577-6134-4115-97b0-f8660e03473a-kube-api-access-w77p7\") pod \"maas-api-e2e-api-b-57e988-7ddf7d45f6-fk8nr\" (UID: \"9bd27577-6134-4115-97b0-f8660e03473a\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-57e988-7ddf7d45f6-fk8nr"
Jul 14 19:52:19.938477 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:52:19.938444    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9bd27577-6134-4115-97b0-f8660e03473a-maas-api-tls\") pod \"maas-api-e2e-api-b-57e988-7ddf7d45f6-fk8nr\" (UID: \"9bd27577-6134-4115-97b0-f8660e03473a\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-57e988-7ddf7d45f6-fk8nr"
Jul 14 19:52:19.941081 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:52:19.941058    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9bd27577-6134-4115-97b0-f8660e03473a-maas-api-tls\") pod \"maas-api-e2e-api-b-57e988-7ddf7d45f6-fk8nr\" (UID: \"9bd27577-6134-4115-97b0-f8660e03473a\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-57e988-7ddf7d45f6-fk8nr"
Jul 14 19:52:20.206362 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:52:20.206263    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-57e988-7ddf7d45f6-fk8nr"
Jul 14 19:52:20.357729 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:52:20.357696    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-57e988-7ddf7d45f6-fk8nr"]
Jul 14 19:52:20.358147 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:52:20.357801    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9bd27577_6134_4115_97b0_f8660e03473a.slice/crio-ef81a609a152560f28c1ffe0f45d8f4c66922a6a6a61fadd653fbec7138a02ca WatchSource:0}: Error finding container ef81a609a152560f28c1ffe0f45d8f4c66922a6a6a61fadd653fbec7138a02ca: Status 404 returned error can't find the container with id ef81a609a152560f28c1ffe0f45d8f4c66922a6a6a61fadd653fbec7138a02ca
Jul 14 19:52:21.310353 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:52:21.310317    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-57e988-7ddf7d45f6-fk8nr" event={"ID":"9bd27577-6134-4115-97b0-f8660e03473a","Type":"ContainerStarted","Data":"40c439b74962ac3baed0726b3a05d1bb25d477ad2352158e703782f666e325ce"}
Jul 14 19:52:21.310537 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:52:21.310382    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-57e988-7ddf7d45f6-fk8nr" event={"ID":"9bd27577-6134-4115-97b0-f8660e03473a","Type":"ContainerStarted","Data":"ef81a609a152560f28c1ffe0f45d8f4c66922a6a6a61fadd653fbec7138a02ca"}
Jul 14 19:52:21.310537 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:52:21.310407    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-57e988-7ddf7d45f6-fk8nr"
Jul 14 19:52:21.331855 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:52:21.331799    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-57e988-7ddf7d45f6-fk8nr" podStartSLOduration=1.929170595 podStartE2EDuration="2.331784983s" totalImagesPullingTime="402.614388ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 19:52:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:52:21.328252146 +0000 UTC m=+2487.889109058" watchObservedRunningTime="2026-07-14 19:52:21.331784983 +0000 UTC m=+2487.892641875"
Jul 14 19:52:27.320991 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:52:27.320962    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-57e988-7ddf7d45f6-fk8nr"
Jul 14 19:52:42.821638 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:52:42.821598    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-922b98-96fb9b6ff-29xl4"]
Jul 14 19:52:42.822090 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:52:42.821907    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-922b98-96fb9b6ff-29xl4" podUID="c7cf2c12-c0f4-41b0-8603-a290c563ae47" containerName="maas-api" containerID="cri-o://481149b412572d70243a58eafa4e6049e86b4ebf8298f9f049f8bd083d7ade88" gracePeriod=30
Jul 14 19:52:43.081508 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:52:43.081446    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-922b98-96fb9b6ff-29xl4"
Jul 14 19:52:43.251191 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:52:43.251149    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c7cf2c12-c0f4-41b0-8603-a290c563ae47-maas-api-tls\") pod \"c7cf2c12-c0f4-41b0-8603-a290c563ae47\" (UID: \"c7cf2c12-c0f4-41b0-8603-a290c563ae47\") "
Jul 14 19:52:43.251361 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:52:43.251261    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c7cf2c12-c0f4-41b0-8603-a290c563ae47-openshift-service-ca\") pod \"c7cf2c12-c0f4-41b0-8603-a290c563ae47\" (UID: \"c7cf2c12-c0f4-41b0-8603-a290c563ae47\") "
Jul 14 19:52:43.251361 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:52:43.251294    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sh744\" (UniqueName: \"kubernetes.io/projected/c7cf2c12-c0f4-41b0-8603-a290c563ae47-kube-api-access-sh744\") pod \"c7cf2c12-c0f4-41b0-8603-a290c563ae47\" (UID: \"c7cf2c12-c0f4-41b0-8603-a290c563ae47\") "
Jul 14 19:52:43.251589 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:52:43.251554    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c7cf2c12-c0f4-41b0-8603-a290c563ae47-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "c7cf2c12-c0f4-41b0-8603-a290c563ae47" (UID: "c7cf2c12-c0f4-41b0-8603-a290c563ae47"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 19:52:43.253414 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:52:43.253392    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c7cf2c12-c0f4-41b0-8603-a290c563ae47-kube-api-access-sh744" (OuterVolumeSpecName: "kube-api-access-sh744") pod "c7cf2c12-c0f4-41b0-8603-a290c563ae47" (UID: "c7cf2c12-c0f4-41b0-8603-a290c563ae47"). InnerVolumeSpecName "kube-api-access-sh744". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 19:52:43.253499 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:52:43.253421    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c7cf2c12-c0f4-41b0-8603-a290c563ae47-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "c7cf2c12-c0f4-41b0-8603-a290c563ae47" (UID: "c7cf2c12-c0f4-41b0-8603-a290c563ae47"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 19:52:43.352683 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:52:43.352625    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c7cf2c12-c0f4-41b0-8603-a290c563ae47-maas-api-tls\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Jul 14 19:52:43.352683 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:52:43.352649    2565 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c7cf2c12-c0f4-41b0-8603-a290c563ae47-openshift-service-ca\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Jul 14 19:52:43.352683 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:52:43.352658    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sh744\" (UniqueName: \"kubernetes.io/projected/c7cf2c12-c0f4-41b0-8603-a290c563ae47-kube-api-access-sh744\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Jul 14 19:52:43.450817 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:52:43.450791    2565 generic.go:356] "Generic (PLEG): container finished" podID="c7cf2c12-c0f4-41b0-8603-a290c563ae47" containerID="481149b412572d70243a58eafa4e6049e86b4ebf8298f9f049f8bd083d7ade88" exitCode=0
Jul 14 19:52:43.450933 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:52:43.450834    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-922b98-96fb9b6ff-29xl4"
Jul 14 19:52:43.450933 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:52:43.450875    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-922b98-96fb9b6ff-29xl4" event={"ID":"c7cf2c12-c0f4-41b0-8603-a290c563ae47","Type":"ContainerDied","Data":"481149b412572d70243a58eafa4e6049e86b4ebf8298f9f049f8bd083d7ade88"}
Jul 14 19:52:43.450933 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:52:43.450929    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-922b98-96fb9b6ff-29xl4" event={"ID":"c7cf2c12-c0f4-41b0-8603-a290c563ae47","Type":"ContainerDied","Data":"4710bec427a7cf51e75e88e6708782c104af998ea90b431e421ca0a6360ad1b8"}
Jul 14 19:52:43.451058 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:52:43.450959    2565 scope.go:117] "RemoveContainer" containerID="481149b412572d70243a58eafa4e6049e86b4ebf8298f9f049f8bd083d7ade88"
Jul 14 19:52:43.460949 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:52:43.460934    2565 scope.go:117] "RemoveContainer" containerID="481149b412572d70243a58eafa4e6049e86b4ebf8298f9f049f8bd083d7ade88"
Jul 14 19:52:43.461229 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:52:43.461211    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"481149b412572d70243a58eafa4e6049e86b4ebf8298f9f049f8bd083d7ade88\": container with ID starting with 481149b412572d70243a58eafa4e6049e86b4ebf8298f9f049f8bd083d7ade88 not found: ID does not exist" containerID="481149b412572d70243a58eafa4e6049e86b4ebf8298f9f049f8bd083d7ade88"
Jul 14 19:52:43.461306 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:52:43.461236    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"481149b412572d70243a58eafa4e6049e86b4ebf8298f9f049f8bd083d7ade88"} err="failed to get container status \"481149b412572d70243a58eafa4e6049e86b4ebf8298f9f049f8bd083d7ade88\": rpc error: code = NotFound desc = could not find container \"481149b412572d70243a58eafa4e6049e86b4ebf8298f9f049f8bd083d7ade88\": container with ID starting with 481149b412572d70243a58eafa4e6049e86b4ebf8298f9f049f8bd083d7ade88 not found: ID does not exist"
Jul 14 19:52:43.488372 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:52:43.488345    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-922b98-96fb9b6ff-29xl4"]
Jul 14 19:52:43.502823 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:52:43.502802    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-922b98-96fb9b6ff-29xl4"]
Jul 14 19:52:43.969168 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:52:43.969133    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c7cf2c12-c0f4-41b0-8603-a290c563ae47" path="/var/lib/kubelet/pods/c7cf2c12-c0f4-41b0-8603-a290c563ae47/volumes"
Jul 14 19:53:08.621653 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:53:08.621619    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-57e988-7ddf7d45f6-fk8nr"]
Jul 14 19:53:08.622236 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:53:08.621872    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-57e988-7ddf7d45f6-fk8nr" podUID="9bd27577-6134-4115-97b0-f8660e03473a" containerName="maas-api" containerID="cri-o://40c439b74962ac3baed0726b3a05d1bb25d477ad2352158e703782f666e325ce" gracePeriod=30
Jul 14 19:53:08.882304 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:53:08.882241    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-57e988-7ddf7d45f6-fk8nr"
Jul 14 19:53:08.958742 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:53:08.958714    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9bd27577-6134-4115-97b0-f8660e03473a-openshift-service-ca\") pod \"9bd27577-6134-4115-97b0-f8660e03473a\" (UID: \"9bd27577-6134-4115-97b0-f8660e03473a\") "
Jul 14 19:53:08.958869 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:53:08.958746    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w77p7\" (UniqueName: \"kubernetes.io/projected/9bd27577-6134-4115-97b0-f8660e03473a-kube-api-access-w77p7\") pod \"9bd27577-6134-4115-97b0-f8660e03473a\" (UID: \"9bd27577-6134-4115-97b0-f8660e03473a\") "
Jul 14 19:53:08.958869 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:53:08.958866    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9bd27577-6134-4115-97b0-f8660e03473a-maas-api-tls\") pod \"9bd27577-6134-4115-97b0-f8660e03473a\" (UID: \"9bd27577-6134-4115-97b0-f8660e03473a\") "
Jul 14 19:53:08.959094 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:53:08.959070    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9bd27577-6134-4115-97b0-f8660e03473a-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "9bd27577-6134-4115-97b0-f8660e03473a" (UID: "9bd27577-6134-4115-97b0-f8660e03473a"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 19:53:08.960957 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:53:08.960937    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9bd27577-6134-4115-97b0-f8660e03473a-kube-api-access-w77p7" (OuterVolumeSpecName: "kube-api-access-w77p7") pod "9bd27577-6134-4115-97b0-f8660e03473a" (UID: "9bd27577-6134-4115-97b0-f8660e03473a"). InnerVolumeSpecName "kube-api-access-w77p7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 19:53:08.960957 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:53:08.960936    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9bd27577-6134-4115-97b0-f8660e03473a-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "9bd27577-6134-4115-97b0-f8660e03473a" (UID: "9bd27577-6134-4115-97b0-f8660e03473a"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 19:53:09.060206 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:53:09.060180    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9bd27577-6134-4115-97b0-f8660e03473a-maas-api-tls\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Jul 14 19:53:09.060206 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:53:09.060201    2565 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9bd27577-6134-4115-97b0-f8660e03473a-openshift-service-ca\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Jul 14 19:53:09.060335 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:53:09.060212    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w77p7\" (UniqueName: \"kubernetes.io/projected/9bd27577-6134-4115-97b0-f8660e03473a-kube-api-access-w77p7\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Jul 14 19:53:09.612355 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:53:09.612326    2565 generic.go:356] "Generic (PLEG): container finished" podID="9bd27577-6134-4115-97b0-f8660e03473a" containerID="40c439b74962ac3baed0726b3a05d1bb25d477ad2352158e703782f666e325ce" exitCode=0
Jul 14 19:53:09.612542 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:53:09.612370    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-57e988-7ddf7d45f6-fk8nr"
Jul 14 19:53:09.612542 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:53:09.612413    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-57e988-7ddf7d45f6-fk8nr" event={"ID":"9bd27577-6134-4115-97b0-f8660e03473a","Type":"ContainerDied","Data":"40c439b74962ac3baed0726b3a05d1bb25d477ad2352158e703782f666e325ce"}
Jul 14 19:53:09.612542 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:53:09.612472    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-57e988-7ddf7d45f6-fk8nr" event={"ID":"9bd27577-6134-4115-97b0-f8660e03473a","Type":"ContainerDied","Data":"ef81a609a152560f28c1ffe0f45d8f4c66922a6a6a61fadd653fbec7138a02ca"}
Jul 14 19:53:09.612542 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:53:09.612503    2565 scope.go:117] "RemoveContainer" containerID="40c439b74962ac3baed0726b3a05d1bb25d477ad2352158e703782f666e325ce"
Jul 14 19:53:09.623198 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:53:09.622990    2565 scope.go:117] "RemoveContainer" containerID="40c439b74962ac3baed0726b3a05d1bb25d477ad2352158e703782f666e325ce"
Jul 14 19:53:09.623435 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:53:09.623282    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"40c439b74962ac3baed0726b3a05d1bb25d477ad2352158e703782f666e325ce\": container with ID starting with 40c439b74962ac3baed0726b3a05d1bb25d477ad2352158e703782f666e325ce not found: ID does not exist" containerID="40c439b74962ac3baed0726b3a05d1bb25d477ad2352158e703782f666e325ce"
Jul 14 19:53:09.623435 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:53:09.623308    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"40c439b74962ac3baed0726b3a05d1bb25d477ad2352158e703782f666e325ce"} err="failed to get container status \"40c439b74962ac3baed0726b3a05d1bb25d477ad2352158e703782f666e325ce\": rpc error: code = NotFound desc = could not find container \"40c439b74962ac3baed0726b3a05d1bb25d477ad2352158e703782f666e325ce\": container with ID starting with 40c439b74962ac3baed0726b3a05d1bb25d477ad2352158e703782f666e325ce not found: ID does not exist"
Jul 14 19:53:09.635776 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:53:09.635757    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-57e988-7ddf7d45f6-fk8nr"]
Jul 14 19:53:09.638236 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:53:09.638217    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-57e988-7ddf7d45f6-fk8nr"]
Jul 14 19:53:09.969906 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:53:09.969879    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9bd27577-6134-4115-97b0-f8660e03473a" path="/var/lib/kubelet/pods/9bd27577-6134-4115-97b0-f8660e03473a/volumes"
Jul 14 19:53:27.700903 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:53:27.700864    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-70659c-549b877896-5rc8v"]
Jul 14 19:53:27.701340 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:53:27.701297    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9bd27577-6134-4115-97b0-f8660e03473a" containerName="maas-api"
Jul 14 19:53:27.701340 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:53:27.701310    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="9bd27577-6134-4115-97b0-f8660e03473a" containerName="maas-api"
Jul 14 19:53:27.701340 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:53:27.701323    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c7cf2c12-c0f4-41b0-8603-a290c563ae47" containerName="maas-api"
Jul 14 19:53:27.701340 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:53:27.701329    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="c7cf2c12-c0f4-41b0-8603-a290c563ae47" containerName="maas-api"
Jul 14 19:53:27.701516 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:53:27.701404    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="c7cf2c12-c0f4-41b0-8603-a290c563ae47" containerName="maas-api"
Jul 14 19:53:27.701516 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:53:27.701416    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="9bd27577-6134-4115-97b0-f8660e03473a" containerName="maas-api"
Jul 14 19:53:27.705971 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:53:27.705937    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-70659c-549b877896-5rc8v"
Jul 14 19:53:27.708530 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:53:27.708512    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-70659c-serving-cert\""
Jul 14 19:53:27.716532 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:53:27.716511    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-70659c-549b877896-5rc8v"]
Jul 14 19:53:27.814708 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:53:27.814676    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1bd4f7e9-8117-439b-b8d5-01f26ee2e0ff-maas-api-tls\") pod \"maas-api-e2e-shared-a-70659c-549b877896-5rc8v\" (UID: \"1bd4f7e9-8117-439b-b8d5-01f26ee2e0ff\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-70659c-549b877896-5rc8v"
Jul 14 19:53:27.814860 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:53:27.814736    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rxvcf\" (UniqueName: \"kubernetes.io/projected/1bd4f7e9-8117-439b-b8d5-01f26ee2e0ff-kube-api-access-rxvcf\") pod \"maas-api-e2e-shared-a-70659c-549b877896-5rc8v\" (UID: \"1bd4f7e9-8117-439b-b8d5-01f26ee2e0ff\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-70659c-549b877896-5rc8v"
Jul 14 19:53:27.814860 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:53:27.814806    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1bd4f7e9-8117-439b-b8d5-01f26ee2e0ff-openshift-service-ca\") pod \"maas-api-e2e-shared-a-70659c-549b877896-5rc8v\" (UID: \"1bd4f7e9-8117-439b-b8d5-01f26ee2e0ff\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-70659c-549b877896-5rc8v"
Jul 14 19:53:27.915903 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:53:27.915874    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rxvcf\" (UniqueName: \"kubernetes.io/projected/1bd4f7e9-8117-439b-b8d5-01f26ee2e0ff-kube-api-access-rxvcf\") pod \"maas-api-e2e-shared-a-70659c-549b877896-5rc8v\" (UID: \"1bd4f7e9-8117-439b-b8d5-01f26ee2e0ff\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-70659c-549b877896-5rc8v"
Jul 14 19:53:27.916037 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:53:27.915908    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1bd4f7e9-8117-439b-b8d5-01f26ee2e0ff-openshift-service-ca\") pod \"maas-api-e2e-shared-a-70659c-549b877896-5rc8v\" (UID: \"1bd4f7e9-8117-439b-b8d5-01f26ee2e0ff\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-70659c-549b877896-5rc8v"
Jul 14 19:53:27.916037 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:53:27.915963    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1bd4f7e9-8117-439b-b8d5-01f26ee2e0ff-maas-api-tls\") pod \"maas-api-e2e-shared-a-70659c-549b877896-5rc8v\" (UID: \"1bd4f7e9-8117-439b-b8d5-01f26ee2e0ff\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-70659c-549b877896-5rc8v"
Jul 14 19:53:27.916134 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:53:27.916069    2565 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-a-70659c-serving-cert: secret "maas-api-e2e-shared-a-70659c-serving-cert" not found
Jul 14 19:53:27.916134 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:53:27.916126    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1bd4f7e9-8117-439b-b8d5-01f26ee2e0ff-maas-api-tls podName:1bd4f7e9-8117-439b-b8d5-01f26ee2e0ff nodeName:}" failed. No retries permitted until 2026-07-14 19:53:28.416109691 +0000 UTC m=+2554.976966562 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/1bd4f7e9-8117-439b-b8d5-01f26ee2e0ff-maas-api-tls") pod "maas-api-e2e-shared-a-70659c-549b877896-5rc8v" (UID: "1bd4f7e9-8117-439b-b8d5-01f26ee2e0ff") : secret "maas-api-e2e-shared-a-70659c-serving-cert" not found
Jul 14 19:53:27.916616 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:53:27.916594    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1bd4f7e9-8117-439b-b8d5-01f26ee2e0ff-openshift-service-ca\") pod \"maas-api-e2e-shared-a-70659c-549b877896-5rc8v\" (UID: \"1bd4f7e9-8117-439b-b8d5-01f26ee2e0ff\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-70659c-549b877896-5rc8v"
Jul 14 19:53:27.925679 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:53:27.925656    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rxvcf\" (UniqueName: \"kubernetes.io/projected/1bd4f7e9-8117-439b-b8d5-01f26ee2e0ff-kube-api-access-rxvcf\") pod \"maas-api-e2e-shared-a-70659c-549b877896-5rc8v\" (UID: \"1bd4f7e9-8117-439b-b8d5-01f26ee2e0ff\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-70659c-549b877896-5rc8v"
Jul 14 19:53:28.419801 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:53:28.419762    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1bd4f7e9-8117-439b-b8d5-01f26ee2e0ff-maas-api-tls\") pod \"maas-api-e2e-shared-a-70659c-549b877896-5rc8v\" (UID: \"1bd4f7e9-8117-439b-b8d5-01f26ee2e0ff\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-70659c-549b877896-5rc8v"
Jul 14 19:53:28.422638 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:53:28.422612    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1bd4f7e9-8117-439b-b8d5-01f26ee2e0ff-maas-api-tls\") pod \"maas-api-e2e-shared-a-70659c-549b877896-5rc8v\" (UID: \"1bd4f7e9-8117-439b-b8d5-01f26ee2e0ff\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-70659c-549b877896-5rc8v"
Jul 14 19:53:28.617798 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:53:28.617764    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-70659c-549b877896-5rc8v"
Jul 14 19:53:28.759665 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:53:28.759634    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-70659c-549b877896-5rc8v"]
Jul 14 19:53:28.761141 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:53:28.761116    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1bd4f7e9_8117_439b_b8d5_01f26ee2e0ff.slice/crio-ae3fafc316b895f57f067b30d032d913f28dc80abe60c79aa31d08a49d81d8b8 WatchSource:0}: Error finding container ae3fafc316b895f57f067b30d032d913f28dc80abe60c79aa31d08a49d81d8b8: Status 404 returned error can't find the container with id ae3fafc316b895f57f067b30d032d913f28dc80abe60c79aa31d08a49d81d8b8
Jul 14 19:53:29.745937 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:53:29.745903    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-70659c-549b877896-5rc8v" event={"ID":"1bd4f7e9-8117-439b-b8d5-01f26ee2e0ff","Type":"ContainerStarted","Data":"0a53195b5a63b02c27c74ab392166d54b9c061375654303050cc4c884f1ce2b6"}
Jul 14 19:53:29.746113 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:53:29.745962    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-70659c-549b877896-5rc8v" event={"ID":"1bd4f7e9-8117-439b-b8d5-01f26ee2e0ff","Type":"ContainerStarted","Data":"ae3fafc316b895f57f067b30d032d913f28dc80abe60c79aa31d08a49d81d8b8"}
Jul 14 19:53:29.746113 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:53:29.746082    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-70659c-549b877896-5rc8v"
Jul 14 19:53:29.769571 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:53:29.769523    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-70659c-549b877896-5rc8v" podStartSLOduration=2.313174143 podStartE2EDuration="2.769509115s" totalImagesPullingTime="456.334972ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 19:53:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:53:29.767123291 +0000 UTC m=+2556.327980184" watchObservedRunningTime="2026-07-14 19:53:29.769509115 +0000 UTC m=+2556.330366039"
Jul 14 19:53:35.758087 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:53:35.758053    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-70659c-549b877896-5rc8v"
Jul 14 19:53:35.835143 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:53:35.835116    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-356b53-6d746fd977-ztf6t"]
Jul 14 19:53:35.838683 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:53:35.838662    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-356b53-6d746fd977-ztf6t"
Jul 14 19:53:35.842194 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:53:35.842169    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-356b53-serving-cert\""
Jul 14 19:53:35.859707 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:53:35.859682    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-356b53-6d746fd977-ztf6t"]
Jul 14 19:53:35.988394 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:53:35.988361    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/97d8dafe-6790-44e4-81a0-59c711d0c355-maas-api-tls\") pod \"maas-api-e2e-shared-b-356b53-6d746fd977-ztf6t\" (UID: \"97d8dafe-6790-44e4-81a0-59c711d0c355\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-356b53-6d746fd977-ztf6t"
Jul 14 19:53:35.988550 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:53:35.988409    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/97d8dafe-6790-44e4-81a0-59c711d0c355-openshift-service-ca\") pod \"maas-api-e2e-shared-b-356b53-6d746fd977-ztf6t\" (UID: \"97d8dafe-6790-44e4-81a0-59c711d0c355\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-356b53-6d746fd977-ztf6t"
Jul 14 19:53:35.988550 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:53:35.988436    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s6n72\" (UniqueName: \"kubernetes.io/projected/97d8dafe-6790-44e4-81a0-59c711d0c355-kube-api-access-s6n72\") pod \"maas-api-e2e-shared-b-356b53-6d746fd977-ztf6t\" (UID: \"97d8dafe-6790-44e4-81a0-59c711d0c355\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-356b53-6d746fd977-ztf6t"
Jul 14 19:53:36.089314 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:53:36.089228    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/97d8dafe-6790-44e4-81a0-59c711d0c355-openshift-service-ca\") pod \"maas-api-e2e-shared-b-356b53-6d746fd977-ztf6t\" (UID: \"97d8dafe-6790-44e4-81a0-59c711d0c355\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-356b53-6d746fd977-ztf6t"
Jul 14 19:53:36.089314 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:53:36.089277    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s6n72\" (UniqueName: \"kubernetes.io/projected/97d8dafe-6790-44e4-81a0-59c711d0c355-kube-api-access-s6n72\") pod \"maas-api-e2e-shared-b-356b53-6d746fd977-ztf6t\" (UID: \"97d8dafe-6790-44e4-81a0-59c711d0c355\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-356b53-6d746fd977-ztf6t"
Jul 14 19:53:36.089557 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:53:36.089364    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/97d8dafe-6790-44e4-81a0-59c711d0c355-maas-api-tls\") pod \"maas-api-e2e-shared-b-356b53-6d746fd977-ztf6t\" (UID: \"97d8dafe-6790-44e4-81a0-59c711d0c355\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-356b53-6d746fd977-ztf6t"
Jul 14 19:53:36.089858 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:53:36.089837    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/97d8dafe-6790-44e4-81a0-59c711d0c355-openshift-service-ca\") pod \"maas-api-e2e-shared-b-356b53-6d746fd977-ztf6t\" (UID: \"97d8dafe-6790-44e4-81a0-59c711d0c355\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-356b53-6d746fd977-ztf6t"
Jul 14 19:53:36.091825 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:53:36.091805    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/97d8dafe-6790-44e4-81a0-59c711d0c355-maas-api-tls\") pod \"maas-api-e2e-shared-b-356b53-6d746fd977-ztf6t\" (UID: \"97d8dafe-6790-44e4-81a0-59c711d0c355\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-356b53-6d746fd977-ztf6t"
Jul 14 19:53:36.101080 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:53:36.101050    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s6n72\" (UniqueName: \"kubernetes.io/projected/97d8dafe-6790-44e4-81a0-59c711d0c355-kube-api-access-s6n72\") pod \"maas-api-e2e-shared-b-356b53-6d746fd977-ztf6t\" (UID: \"97d8dafe-6790-44e4-81a0-59c711d0c355\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-356b53-6d746fd977-ztf6t"
Jul 14 19:53:36.149077 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:53:36.149052    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-356b53-6d746fd977-ztf6t"
Jul 14 19:53:36.299484 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:53:36.299456    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-356b53-6d746fd977-ztf6t"]
Jul 14 19:53:36.301845 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:53:36.301815    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97d8dafe_6790_44e4_81a0_59c711d0c355.slice/crio-b50cbbeb91181b1a366577e8c9b0d8e148eb2e8a7e46828583fbc68ea5b3cefa WatchSource:0}: Error finding container b50cbbeb91181b1a366577e8c9b0d8e148eb2e8a7e46828583fbc68ea5b3cefa: Status 404 returned error can't find the container with id b50cbbeb91181b1a366577e8c9b0d8e148eb2e8a7e46828583fbc68ea5b3cefa
Jul 14 19:53:36.791891 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:53:36.791861    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-356b53-6d746fd977-ztf6t" event={"ID":"97d8dafe-6790-44e4-81a0-59c711d0c355","Type":"ContainerStarted","Data":"281f33e22150f4d1755795dcd7c42bd2adda8686ea9915530b7660a42435e5e7"}
Jul 14 19:53:36.792213 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:53:36.791921    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-356b53-6d746fd977-ztf6t" event={"ID":"97d8dafe-6790-44e4-81a0-59c711d0c355","Type":"ContainerStarted","Data":"b50cbbeb91181b1a366577e8c9b0d8e148eb2e8a7e46828583fbc68ea5b3cefa"}
Jul 14 19:53:36.792213 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:53:36.791945    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-356b53-6d746fd977-ztf6t"
Jul 14 19:53:36.811789 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:53:36.811732    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-356b53-6d746fd977-ztf6t" podStartSLOduration=1.390703846 podStartE2EDuration="1.811716195s" totalImagesPullingTime="421.012349ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 19:53:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:53:36.811688341 +0000 UTC m=+2563.372545253" watchObservedRunningTime="2026-07-14 19:53:36.811716195 +0000 UTC m=+2563.372573129"
Jul 14 19:53:42.802891 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:53:42.802863    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-356b53-6d746fd977-ztf6t"
Jul 14 19:55:54.448656 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:55:54.448589    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-p5lb5_7ab60b2b-a644-4e35-b8b1-49c676e0f63f/console-operator/1.log"
Jul 14 19:55:54.451922 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:55:54.451902    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cqqv8_7a447cf6-9373-4497-8028-97d590f38262/ovn-acl-logging/0.log"
Jul 14 19:55:54.456016 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:55:54.455999    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-p5lb5_7ab60b2b-a644-4e35-b8b1-49c676e0f63f/console-operator/1.log"
Jul 14 19:55:54.459288 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:55:54.459272    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cqqv8_7a447cf6-9373-4497-8028-97d590f38262/ovn-acl-logging/0.log"
Jul 14 19:59:17.980391 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:59:17.980319    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-70659c-zj424"]
Jul 14 19:59:17.983748 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:59:17.983729    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-70659c-zj424"
Jul 14 19:59:17.985967 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:59:17.985945    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-br5f6\""
Jul 14 19:59:17.991018 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:59:17.990993    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-70659c-zj424"]
Jul 14 19:59:18.148369 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:59:18.148329    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e7d2504f-c9bc-4b90-bc6f-32151e0f61e0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-70659c-zj424\" (UID: \"e7d2504f-c9bc-4b90-bc6f-32151e0f61e0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-70659c-zj424"
Jul 14 19:59:18.249583 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:59:18.249491    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e7d2504f-c9bc-4b90-bc6f-32151e0f61e0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-70659c-zj424\" (UID: \"e7d2504f-c9bc-4b90-bc6f-32151e0f61e0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-70659c-zj424"
Jul 14 19:59:18.250098 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:59:18.250076    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e7d2504f-c9bc-4b90-bc6f-32151e0f61e0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-70659c-zj424\" (UID: \"e7d2504f-c9bc-4b90-bc6f-32151e0f61e0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-70659c-zj424"
Jul 14 19:59:18.295818 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:59:18.295793    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-70659c-zj424"
Jul 14 19:59:18.438517 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:59:18.438486    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-70659c-zj424"]
Jul 14 19:59:18.440358 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:59:18.440332    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7d2504f_c9bc_4b90_bc6f_32151e0f61e0.slice/crio-a2bd181c2b90a3dd29e9aa24d971263bd056e4ea00ed996f9b0e0c89ca77803f WatchSource:0}: Error finding container a2bd181c2b90a3dd29e9aa24d971263bd056e4ea00ed996f9b0e0c89ca77803f: Status 404 returned error can't find the container with id a2bd181c2b90a3dd29e9aa24d971263bd056e4ea00ed996f9b0e0c89ca77803f
Jul 14 19:59:18.810182 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:59:18.810115    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-70659c-zj424" event={"ID":"e7d2504f-c9bc-4b90-bc6f-32151e0f61e0","Type":"ContainerStarted","Data":"58faf0d36b33fce030fca0a6a757605a11201311d2cbec3d21484ff6b02307e1"}
Jul 14 19:59:18.810182 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:59:18.810185    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-70659c-zj424" event={"ID":"e7d2504f-c9bc-4b90-bc6f-32151e0f61e0","Type":"ContainerStarted","Data":"a2bd181c2b90a3dd29e9aa24d971263bd056e4ea00ed996f9b0e0c89ca77803f"}
Jul 14 19:59:18.826255 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:59:18.826208    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-70659c-zj424" podStartSLOduration=1.82619261 podStartE2EDuration="1.82619261s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 19:59:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:59:18.823321058 +0000 UTC m=+2905.384177971" watchObservedRunningTime="2026-07-14 19:59:18.82619261 +0000 UTC m=+2905.387049499"
Jul 14 19:59:19.817925 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:59:19.817891    2565 generic.go:356] "Generic (PLEG): container finished" podID="e7d2504f-c9bc-4b90-bc6f-32151e0f61e0" containerID="58faf0d36b33fce030fca0a6a757605a11201311d2cbec3d21484ff6b02307e1" exitCode=0
Jul 14 19:59:19.818329 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:59:19.817979    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-70659c-zj424" event={"ID":"e7d2504f-c9bc-4b90-bc6f-32151e0f61e0","Type":"ContainerDied","Data":"58faf0d36b33fce030fca0a6a757605a11201311d2cbec3d21484ff6b02307e1"}
Jul 14 19:59:20.967562 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:59:20.967537    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-70659c-zj424"
Jul 14 19:59:21.074743 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:59:21.074654    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e7d2504f-c9bc-4b90-bc6f-32151e0f61e0-maas-api-service-ca\") pod \"e7d2504f-c9bc-4b90-bc6f-32151e0f61e0\" (UID: \"e7d2504f-c9bc-4b90-bc6f-32151e0f61e0\") "
Jul 14 19:59:21.074988 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:59:21.074966    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e7d2504f-c9bc-4b90-bc6f-32151e0f61e0-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "e7d2504f-c9bc-4b90-bc6f-32151e0f61e0" (UID: "e7d2504f-c9bc-4b90-bc6f-32151e0f61e0"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 19:59:21.175611 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:59:21.175577    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e7d2504f-c9bc-4b90-bc6f-32151e0f61e0-maas-api-service-ca\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Jul 14 19:59:21.832233 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:59:21.832201    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-70659c-zj424"
Jul 14 19:59:21.832233 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:59:21.832226    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-70659c-zj424" event={"ID":"e7d2504f-c9bc-4b90-bc6f-32151e0f61e0","Type":"ContainerDied","Data":"a2bd181c2b90a3dd29e9aa24d971263bd056e4ea00ed996f9b0e0c89ca77803f"}
Jul 14 19:59:21.832468 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:59:21.832281    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a2bd181c2b90a3dd29e9aa24d971263bd056e4ea00ed996f9b0e0c89ca77803f"
Jul 14 19:59:28.802008 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:59:28.801969    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-70659c-549b877896-5rc8v"]
Jul 14 19:59:28.802603 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:59:28.802224    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-70659c-549b877896-5rc8v" podUID="1bd4f7e9-8117-439b-b8d5-01f26ee2e0ff" containerName="maas-api" containerID="cri-o://0a53195b5a63b02c27c74ab392166d54b9c061375654303050cc4c884f1ce2b6" gracePeriod=30
Jul 14 19:59:29.067974 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:59:29.067899    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-70659c-549b877896-5rc8v"
Jul 14 19:59:29.251509 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:59:29.251471    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1bd4f7e9-8117-439b-b8d5-01f26ee2e0ff-openshift-service-ca\") pod \"1bd4f7e9-8117-439b-b8d5-01f26ee2e0ff\" (UID: \"1bd4f7e9-8117-439b-b8d5-01f26ee2e0ff\") "
Jul 14 19:59:29.251716 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:59:29.251520    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1bd4f7e9-8117-439b-b8d5-01f26ee2e0ff-maas-api-tls\") pod \"1bd4f7e9-8117-439b-b8d5-01f26ee2e0ff\" (UID: \"1bd4f7e9-8117-439b-b8d5-01f26ee2e0ff\") "
Jul 14 19:59:29.251716 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:59:29.251645    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rxvcf\" (UniqueName: \"kubernetes.io/projected/1bd4f7e9-8117-439b-b8d5-01f26ee2e0ff-kube-api-access-rxvcf\") pod \"1bd4f7e9-8117-439b-b8d5-01f26ee2e0ff\" (UID: \"1bd4f7e9-8117-439b-b8d5-01f26ee2e0ff\") "
Jul 14 19:59:29.251862 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:59:29.251826    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1bd4f7e9-8117-439b-b8d5-01f26ee2e0ff-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "1bd4f7e9-8117-439b-b8d5-01f26ee2e0ff" (UID: "1bd4f7e9-8117-439b-b8d5-01f26ee2e0ff"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 19:59:29.253883 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:59:29.253848    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1bd4f7e9-8117-439b-b8d5-01f26ee2e0ff-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "1bd4f7e9-8117-439b-b8d5-01f26ee2e0ff" (UID: "1bd4f7e9-8117-439b-b8d5-01f26ee2e0ff"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 19:59:29.253978 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:59:29.253911    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1bd4f7e9-8117-439b-b8d5-01f26ee2e0ff-kube-api-access-rxvcf" (OuterVolumeSpecName: "kube-api-access-rxvcf") pod "1bd4f7e9-8117-439b-b8d5-01f26ee2e0ff" (UID: "1bd4f7e9-8117-439b-b8d5-01f26ee2e0ff"). InnerVolumeSpecName "kube-api-access-rxvcf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 19:59:29.352855 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:59:29.352764    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rxvcf\" (UniqueName: \"kubernetes.io/projected/1bd4f7e9-8117-439b-b8d5-01f26ee2e0ff-kube-api-access-rxvcf\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Jul 14 19:59:29.352855 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:59:29.352795    2565 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1bd4f7e9-8117-439b-b8d5-01f26ee2e0ff-openshift-service-ca\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Jul 14 19:59:29.352855 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:59:29.352805    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1bd4f7e9-8117-439b-b8d5-01f26ee2e0ff-maas-api-tls\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Jul 14 19:59:29.880788 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:59:29.880750    2565 generic.go:356] "Generic (PLEG): container finished" podID="1bd4f7e9-8117-439b-b8d5-01f26ee2e0ff" containerID="0a53195b5a63b02c27c74ab392166d54b9c061375654303050cc4c884f1ce2b6" exitCode=0
Jul 14 19:59:29.881230 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:59:29.880804    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-70659c-549b877896-5rc8v"
Jul 14 19:59:29.881230 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:59:29.880844    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-70659c-549b877896-5rc8v" event={"ID":"1bd4f7e9-8117-439b-b8d5-01f26ee2e0ff","Type":"ContainerDied","Data":"0a53195b5a63b02c27c74ab392166d54b9c061375654303050cc4c884f1ce2b6"}
Jul 14 19:59:29.881230 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:59:29.880900    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-70659c-549b877896-5rc8v" event={"ID":"1bd4f7e9-8117-439b-b8d5-01f26ee2e0ff","Type":"ContainerDied","Data":"ae3fafc316b895f57f067b30d032d913f28dc80abe60c79aa31d08a49d81d8b8"}
Jul 14 19:59:29.881230 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:59:29.880922    2565 scope.go:117] "RemoveContainer" containerID="0a53195b5a63b02c27c74ab392166d54b9c061375654303050cc4c884f1ce2b6"
Jul 14 19:59:29.894857 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:59:29.894824    2565 scope.go:117] "RemoveContainer" containerID="0a53195b5a63b02c27c74ab392166d54b9c061375654303050cc4c884f1ce2b6"
Jul 14 19:59:29.895444 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:59:29.895411    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0a53195b5a63b02c27c74ab392166d54b9c061375654303050cc4c884f1ce2b6\": container with ID starting with 0a53195b5a63b02c27c74ab392166d54b9c061375654303050cc4c884f1ce2b6 not found: ID does not exist" containerID="0a53195b5a63b02c27c74ab392166d54b9c061375654303050cc4c884f1ce2b6"
Jul 14 19:59:29.895550 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:59:29.895444    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0a53195b5a63b02c27c74ab392166d54b9c061375654303050cc4c884f1ce2b6"} err="failed to get container status \"0a53195b5a63b02c27c74ab392166d54b9c061375654303050cc4c884f1ce2b6\": rpc error: code = NotFound desc = could not find container \"0a53195b5a63b02c27c74ab392166d54b9c061375654303050cc4c884f1ce2b6\": container with ID starting with 0a53195b5a63b02c27c74ab392166d54b9c061375654303050cc4c884f1ce2b6 not found: ID does not exist"
Jul 14 19:59:29.910213 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:59:29.910178    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-70659c-549b877896-5rc8v"]
Jul 14 19:59:29.913816 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:59:29.913793    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-70659c-549b877896-5rc8v"]
Jul 14 19:59:29.969084 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:59:29.969054    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1bd4f7e9-8117-439b-b8d5-01f26ee2e0ff" path="/var/lib/kubelet/pods/1bd4f7e9-8117-439b-b8d5-01f26ee2e0ff/volumes"
Jul 14 19:59:44.182624 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:59:44.182590    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-356b53-97wnv"]
Jul 14 19:59:44.183044 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:59:44.183031    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1bd4f7e9-8117-439b-b8d5-01f26ee2e0ff" containerName="maas-api"
Jul 14 19:59:44.183044 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:59:44.183044    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="1bd4f7e9-8117-439b-b8d5-01f26ee2e0ff" containerName="maas-api"
Jul 14 19:59:44.183117 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:59:44.183053    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e7d2504f-c9bc-4b90-bc6f-32151e0f61e0" containerName="revoke-keys"
Jul 14 19:59:44.183117 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:59:44.183059    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="e7d2504f-c9bc-4b90-bc6f-32151e0f61e0" containerName="revoke-keys"
Jul 14 19:59:44.183217 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:59:44.183174    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="1bd4f7e9-8117-439b-b8d5-01f26ee2e0ff" containerName="maas-api"
Jul 14 19:59:44.183217 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:59:44.183185    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="e7d2504f-c9bc-4b90-bc6f-32151e0f61e0" containerName="revoke-keys"
Jul 14 19:59:44.186416 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:59:44.186392    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-356b53-97wnv"
Jul 14 19:59:44.189203 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:59:44.188980    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-br5f6\""
Jul 14 19:59:44.193071 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:59:44.193045    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-356b53-97wnv"]
Jul 14 19:59:44.278671 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:59:44.278636    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0c23efea-ebfe-4832-beb1-5a4640cdbcaa-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-356b53-97wnv\" (UID: \"0c23efea-ebfe-4832-beb1-5a4640cdbcaa\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-356b53-97wnv"
Jul 14 19:59:44.379984 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:59:44.379947    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0c23efea-ebfe-4832-beb1-5a4640cdbcaa-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-356b53-97wnv\" (UID: \"0c23efea-ebfe-4832-beb1-5a4640cdbcaa\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-356b53-97wnv"
Jul 14 19:59:44.380634 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:59:44.380615    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0c23efea-ebfe-4832-beb1-5a4640cdbcaa-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-356b53-97wnv\" (UID: \"0c23efea-ebfe-4832-beb1-5a4640cdbcaa\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-356b53-97wnv"
Jul 14 19:59:44.498424 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:59:44.498391    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-356b53-97wnv"
Jul 14 19:59:44.641025 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:59:44.640992    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-356b53-97wnv"]
Jul 14 19:59:44.642201 ip-10-0-129-23 kubenswrapper[2565]: W0714 19:59:44.642145    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c23efea_ebfe_4832_beb1_5a4640cdbcaa.slice/crio-a779a66270922f6288e56f27889c8039d124bc72e2a6fcc5feb82baab96353f4 WatchSource:0}: Error finding container a779a66270922f6288e56f27889c8039d124bc72e2a6fcc5feb82baab96353f4: Status 404 returned error can't find the container with id a779a66270922f6288e56f27889c8039d124bc72e2a6fcc5feb82baab96353f4
Jul 14 19:59:44.979245 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:59:44.979202    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-356b53-97wnv" event={"ID":"0c23efea-ebfe-4832-beb1-5a4640cdbcaa","Type":"ContainerStarted","Data":"57e0c10c64f778ff8bee87d817c91aa9960f5ee6b7f67066ccbf81b5c10baf1e"}
Jul 14 19:59:44.979442 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:59:44.979266    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-356b53-97wnv" event={"ID":"0c23efea-ebfe-4832-beb1-5a4640cdbcaa","Type":"ContainerStarted","Data":"a779a66270922f6288e56f27889c8039d124bc72e2a6fcc5feb82baab96353f4"}
Jul 14 19:59:44.994415 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:59:44.994363    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-356b53-97wnv" podStartSLOduration=0.994346871 podStartE2EDuration="994.346871ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 19:59:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:59:44.993023453 +0000 UTC m=+2931.553880383" watchObservedRunningTime="2026-07-14 19:59:44.994346871 +0000 UTC m=+2931.555203763"
Jul 14 19:59:45.986301 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:59:45.986270    2565 generic.go:356] "Generic (PLEG): container finished" podID="0c23efea-ebfe-4832-beb1-5a4640cdbcaa" containerID="57e0c10c64f778ff8bee87d817c91aa9960f5ee6b7f67066ccbf81b5c10baf1e" exitCode=0
Jul 14 19:59:45.986724 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:59:45.986304    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-356b53-97wnv" event={"ID":"0c23efea-ebfe-4832-beb1-5a4640cdbcaa","Type":"ContainerDied","Data":"57e0c10c64f778ff8bee87d817c91aa9960f5ee6b7f67066ccbf81b5c10baf1e"}
Jul 14 19:59:47.128958 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:59:47.128932    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-356b53-97wnv"
Jul 14 19:59:47.204314 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:59:47.204282    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0c23efea-ebfe-4832-beb1-5a4640cdbcaa-maas-api-service-ca\") pod \"0c23efea-ebfe-4832-beb1-5a4640cdbcaa\" (UID: \"0c23efea-ebfe-4832-beb1-5a4640cdbcaa\") "
Jul 14 19:59:47.204663 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:59:47.204642    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0c23efea-ebfe-4832-beb1-5a4640cdbcaa-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "0c23efea-ebfe-4832-beb1-5a4640cdbcaa" (UID: "0c23efea-ebfe-4832-beb1-5a4640cdbcaa"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 19:59:47.305216 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:59:47.305107    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0c23efea-ebfe-4832-beb1-5a4640cdbcaa-maas-api-service-ca\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Jul 14 19:59:47.999733 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:59:47.999700    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-356b53-97wnv" event={"ID":"0c23efea-ebfe-4832-beb1-5a4640cdbcaa","Type":"ContainerDied","Data":"a779a66270922f6288e56f27889c8039d124bc72e2a6fcc5feb82baab96353f4"}
Jul 14 19:59:47.999921 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:59:47.999737    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-356b53-97wnv"
Jul 14 19:59:47.999921 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:59:47.999749    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a779a66270922f6288e56f27889c8039d124bc72e2a6fcc5feb82baab96353f4"
Jul 14 19:59:54.682435 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:59:54.682401    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-356b53-6d746fd977-ztf6t"]
Jul 14 19:59:54.682873 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:59:54.682661    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-356b53-6d746fd977-ztf6t" podUID="97d8dafe-6790-44e4-81a0-59c711d0c355" containerName="maas-api" containerID="cri-o://281f33e22150f4d1755795dcd7c42bd2adda8686ea9915530b7660a42435e5e7" gracePeriod=30
Jul 14 19:59:54.943539 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:59:54.943512    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-356b53-6d746fd977-ztf6t"
Jul 14 19:59:55.043903 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:59:55.043870    2565 generic.go:356] "Generic (PLEG): container finished" podID="97d8dafe-6790-44e4-81a0-59c711d0c355" containerID="281f33e22150f4d1755795dcd7c42bd2adda8686ea9915530b7660a42435e5e7" exitCode=0
Jul 14 19:59:55.044104 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:59:55.043930    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-356b53-6d746fd977-ztf6t"
Jul 14 19:59:55.044104 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:59:55.043933    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-356b53-6d746fd977-ztf6t" event={"ID":"97d8dafe-6790-44e4-81a0-59c711d0c355","Type":"ContainerDied","Data":"281f33e22150f4d1755795dcd7c42bd2adda8686ea9915530b7660a42435e5e7"}
Jul 14 19:59:55.044104 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:59:55.044067    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-356b53-6d746fd977-ztf6t" event={"ID":"97d8dafe-6790-44e4-81a0-59c711d0c355","Type":"ContainerDied","Data":"b50cbbeb91181b1a366577e8c9b0d8e148eb2e8a7e46828583fbc68ea5b3cefa"}
Jul 14 19:59:55.044104 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:59:55.044104    2565 scope.go:117] "RemoveContainer" containerID="281f33e22150f4d1755795dcd7c42bd2adda8686ea9915530b7660a42435e5e7"
Jul 14 19:59:55.053752 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:59:55.053736    2565 scope.go:117] "RemoveContainer" containerID="281f33e22150f4d1755795dcd7c42bd2adda8686ea9915530b7660a42435e5e7"
Jul 14 19:59:55.054011 ip-10-0-129-23 kubenswrapper[2565]: E0714 19:59:55.053994    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"281f33e22150f4d1755795dcd7c42bd2adda8686ea9915530b7660a42435e5e7\": container with ID starting with 281f33e22150f4d1755795dcd7c42bd2adda8686ea9915530b7660a42435e5e7 not found: ID does not exist" containerID="281f33e22150f4d1755795dcd7c42bd2adda8686ea9915530b7660a42435e5e7"
Jul 14 19:59:55.054064 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:59:55.054019    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"281f33e22150f4d1755795dcd7c42bd2adda8686ea9915530b7660a42435e5e7"} err="failed to get container status \"281f33e22150f4d1755795dcd7c42bd2adda8686ea9915530b7660a42435e5e7\": rpc error: code = NotFound desc = could not find container \"281f33e22150f4d1755795dcd7c42bd2adda8686ea9915530b7660a42435e5e7\": container with ID starting with 281f33e22150f4d1755795dcd7c42bd2adda8686ea9915530b7660a42435e5e7 not found: ID does not exist"
Jul 14 19:59:55.076358 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:59:55.076334    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s6n72\" (UniqueName: \"kubernetes.io/projected/97d8dafe-6790-44e4-81a0-59c711d0c355-kube-api-access-s6n72\") pod \"97d8dafe-6790-44e4-81a0-59c711d0c355\" (UID: \"97d8dafe-6790-44e4-81a0-59c711d0c355\") "
Jul 14 19:59:55.076461 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:59:55.076400    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/97d8dafe-6790-44e4-81a0-59c711d0c355-openshift-service-ca\") pod \"97d8dafe-6790-44e4-81a0-59c711d0c355\" (UID: \"97d8dafe-6790-44e4-81a0-59c711d0c355\") "
Jul 14 19:59:55.076461 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:59:55.076421    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/97d8dafe-6790-44e4-81a0-59c711d0c355-maas-api-tls\") pod \"97d8dafe-6790-44e4-81a0-59c711d0c355\" (UID: \"97d8dafe-6790-44e4-81a0-59c711d0c355\") "
Jul 14 19:59:55.076794 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:59:55.076771    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/97d8dafe-6790-44e4-81a0-59c711d0c355-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "97d8dafe-6790-44e4-81a0-59c711d0c355" (UID: "97d8dafe-6790-44e4-81a0-59c711d0c355"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 19:59:55.078540 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:59:55.078516    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/97d8dafe-6790-44e4-81a0-59c711d0c355-kube-api-access-s6n72" (OuterVolumeSpecName: "kube-api-access-s6n72") pod "97d8dafe-6790-44e4-81a0-59c711d0c355" (UID: "97d8dafe-6790-44e4-81a0-59c711d0c355"). InnerVolumeSpecName "kube-api-access-s6n72". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 19:59:55.078627 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:59:55.078591    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/97d8dafe-6790-44e4-81a0-59c711d0c355-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "97d8dafe-6790-44e4-81a0-59c711d0c355" (UID: "97d8dafe-6790-44e4-81a0-59c711d0c355"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 19:59:55.177750 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:59:55.177717    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s6n72\" (UniqueName: \"kubernetes.io/projected/97d8dafe-6790-44e4-81a0-59c711d0c355-kube-api-access-s6n72\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Jul 14 19:59:55.177750 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:59:55.177744    2565 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/97d8dafe-6790-44e4-81a0-59c711d0c355-openshift-service-ca\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Jul 14 19:59:55.177750 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:59:55.177756    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/97d8dafe-6790-44e4-81a0-59c711d0c355-maas-api-tls\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Jul 14 19:59:55.367250 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:59:55.367220    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-356b53-6d746fd977-ztf6t"]
Jul 14 19:59:55.370962 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:59:55.370938    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-356b53-6d746fd977-ztf6t"]
Jul 14 19:59:55.969748 ip-10-0-129-23 kubenswrapper[2565]: I0714 19:59:55.969718    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="97d8dafe-6790-44e4-81a0-59c711d0c355" path="/var/lib/kubelet/pods/97d8dafe-6790-44e4-81a0-59c711d0c355/volumes"
Jul 14 20:00:00.138533 ip-10-0-129-23 kubenswrapper[2565]: I0714 20:00:00.138492    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29734320-4sfpb"]
Jul 14 20:00:00.138956 ip-10-0-129-23 kubenswrapper[2565]: I0714 20:00:00.138943    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="97d8dafe-6790-44e4-81a0-59c711d0c355" containerName="maas-api"
Jul 14 20:00:00.139005 ip-10-0-129-23 kubenswrapper[2565]: I0714 20:00:00.138958    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="97d8dafe-6790-44e4-81a0-59c711d0c355" containerName="maas-api"
Jul 14 20:00:00.139005 ip-10-0-129-23 kubenswrapper[2565]: I0714 20:00:00.138980    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0c23efea-ebfe-4832-beb1-5a4640cdbcaa" containerName="revoke-keys"
Jul 14 20:00:00.139005 ip-10-0-129-23 kubenswrapper[2565]: I0714 20:00:00.138986    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="0c23efea-ebfe-4832-beb1-5a4640cdbcaa" containerName="revoke-keys"
Jul 14 20:00:00.139098 ip-10-0-129-23 kubenswrapper[2565]: I0714 20:00:00.139057    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="0c23efea-ebfe-4832-beb1-5a4640cdbcaa" containerName="revoke-keys"
Jul 14 20:00:00.139098 ip-10-0-129-23 kubenswrapper[2565]: I0714 20:00:00.139071    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="97d8dafe-6790-44e4-81a0-59c711d0c355" containerName="maas-api"
Jul 14 20:00:00.143746 ip-10-0-129-23 kubenswrapper[2565]: I0714 20:00:00.143729    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29734320-4sfpb"
Jul 14 20:00:00.146267 ip-10-0-129-23 kubenswrapper[2565]: I0714 20:00:00.146240    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-br5f6\""
Jul 14 20:00:00.148251 ip-10-0-129-23 kubenswrapper[2565]: I0714 20:00:00.148218    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29734320-4sfpb"]
Jul 14 20:00:00.155691 ip-10-0-129-23 kubenswrapper[2565]: I0714 20:00:00.155665    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29734320-4sfpb"
Jul 14 20:00:00.306198 ip-10-0-129-23 kubenswrapper[2565]: I0714 20:00:00.306168    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29734320-4sfpb"]
Jul 14 20:00:00.308176 ip-10-0-129-23 kubenswrapper[2565]: W0714 20:00:00.308105    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5170fc59_1c50_4755_9a39_3c6a12f91f12.slice/crio-e4eca7dcc4920a0cedf33a751cfa4a743ce234518de0980548d2877f594fc3c0 WatchSource:0}: Error finding container e4eca7dcc4920a0cedf33a751cfa4a743ce234518de0980548d2877f594fc3c0: Status 404 returned error can't find the container with id e4eca7dcc4920a0cedf33a751cfa4a743ce234518de0980548d2877f594fc3c0
Jul 14 20:00:01.084670 ip-10-0-129-23 kubenswrapper[2565]: I0714 20:00:01.084633    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29734320-4sfpb" event={"ID":"5170fc59-1c50-4755-9a39-3c6a12f91f12","Type":"ContainerStarted","Data":"0f0cec6cfff7580c1551b834c1028fac6c6a4d2b3f7e3136e3affcc328e76598"}
Jul 14 20:00:01.084862 ip-10-0-129-23 kubenswrapper[2565]: I0714 20:00:01.084688    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29734320-4sfpb" event={"ID":"5170fc59-1c50-4755-9a39-3c6a12f91f12","Type":"ContainerStarted","Data":"e4eca7dcc4920a0cedf33a751cfa4a743ce234518de0980548d2877f594fc3c0"}
Jul 14 20:00:01.101412 ip-10-0-129-23 kubenswrapper[2565]: I0714 20:00:01.101356    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29734320-4sfpb" podStartSLOduration=1.101335208 podStartE2EDuration="1.101335208s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 20:00:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 20:00:01.098837046 +0000 UTC m=+2947.659693939" watchObservedRunningTime="2026-07-14 20:00:01.101335208 +0000 UTC m=+2947.662192100"
Jul 14 20:00:02.092782 ip-10-0-129-23 kubenswrapper[2565]: I0714 20:00:02.092749    2565 generic.go:356] "Generic (PLEG): container finished" podID="5170fc59-1c50-4755-9a39-3c6a12f91f12" containerID="0f0cec6cfff7580c1551b834c1028fac6c6a4d2b3f7e3136e3affcc328e76598" exitCode=0
Jul 14 20:00:02.093189 ip-10-0-129-23 kubenswrapper[2565]: I0714 20:00:02.092792    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29734320-4sfpb" event={"ID":"5170fc59-1c50-4755-9a39-3c6a12f91f12","Type":"ContainerDied","Data":"0f0cec6cfff7580c1551b834c1028fac6c6a4d2b3f7e3136e3affcc328e76598"}
Jul 14 20:00:03.251451 ip-10-0-129-23 kubenswrapper[2565]: I0714 20:00:03.251424    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29734320-4sfpb"
Jul 14 20:00:04.111022 ip-10-0-129-23 kubenswrapper[2565]: I0714 20:00:04.110993    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29734320-4sfpb"
Jul 14 20:00:04.111206 ip-10-0-129-23 kubenswrapper[2565]: I0714 20:00:04.111029    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29734320-4sfpb" event={"ID":"5170fc59-1c50-4755-9a39-3c6a12f91f12","Type":"ContainerDied","Data":"e4eca7dcc4920a0cedf33a751cfa4a743ce234518de0980548d2877f594fc3c0"}
Jul 14 20:00:04.111206 ip-10-0-129-23 kubenswrapper[2565]: I0714 20:00:04.111080    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e4eca7dcc4920a0cedf33a751cfa4a743ce234518de0980548d2877f594fc3c0"
Jul 14 20:00:15.876897 ip-10-0-129-23 kubenswrapper[2565]: I0714 20:00:15.876823    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-59s7m_a6cc2edb-535e-453e-8dae-347994f44b03/manager/0.log"
Jul 14 20:00:16.002276 ip-10-0-129-23 kubenswrapper[2565]: I0714 20:00:16.002242    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-8jx5x_477ec5d3-633e-43ad-884d-04ecf8e99df4/manager/0.log"
Jul 14 20:00:16.132535 ip-10-0-129-23 kubenswrapper[2565]: I0714 20:00:16.132440    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-5b78ddfc45-gt9gb_4f76d117-82eb-4b68-a42a-59215f66e436/manager/0.log"
Jul 14 20:00:16.260272 ip-10-0-129-23 kubenswrapper[2565]: I0714 20:00:16.260249    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-76jnp_c946ab58-d1fd-4016-9310-3dbf08b679c6/server/0.log"
Jul 14 20:00:16.653357 ip-10-0-129-23 kubenswrapper[2565]: I0714 20:00:16.653329    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6f9786d97d-mchdj_b4d66fe5-f315-4b5b-9c1b-7c539e02a839/copy-manifests/0.log"
Jul 14 20:00:16.660264 ip-10-0-129-23 kubenswrapper[2565]: I0714 20:00:16.660244    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6f9786d97d-mchdj_b4d66fe5-f315-4b5b-9c1b-7c539e02a839/manager/0.log"
Jul 14 20:00:17.192125 ip-10-0-129-23 kubenswrapper[2565]: I0714 20:00:17.192088    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-7bc9dcdd9d-7p6lq_5cc3d411-fdd7-4729-afb1-e16375350774/maas-api/0.log"
Jul 14 20:00:17.309618 ip-10-0-129-23 kubenswrapper[2565]: I0714 20:00:17.309589    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29734290-fmvlg_56ecd4ec-affb-4f99-a737-c003170de533/cleanup/0.log"
Jul 14 20:00:17.429948 ip-10-0-129-23 kubenswrapper[2565]: I0714 20:00:17.429918    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29734305-84vvm_edba4ece-28c7-4c4d-96f3-6448601ffcd0/cleanup/0.log"
Jul 14 20:00:17.555731 ip-10-0-129-23 kubenswrapper[2565]: I0714 20:00:17.555703    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29734320-4sfpb_5170fc59-1c50-4755-9a39-3c6a12f91f12/cleanup/0.log"
Jul 14 20:00:18.286040 ip-10-0-129-23 kubenswrapper[2565]: I0714 20:00:18.286012    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-inf-a-0c147a-8cm49_e68a11aa-53af-4e30-b533-bdfabc89ad29/revoke-keys/0.log"
Jul 14 20:00:18.404570 ip-10-0-129-23 kubenswrapper[2565]: I0714 20:00:18.404536    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-inf-b-7fc5dd-892pr_97eafccc-25ca-4907-9641-7d1ae4921672/revoke-keys/0.log"
Jul 14 20:00:18.882080 ip-10-0-129-23 kubenswrapper[2565]: I0714 20:00:18.882053    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-shared-a-70659c-zj424_e7d2504f-c9bc-4b90-bc6f-32151e0f61e0/revoke-keys/0.log"
Jul 14 20:00:18.999427 ip-10-0-129-23 kubenswrapper[2565]: I0714 20:00:18.999403    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-shared-b-356b53-97wnv_0c23efea-ebfe-4832-beb1-5a4640cdbcaa/revoke-keys/0.log"
Jul 14 20:00:19.962841 ip-10-0-129-23 kubenswrapper[2565]: I0714 20:00:19.962810    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595q484_96d2ff75-d472-4381-b506-9732d122a030/util/0.log"
Jul 14 20:00:19.969262 ip-10-0-129-23 kubenswrapper[2565]: I0714 20:00:19.969237    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595q484_96d2ff75-d472-4381-b506-9732d122a030/pull/0.log"
Jul 14 20:00:19.975536 ip-10-0-129-23 kubenswrapper[2565]: I0714 20:00:19.975518    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595q484_96d2ff75-d472-4381-b506-9732d122a030/extract/0.log"
Jul 14 20:00:20.098969 ip-10-0-129-23 kubenswrapper[2565]: I0714 20:00:20.098942    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0bcx7z_f4738274-1650-4b36-8c34-8bc1c71050ac/util/0.log"
Jul 14 20:00:20.105608 ip-10-0-129-23 kubenswrapper[2565]: I0714 20:00:20.105587    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0bcx7z_f4738274-1650-4b36-8c34-8bc1c71050ac/pull/0.log"
Jul 14 20:00:20.112827 ip-10-0-129-23 kubenswrapper[2565]: I0714 20:00:20.112809    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0bcx7z_f4738274-1650-4b36-8c34-8bc1c71050ac/extract/0.log"
Jul 14 20:00:20.236749 ip-10-0-129-23 kubenswrapper[2565]: I0714 20:00:20.236732    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736qcrg_fd9e1d7d-4294-42c8-82e1-351b6373a8d6/util/0.log"
Jul 14 20:00:20.243324 ip-10-0-129-23 kubenswrapper[2565]: I0714 20:00:20.243306    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736qcrg_fd9e1d7d-4294-42c8-82e1-351b6373a8d6/pull/0.log"
Jul 14 20:00:20.249371 ip-10-0-129-23 kubenswrapper[2565]: I0714 20:00:20.249355    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736qcrg_fd9e1d7d-4294-42c8-82e1-351b6373a8d6/extract/0.log"
Jul 14 20:00:20.373500 ip-10-0-129-23 kubenswrapper[2565]: I0714 20:00:20.373475    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jg8rq_11705ca2-7d60-4441-92d1-90987e0f1a4e/util/0.log"
Jul 14 20:00:20.381978 ip-10-0-129-23 kubenswrapper[2565]: I0714 20:00:20.381946    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jg8rq_11705ca2-7d60-4441-92d1-90987e0f1a4e/pull/0.log"
Jul 14 20:00:20.388755 ip-10-0-129-23 kubenswrapper[2565]: I0714 20:00:20.388740    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jg8rq_11705ca2-7d60-4441-92d1-90987e0f1a4e/extract/0.log"
Jul 14 20:00:20.639741 ip-10-0-129-23 kubenswrapper[2565]: I0714 20:00:20.639656    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-5shhk_8101abc0-2e64-4ffe-80a4-7fcdbad99b44/manager/0.log"
Jul 14 20:00:21.765515 ip-10-0-129-23 kubenswrapper[2565]: I0714 20:00:21.765470    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4sklb8_f9309242-1edc-409b-bc18-d243463b18d5/istio-proxy/0.log"
Jul 14 20:00:21.892135 ip-10-0-129-23 kubenswrapper[2565]: I0714 20:00:21.892109    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-l9wqn_63d095e3-a845-49d3-a5a9-abd823fad9aa/discovery/0.log"
Jul 14 20:00:22.014006 ip-10-0-129-23 kubenswrapper[2565]: I0714 20:00:22.013972    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5d877944c-867np_adda783a-0ef9-40a9-99a7-445d881305ec/kube-auth-proxy/0.log"
Jul 14 20:00:22.415048 ip-10-0-129-23 kubenswrapper[2565]: I0714 20:00:22.415022    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-74584bb9f8-b4jv2_f17ce124-5d01-4fe3-ae66-be3813fa2e25/payload-pre-processing/0.log"
Jul 14 20:00:22.539214 ip-10-0-129-23 kubenswrapper[2565]: I0714 20:00:22.539174    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-f9b8d9b9b-vm7fk_ae0538c4-1104-47c5-b186-71789e6fab74/payload-processing/0.log"
Jul 14 20:00:23.042533 ip-10-0-129-23 kubenswrapper[2565]: I0714 20:00:23.042507    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-br2wd_7bb79158-0469-4f56-89eb-960151e68f68/main/0.log"
Jul 14 20:00:23.286814 ip-10-0-129-23 kubenswrapper[2565]: I0714 20:00:23.286784    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-4ddwp_7d4b8bd7-dead-46db-9798-aad909af3259/main/0.log"
Jul 14 20:00:30.980234 ip-10-0-129-23 kubenswrapper[2565]: I0714 20:00:30.980200    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-lkbtz_8a7994c4-4dcd-4b18-a6f3-580eda35a3d9/global-pull-secret-syncer/0.log"
Jul 14 20:00:31.130087 ip-10-0-129-23 kubenswrapper[2565]: I0714 20:00:31.130055    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-ppqk5_d02ff63b-3fa8-432f-aa86-c517e74ae017/konnectivity-agent/0.log"
Jul 14 20:00:31.173464 ip-10-0-129-23 kubenswrapper[2565]: I0714 20:00:31.173427    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-129-23.ec2.internal_671780e245728d8f6e843008df2b039a/haproxy/0.log"
Jul 14 20:00:35.394398 ip-10-0-129-23 kubenswrapper[2565]: I0714 20:00:35.394367    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595q484_96d2ff75-d472-4381-b506-9732d122a030/extract/0.log"
Jul 14 20:00:35.415054 ip-10-0-129-23 kubenswrapper[2565]: I0714 20:00:35.415026    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595q484_96d2ff75-d472-4381-b506-9732d122a030/util/0.log"
Jul 14 20:00:35.438302 ip-10-0-129-23 kubenswrapper[2565]: I0714 20:00:35.438275    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595q484_96d2ff75-d472-4381-b506-9732d122a030/pull/0.log"
Jul 14 20:00:35.476477 ip-10-0-129-23 kubenswrapper[2565]: I0714 20:00:35.476453    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0bcx7z_f4738274-1650-4b36-8c34-8bc1c71050ac/extract/0.log"
Jul 14 20:00:35.498408 ip-10-0-129-23 kubenswrapper[2565]: I0714 20:00:35.498382    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0bcx7z_f4738274-1650-4b36-8c34-8bc1c71050ac/util/0.log"
Jul 14 20:00:35.517326 ip-10-0-129-23 kubenswrapper[2565]: I0714 20:00:35.517305    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0bcx7z_f4738274-1650-4b36-8c34-8bc1c71050ac/pull/0.log"
Jul 14 20:00:35.547201 ip-10-0-129-23 kubenswrapper[2565]: I0714 20:00:35.547181    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736qcrg_fd9e1d7d-4294-42c8-82e1-351b6373a8d6/extract/0.log"
Jul 14 20:00:35.570736 ip-10-0-129-23 kubenswrapper[2565]: I0714 20:00:35.570716    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736qcrg_fd9e1d7d-4294-42c8-82e1-351b6373a8d6/util/0.log"
Jul 14 20:00:35.592014 ip-10-0-129-23 kubenswrapper[2565]: I0714 20:00:35.591994    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736qcrg_fd9e1d7d-4294-42c8-82e1-351b6373a8d6/pull/0.log"
Jul 14 20:00:35.622202 ip-10-0-129-23 kubenswrapper[2565]: I0714 20:00:35.622183    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jg8rq_11705ca2-7d60-4441-92d1-90987e0f1a4e/extract/0.log"
Jul 14 20:00:35.643671 ip-10-0-129-23 kubenswrapper[2565]: I0714 20:00:35.643650    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jg8rq_11705ca2-7d60-4441-92d1-90987e0f1a4e/util/0.log"
Jul 14 20:00:35.663886 ip-10-0-129-23 kubenswrapper[2565]: I0714 20:00:35.663825    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jg8rq_11705ca2-7d60-4441-92d1-90987e0f1a4e/pull/0.log"
Jul 14 20:00:36.109249 ip-10-0-129-23 kubenswrapper[2565]: I0714 20:00:36.109219    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-5shhk_8101abc0-2e64-4ffe-80a4-7fcdbad99b44/manager/0.log"
Jul 14 20:00:37.895660 ip-10-0-129-23 kubenswrapper[2565]: I0714 20:00:37.895628    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7d74bf17-154e-4367-8adc-2dd1505a99d5/alertmanager/0.log"
Jul 14 20:00:37.922831 ip-10-0-129-23 kubenswrapper[2565]: I0714 20:00:37.922804    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7d74bf17-154e-4367-8adc-2dd1505a99d5/config-reloader/0.log"
Jul 14 20:00:37.950655 ip-10-0-129-23 kubenswrapper[2565]: I0714 20:00:37.950628    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7d74bf17-154e-4367-8adc-2dd1505a99d5/kube-rbac-proxy-web/0.log"
Jul 14 20:00:37.971008 ip-10-0-129-23 kubenswrapper[2565]: I0714 20:00:37.970976    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7d74bf17-154e-4367-8adc-2dd1505a99d5/kube-rbac-proxy/0.log"
Jul 14 20:00:37.996456 ip-10-0-129-23 kubenswrapper[2565]: I0714 20:00:37.996424    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7d74bf17-154e-4367-8adc-2dd1505a99d5/kube-rbac-proxy-metric/0.log"
Jul 14 20:00:38.021254 ip-10-0-129-23 kubenswrapper[2565]: I0714 20:00:38.021218    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7d74bf17-154e-4367-8adc-2dd1505a99d5/prom-label-proxy/0.log"
Jul 14 20:00:38.047090 ip-10-0-129-23 kubenswrapper[2565]: I0714 20:00:38.047062    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7d74bf17-154e-4367-8adc-2dd1505a99d5/init-config-reloader/0.log"
Jul 14 20:00:38.242804 ip-10-0-129-23 kubenswrapper[2565]: I0714 20:00:38.242779    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-68dcbc58c-w8rtn_c98f66f6-6388-4a8c-b7b8-b7056790025c/metrics-server/0.log"
Jul 14 20:00:38.287660 ip-10-0-129-23 kubenswrapper[2565]: I0714 20:00:38.287631    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5f68df7f58-9cwr4_02b13352-bd43-4303-8b23-52eb0caed47d/monitoring-plugin/0.log"
Jul 14 20:00:38.409866 ip-10-0-129-23 kubenswrapper[2565]: I0714 20:00:38.409842    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-lpsw7_86cc3494-b30a-4c30-9000-bf048d51f7e2/node-exporter/0.log"
Jul 14 20:00:38.428718 ip-10-0-129-23 kubenswrapper[2565]: I0714 20:00:38.428692    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-lpsw7_86cc3494-b30a-4c30-9000-bf048d51f7e2/kube-rbac-proxy/0.log"
Jul 14 20:00:38.448923 ip-10-0-129-23 kubenswrapper[2565]: I0714 20:00:38.448866    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-lpsw7_86cc3494-b30a-4c30-9000-bf048d51f7e2/init-textfile/0.log"
Jul 14 20:00:38.817110 ip-10-0-129-23 kubenswrapper[2565]: I0714 20:00:38.817083    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-64785b6675-b8jsk_f722f05c-64a7-4bb3-ab0b-24d6c56c3e5a/prometheus-operator/0.log"
Jul 14 20:00:38.838061 ip-10-0-129-23 kubenswrapper[2565]: I0714 20:00:38.838038    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-64785b6675-b8jsk_f722f05c-64a7-4bb3-ab0b-24d6c56c3e5a/kube-rbac-proxy/0.log"
Jul 14 20:00:38.862058 ip-10-0-129-23 kubenswrapper[2565]: I0714 20:00:38.862039    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-77d98bc786-4wv2j_067a3776-b83c-4132-a75e-da5bcef23f4a/prometheus-operator-admission-webhook/0.log"
Jul 14 20:00:38.993345 ip-10-0-129-23 kubenswrapper[2565]: I0714 20:00:38.993304    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-696bc7564-826gk_cf930f53-bb6b-43f3-8a01-7d5797b0d75f/thanos-query/0.log"
Jul 14 20:00:39.015541 ip-10-0-129-23 kubenswrapper[2565]: I0714 20:00:39.015521    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-696bc7564-826gk_cf930f53-bb6b-43f3-8a01-7d5797b0d75f/kube-rbac-proxy-web/0.log"
Jul 14 20:00:39.039943 ip-10-0-129-23 kubenswrapper[2565]: I0714 20:00:39.039921    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-696bc7564-826gk_cf930f53-bb6b-43f3-8a01-7d5797b0d75f/kube-rbac-proxy/0.log"
Jul 14 20:00:39.058109 ip-10-0-129-23 kubenswrapper[2565]: I0714 20:00:39.058092    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-696bc7564-826gk_cf930f53-bb6b-43f3-8a01-7d5797b0d75f/prom-label-proxy/0.log"
Jul 14 20:00:39.079584 ip-10-0-129-23 kubenswrapper[2565]: I0714 20:00:39.079528    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-696bc7564-826gk_cf930f53-bb6b-43f3-8a01-7d5797b0d75f/kube-rbac-proxy-rules/0.log"
Jul 14 20:00:39.101905 ip-10-0-129-23 kubenswrapper[2565]: I0714 20:00:39.101885    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-696bc7564-826gk_cf930f53-bb6b-43f3-8a01-7d5797b0d75f/kube-rbac-proxy-metrics/0.log"
Jul 14 20:00:40.388832 ip-10-0-129-23 kubenswrapper[2565]: I0714 20:00:40.388804    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6cf856758c-9bkzn_13fae2a1-59f5-4880-8045-12b6ce931d3f/networking-console-plugin/0.log"
Jul 14 20:00:41.036563 ip-10-0-129-23 kubenswrapper[2565]: I0714 20:00:41.036532    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-p5lb5_7ab60b2b-a644-4e35-b8b1-49c676e0f63f/console-operator/1.log"
Jul 14 20:00:41.040701 ip-10-0-129-23 kubenswrapper[2565]: I0714 20:00:41.040685    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-p5lb5_7ab60b2b-a644-4e35-b8b1-49c676e0f63f/console-operator/2.log"
Jul 14 20:00:41.593643 ip-10-0-129-23 kubenswrapper[2565]: I0714 20:00:41.593619    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-68c9cbb497-dbsmm_bbcea941-8508-4926-89fd-e4df1191df74/download-server/0.log"
Jul 14 20:00:42.173513 ip-10-0-129-23 kubenswrapper[2565]: I0714 20:00:42.173490    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78495597f6-9qq8x_1ec54941-8411-4559-97ba-84a7de6529fc/volume-data-source-validator/0.log"
Jul 14 20:00:43.245053 ip-10-0-129-23 kubenswrapper[2565]: I0714 20:00:43.245026    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-g85df_648852a8-be96-4782-bfdc-76bdce2ab8b5/dns/0.log"
Jul 14 20:00:43.263822 ip-10-0-129-23 kubenswrapper[2565]: I0714 20:00:43.263800    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-g85df_648852a8-be96-4782-bfdc-76bdce2ab8b5/kube-rbac-proxy/0.log"
Jul 14 20:00:43.286075 ip-10-0-129-23 kubenswrapper[2565]: I0714 20:00:43.286049    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-gx8lp_9d44b622-d76b-4616-af94-e7d9b6f2f67b/dns-node-resolver/0.log"
Jul 14 20:00:43.885834 ip-10-0-129-23 kubenswrapper[2565]: I0714 20:00:43.885805    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-kjr5k_06f772af-8888-44a7-9035-bd5ca76ac90e/node-ca/0.log"
Jul 14 20:00:44.406501 ip-10-0-129-23 kubenswrapper[2565]: I0714 20:00:44.406469    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-bmp8z/perf-node-gather-daemonset-gs7m2"]
Jul 14 20:00:44.406938 ip-10-0-129-23 kubenswrapper[2565]: I0714 20:00:44.406924    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5170fc59-1c50-4755-9a39-3c6a12f91f12" containerName="cleanup"
Jul 14 20:00:44.406988 ip-10-0-129-23 kubenswrapper[2565]: I0714 20:00:44.406941    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="5170fc59-1c50-4755-9a39-3c6a12f91f12" containerName="cleanup"
Jul 14 20:00:44.407051 ip-10-0-129-23 kubenswrapper[2565]: I0714 20:00:44.407041    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="5170fc59-1c50-4755-9a39-3c6a12f91f12" containerName="cleanup"
Jul 14 20:00:44.410383 ip-10-0-129-23 kubenswrapper[2565]: I0714 20:00:44.410363    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-bmp8z/perf-node-gather-daemonset-gs7m2"
Jul 14 20:00:44.412945 ip-10-0-129-23 kubenswrapper[2565]: I0714 20:00:44.412926    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-bmp8z\"/\"kube-root-ca.crt\""
Jul 14 20:00:44.413037 ip-10-0-129-23 kubenswrapper[2565]: I0714 20:00:44.412968    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-bmp8z\"/\"openshift-service-ca.crt\""
Jul 14 20:00:44.413089 ip-10-0-129-23 kubenswrapper[2565]: I0714 20:00:44.413066    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-bmp8z\"/\"default-dockercfg-skmfs\""
Jul 14 20:00:44.417425 ip-10-0-129-23 kubenswrapper[2565]: I0714 20:00:44.417406    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-bmp8z/perf-node-gather-daemonset-gs7m2"]
Jul 14 20:00:44.524768 ip-10-0-129-23 kubenswrapper[2565]: I0714 20:00:44.524725    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/582fc71f-2439-4bed-ab49-5547660f40cf-podres\") pod \"perf-node-gather-daemonset-gs7m2\" (UID: \"582fc71f-2439-4bed-ab49-5547660f40cf\") " pod="openshift-must-gather-bmp8z/perf-node-gather-daemonset-gs7m2"
Jul 14 20:00:44.524948 ip-10-0-129-23 kubenswrapper[2565]: I0714 20:00:44.524868    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/582fc71f-2439-4bed-ab49-5547660f40cf-lib-modules\") pod \"perf-node-gather-daemonset-gs7m2\" (UID: \"582fc71f-2439-4bed-ab49-5547660f40cf\") " pod="openshift-must-gather-bmp8z/perf-node-gather-daemonset-gs7m2"
Jul 14 20:00:44.524948 ip-10-0-129-23 kubenswrapper[2565]: I0714 20:00:44.524909    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/582fc71f-2439-4bed-ab49-5547660f40cf-proc\") pod \"perf-node-gather-daemonset-gs7m2\" (UID: \"582fc71f-2439-4bed-ab49-5547660f40cf\") " pod="openshift-must-gather-bmp8z/perf-node-gather-daemonset-gs7m2"
Jul 14 20:00:44.525077 ip-10-0-129-23 kubenswrapper[2565]: I0714 20:00:44.524967    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-49gtk\" (UniqueName: \"kubernetes.io/projected/582fc71f-2439-4bed-ab49-5547660f40cf-kube-api-access-49gtk\") pod \"perf-node-gather-daemonset-gs7m2\" (UID: \"582fc71f-2439-4bed-ab49-5547660f40cf\") " pod="openshift-must-gather-bmp8z/perf-node-gather-daemonset-gs7m2"
Jul 14 20:00:44.525077 ip-10-0-129-23 kubenswrapper[2565]: I0714 20:00:44.525008    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/582fc71f-2439-4bed-ab49-5547660f40cf-sys\") pod \"perf-node-gather-daemonset-gs7m2\" (UID: \"582fc71f-2439-4bed-ab49-5547660f40cf\") " pod="openshift-must-gather-bmp8z/perf-node-gather-daemonset-gs7m2"
Jul 14 20:00:44.625823 ip-10-0-129-23 kubenswrapper[2565]: I0714 20:00:44.625794    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/582fc71f-2439-4bed-ab49-5547660f40cf-podres\") pod \"perf-node-gather-daemonset-gs7m2\" (UID: \"582fc71f-2439-4bed-ab49-5547660f40cf\") " pod="openshift-must-gather-bmp8z/perf-node-gather-daemonset-gs7m2"
Jul 14 20:00:44.625974 ip-10-0-129-23 kubenswrapper[2565]: I0714 20:00:44.625865    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/582fc71f-2439-4bed-ab49-5547660f40cf-lib-modules\") pod \"perf-node-gather-daemonset-gs7m2\" (UID: \"582fc71f-2439-4bed-ab49-5547660f40cf\") " pod="openshift-must-gather-bmp8z/perf-node-gather-daemonset-gs7m2"
Jul 14 20:00:44.625974 ip-10-0-129-23 kubenswrapper[2565]: I0714 20:00:44.625891    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/582fc71f-2439-4bed-ab49-5547660f40cf-proc\") pod \"perf-node-gather-daemonset-gs7m2\" (UID: \"582fc71f-2439-4bed-ab49-5547660f40cf\") " pod="openshift-must-gather-bmp8z/perf-node-gather-daemonset-gs7m2"
Jul 14 20:00:44.625974 ip-10-0-129-23 kubenswrapper[2565]: I0714 20:00:44.625924    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-49gtk\" (UniqueName: \"kubernetes.io/projected/582fc71f-2439-4bed-ab49-5547660f40cf-kube-api-access-49gtk\") pod \"perf-node-gather-daemonset-gs7m2\" (UID: \"582fc71f-2439-4bed-ab49-5547660f40cf\") " pod="openshift-must-gather-bmp8z/perf-node-gather-daemonset-gs7m2"
Jul 14 20:00:44.625974 ip-10-0-129-23 kubenswrapper[2565]: I0714 20:00:44.625962    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/582fc71f-2439-4bed-ab49-5547660f40cf-sys\") pod \"perf-node-gather-daemonset-gs7m2\" (UID: \"582fc71f-2439-4bed-ab49-5547660f40cf\") " pod="openshift-must-gather-bmp8z/perf-node-gather-daemonset-gs7m2"
Jul 14 20:00:44.626183 ip-10-0-129-23 kubenswrapper[2565]: I0714 20:00:44.625972    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/582fc71f-2439-4bed-ab49-5547660f40cf-podres\") pod \"perf-node-gather-daemonset-gs7m2\" (UID: \"582fc71f-2439-4bed-ab49-5547660f40cf\") " pod="openshift-must-gather-bmp8z/perf-node-gather-daemonset-gs7m2"
Jul 14 20:00:44.626183 ip-10-0-129-23 kubenswrapper[2565]: I0714 20:00:44.626024    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/582fc71f-2439-4bed-ab49-5547660f40cf-proc\") pod \"perf-node-gather-daemonset-gs7m2\" (UID: \"582fc71f-2439-4bed-ab49-5547660f40cf\") " pod="openshift-must-gather-bmp8z/perf-node-gather-daemonset-gs7m2"
Jul 14 20:00:44.626183 ip-10-0-129-23 kubenswrapper[2565]: I0714 20:00:44.626031    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/582fc71f-2439-4bed-ab49-5547660f40cf-lib-modules\") pod \"perf-node-gather-daemonset-gs7m2\" (UID: \"582fc71f-2439-4bed-ab49-5547660f40cf\") " pod="openshift-must-gather-bmp8z/perf-node-gather-daemonset-gs7m2"
Jul 14 20:00:44.626183 ip-10-0-129-23 kubenswrapper[2565]: I0714 20:00:44.626047    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/582fc71f-2439-4bed-ab49-5547660f40cf-sys\") pod \"perf-node-gather-daemonset-gs7m2\" (UID: \"582fc71f-2439-4bed-ab49-5547660f40cf\") " pod="openshift-must-gather-bmp8z/perf-node-gather-daemonset-gs7m2"
Jul 14 20:00:44.633926 ip-10-0-129-23 kubenswrapper[2565]: I0714 20:00:44.633910    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-49gtk\" (UniqueName: \"kubernetes.io/projected/582fc71f-2439-4bed-ab49-5547660f40cf-kube-api-access-49gtk\") pod \"perf-node-gather-daemonset-gs7m2\" (UID: \"582fc71f-2439-4bed-ab49-5547660f40cf\") " pod="openshift-must-gather-bmp8z/perf-node-gather-daemonset-gs7m2"
Jul 14 20:00:44.721188 ip-10-0-129-23 kubenswrapper[2565]: I0714 20:00:44.721143    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-bmp8z/perf-node-gather-daemonset-gs7m2"
Jul 14 20:00:44.859119 ip-10-0-129-23 kubenswrapper[2565]: I0714 20:00:44.859097    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-bmp8z/perf-node-gather-daemonset-gs7m2"]
Jul 14 20:00:44.860617 ip-10-0-129-23 kubenswrapper[2565]: W0714 20:00:44.860584    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod582fc71f_2439_4bed_ab49_5547660f40cf.slice/crio-89d99701282ac7b3570d754692ca1cc199e90de828168428015828b2a8ea4055 WatchSource:0}: Error finding container 89d99701282ac7b3570d754692ca1cc199e90de828168428015828b2a8ea4055: Status 404 returned error can't find the container with id 89d99701282ac7b3570d754692ca1cc199e90de828168428015828b2a8ea4055
Jul 14 20:00:44.937714 ip-10-0-129-23 kubenswrapper[2565]: I0714 20:00:44.937686    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4sklb8_f9309242-1edc-409b-bc18-d243463b18d5/istio-proxy/0.log"
Jul 14 20:00:45.051233 ip-10-0-129-23 kubenswrapper[2565]: I0714 20:00:45.051125    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-l9wqn_63d095e3-a845-49d3-a5a9-abd823fad9aa/discovery/0.log"
Jul 14 20:00:45.072476 ip-10-0-129-23 kubenswrapper[2565]: I0714 20:00:45.072445    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5d877944c-867np_adda783a-0ef9-40a9-99a7-445d881305ec/kube-auth-proxy/0.log"
Jul 14 20:00:45.184261 ip-10-0-129-23 kubenswrapper[2565]: I0714 20:00:45.184230    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-74584bb9f8-b4jv2_f17ce124-5d01-4fe3-ae66-be3813fa2e25/payload-pre-processing/0.log"
Jul 14 20:00:45.211521 ip-10-0-129-23 kubenswrapper[2565]: I0714 20:00:45.211495    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-f9b8d9b9b-vm7fk_ae0538c4-1104-47c5-b186-71789e6fab74/payload-processing/0.log"
Jul 14 20:00:45.366053 ip-10-0-129-23 kubenswrapper[2565]: I0714 20:00:45.365971    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-bmp8z/perf-node-gather-daemonset-gs7m2" event={"ID":"582fc71f-2439-4bed-ab49-5547660f40cf","Type":"ContainerStarted","Data":"4dad8112bf79a6f0bcb3ce9f60bfd611b030e68b9f0905547fa033da002a1dbc"}
Jul 14 20:00:45.366053 ip-10-0-129-23 kubenswrapper[2565]: I0714 20:00:45.366030    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-bmp8z/perf-node-gather-daemonset-gs7m2"
Jul 14 20:00:45.366053 ip-10-0-129-23 kubenswrapper[2565]: I0714 20:00:45.366047    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-bmp8z/perf-node-gather-daemonset-gs7m2" event={"ID":"582fc71f-2439-4bed-ab49-5547660f40cf","Type":"ContainerStarted","Data":"89d99701282ac7b3570d754692ca1cc199e90de828168428015828b2a8ea4055"}
Jul 14 20:00:45.384110 ip-10-0-129-23 kubenswrapper[2565]: I0714 20:00:45.384063    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-bmp8z/perf-node-gather-daemonset-gs7m2" podStartSLOduration=1.384049601 podStartE2EDuration="1.384049601s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 20:00:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 20:00:45.380931285 +0000 UTC m=+2991.941788177" watchObservedRunningTime="2026-07-14 20:00:45.384049601 +0000 UTC m=+2991.944906493"
Jul 14 20:00:45.983703 ip-10-0-129-23 kubenswrapper[2565]: I0714 20:00:45.983677    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-ttnqj_49093e63-d7ef-4c83-9c07-a96fd79d02f7/serve-healthcheck-canary/0.log"
Jul 14 20:00:46.522445 ip-10-0-129-23 kubenswrapper[2565]: I0714 20:00:46.522414    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-kflcd_44bb8ebf-72e6-435c-8a36-332fbf23a548/kube-rbac-proxy/0.log"
Jul 14 20:00:46.541218 ip-10-0-129-23 kubenswrapper[2565]: I0714 20:00:46.541193    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-kflcd_44bb8ebf-72e6-435c-8a36-332fbf23a548/exporter/0.log"
Jul 14 20:00:46.560271 ip-10-0-129-23 kubenswrapper[2565]: I0714 20:00:46.560248    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-kflcd_44bb8ebf-72e6-435c-8a36-332fbf23a548/extractor/0.log"
Jul 14 20:00:48.723601 ip-10-0-129-23 kubenswrapper[2565]: I0714 20:00:48.723571    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-59s7m_a6cc2edb-535e-453e-8dae-347994f44b03/manager/0.log"
Jul 14 20:00:48.852696 ip-10-0-129-23 kubenswrapper[2565]: I0714 20:00:48.852670    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-8jx5x_477ec5d3-633e-43ad-884d-04ecf8e99df4/manager/0.log"
Jul 14 20:00:48.947352 ip-10-0-129-23 kubenswrapper[2565]: I0714 20:00:48.947327    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-5b78ddfc45-gt9gb_4f76d117-82eb-4b68-a42a-59215f66e436/manager/0.log"
Jul 14 20:00:48.966207 ip-10-0-129-23 kubenswrapper[2565]: I0714 20:00:48.966183    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-76jnp_c946ab58-d1fd-4016-9310-3dbf08b679c6/server/0.log"
Jul 14 20:00:49.124202 ip-10-0-129-23 kubenswrapper[2565]: I0714 20:00:49.124116    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6f9786d97d-mchdj_b4d66fe5-f315-4b5b-9c1b-7c539e02a839/manager/0.log"
Jul 14 20:00:49.143251 ip-10-0-129-23 kubenswrapper[2565]: I0714 20:00:49.143232    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6f9786d97d-mchdj_b4d66fe5-f315-4b5b-9c1b-7c539e02a839/copy-manifests/0.log"
Jul 14 20:00:50.469055 ip-10-0-129-23 kubenswrapper[2565]: I0714 20:00:50.469029    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-f8msz_00a6afba-6096-4a00-bf7b-5f6f67d08360/openshift-lws-operator/0.log"
Jul 14 20:00:51.357328 ip-10-0-129-23 kubenswrapper[2565]: I0714 20:00:51.357301    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4sklb8_f9309242-1edc-409b-bc18-d243463b18d5/istio-proxy/0.log"
Jul 14 20:00:51.391920 ip-10-0-129-23 kubenswrapper[2565]: I0714 20:00:51.391891    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-bmp8z/perf-node-gather-daemonset-gs7m2"
Jul 14 20:00:51.463348 ip-10-0-129-23 kubenswrapper[2565]: I0714 20:00:51.463303    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-l9wqn_63d095e3-a845-49d3-a5a9-abd823fad9aa/discovery/0.log"
Jul 14 20:00:51.472357 ip-10-0-129-23 kubenswrapper[2565]: I0714 20:00:51.472334    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5d877944c-867np_adda783a-0ef9-40a9-99a7-445d881305ec/kube-auth-proxy/0.log"
Jul 14 20:00:51.555661 ip-10-0-129-23 kubenswrapper[2565]: I0714 20:00:51.555626    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-74584bb9f8-b4jv2_f17ce124-5d01-4fe3-ae66-be3813fa2e25/payload-pre-processing/0.log"
Jul 14 20:00:51.574208 ip-10-0-129-23 kubenswrapper[2565]: I0714 20:00:51.574181    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-f9b8d9b9b-vm7fk_ae0538c4-1104-47c5-b186-71789e6fab74/payload-processing/0.log"
Jul 14 20:00:52.717583 ip-10-0-129-23 kubenswrapper[2565]: I0714 20:00:52.717551    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4sklb8_f9309242-1edc-409b-bc18-d243463b18d5/istio-proxy/0.log"
Jul 14 20:00:52.828030 ip-10-0-129-23 kubenswrapper[2565]: I0714 20:00:52.827995    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-l9wqn_63d095e3-a845-49d3-a5a9-abd823fad9aa/discovery/0.log"
Jul 14 20:00:52.839207 ip-10-0-129-23 kubenswrapper[2565]: I0714 20:00:52.839182    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5d877944c-867np_adda783a-0ef9-40a9-99a7-445d881305ec/kube-auth-proxy/0.log"
Jul 14 20:00:52.924685 ip-10-0-129-23 kubenswrapper[2565]: I0714 20:00:52.924659    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-74584bb9f8-b4jv2_f17ce124-5d01-4fe3-ae66-be3813fa2e25/payload-pre-processing/0.log"
Jul 14 20:00:52.947757 ip-10-0-129-23 kubenswrapper[2565]: I0714 20:00:52.947724    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-f9b8d9b9b-vm7fk_ae0538c4-1104-47c5-b186-71789e6fab74/payload-processing/0.log"
Jul 14 20:00:54.489631 ip-10-0-129-23 kubenswrapper[2565]: I0714 20:00:54.489604    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-p5lb5_7ab60b2b-a644-4e35-b8b1-49c676e0f63f/console-operator/1.log"
Jul 14 20:00:54.493307 ip-10-0-129-23 kubenswrapper[2565]: I0714 20:00:54.493281    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cqqv8_7a447cf6-9373-4497-8028-97d590f38262/ovn-acl-logging/0.log"
Jul 14 20:00:54.498844 ip-10-0-129-23 kubenswrapper[2565]: I0714 20:00:54.498825    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-p5lb5_7ab60b2b-a644-4e35-b8b1-49c676e0f63f/console-operator/1.log"
Jul 14 20:00:54.501862 ip-10-0-129-23 kubenswrapper[2565]: I0714 20:00:54.501845    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cqqv8_7a447cf6-9373-4497-8028-97d590f38262/ovn-acl-logging/0.log"
Jul 14 20:00:55.711662 ip-10-0-129-23 kubenswrapper[2565]: I0714 20:00:55.711630    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-xdsmr_1d832d81-a2e9-441e-86a4-22f66908a826/migrator/0.log"
Jul 14 20:00:55.729865 ip-10-0-129-23 kubenswrapper[2565]: I0714 20:00:55.729841    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-xdsmr_1d832d81-a2e9-441e-86a4-22f66908a826/graceful-termination/0.log"
Jul 14 20:00:57.318707 ip-10-0-129-23 kubenswrapper[2565]: I0714 20:00:57.318679    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ql9tj_ef52564d-70d3-4e0d-a5d4-76de0d4cf5ff/kube-multus-additional-cni-plugins/0.log"
Jul 14 20:00:57.338759 ip-10-0-129-23 kubenswrapper[2565]: I0714 20:00:57.338732    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ql9tj_ef52564d-70d3-4e0d-a5d4-76de0d4cf5ff/egress-router-binary-copy/0.log"
Jul 14 20:00:57.358962 ip-10-0-129-23 kubenswrapper[2565]: I0714 20:00:57.358935    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ql9tj_ef52564d-70d3-4e0d-a5d4-76de0d4cf5ff/cni-plugins/0.log"
Jul 14 20:00:57.379049 ip-10-0-129-23 kubenswrapper[2565]: I0714 20:00:57.379022    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ql9tj_ef52564d-70d3-4e0d-a5d4-76de0d4cf5ff/bond-cni-plugin/0.log"
Jul 14 20:00:57.397666 ip-10-0-129-23 kubenswrapper[2565]: I0714 20:00:57.397643    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ql9tj_ef52564d-70d3-4e0d-a5d4-76de0d4cf5ff/routeoverride-cni/0.log"
Jul 14 20:00:57.415541 ip-10-0-129-23 kubenswrapper[2565]: I0714 20:00:57.415515    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ql9tj_ef52564d-70d3-4e0d-a5d4-76de0d4cf5ff/whereabouts-cni-bincopy/0.log"
Jul 14 20:00:57.433765 ip-10-0-129-23 kubenswrapper[2565]: I0714 20:00:57.433738    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ql9tj_ef52564d-70d3-4e0d-a5d4-76de0d4cf5ff/whereabouts-cni/0.log"
Jul 14 20:00:57.672527 ip-10-0-129-23 kubenswrapper[2565]: I0714 20:00:57.672420    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-z4v7q_8e6a3d91-33c3-44c9-a4f0-34c6edf4997c/kube-multus/0.log"
Jul 14 20:00:57.734325 ip-10-0-129-23 kubenswrapper[2565]: I0714 20:00:57.734299    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-hbbrx_a2ef2d8f-5f7b-41bd-b98a-2a272dd4090f/network-metrics-daemon/0.log"
Jul 14 20:00:57.751811 ip-10-0-129-23 kubenswrapper[2565]: I0714 20:00:57.751772    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-hbbrx_a2ef2d8f-5f7b-41bd-b98a-2a272dd4090f/kube-rbac-proxy/0.log"
Jul 14 20:00:58.596587 ip-10-0-129-23 kubenswrapper[2565]: I0714 20:00:58.596558    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cqqv8_7a447cf6-9373-4497-8028-97d590f38262/ovn-controller/0.log"
Jul 14 20:00:58.610973 ip-10-0-129-23 kubenswrapper[2565]: I0714 20:00:58.610948    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cqqv8_7a447cf6-9373-4497-8028-97d590f38262/ovn-acl-logging/1.log"
Jul 14 20:00:58.611104 ip-10-0-129-23 kubenswrapper[2565]: I0714 20:00:58.611011    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cqqv8_7a447cf6-9373-4497-8028-97d590f38262/ovn-acl-logging/0.log"
Jul 14 20:00:58.629329 ip-10-0-129-23 kubenswrapper[2565]: I0714 20:00:58.629300    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cqqv8_7a447cf6-9373-4497-8028-97d590f38262/kube-rbac-proxy-node/0.log"
Jul 14 20:00:58.650718 ip-10-0-129-23 kubenswrapper[2565]: I0714 20:00:58.650687    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cqqv8_7a447cf6-9373-4497-8028-97d590f38262/kube-rbac-proxy-ovn-metrics/0.log"
Jul 14 20:00:58.665609 ip-10-0-129-23 kubenswrapper[2565]: I0714 20:00:58.665591    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cqqv8_7a447cf6-9373-4497-8028-97d590f38262/northd/0.log"
Jul 14 20:00:58.684935 ip-10-0-129-23 kubenswrapper[2565]: I0714 20:00:58.684914    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cqqv8_7a447cf6-9373-4497-8028-97d590f38262/nbdb/0.log"
Jul 14 20:00:58.703290 ip-10-0-129-23 kubenswrapper[2565]: I0714 20:00:58.703265    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cqqv8_7a447cf6-9373-4497-8028-97d590f38262/sbdb/0.log"
Jul 14 20:00:58.758329 ip-10-0-129-23 kubenswrapper[2565]: I0714 20:00:58.758300    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cqqv8_7a447cf6-9373-4497-8028-97d590f38262/ovnkube-controller/0.log"
Jul 14 20:01:00.270642 ip-10-0-129-23 kubenswrapper[2565]: I0714 20:01:00.270616    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-xxs8n_490a903e-0b54-40ef-82f2-4175faef060f/network-check-target-container/0.log"
Jul 14 20:01:01.397489 ip-10-0-129-23 kubenswrapper[2565]: I0714 20:01:01.397464    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-vmk5j_33e87184-8973-45c3-8719-143dd1d21929/iptables-alerter/0.log"