Jul 06 23:53:56.009690 ip-10-0-129-23 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 06 23:53:56.009698 ip-10-0-129-23 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 06 23:53:56.009705 ip-10-0-129-23 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 06 23:53:56.009959 ip-10-0-129-23 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 06 23:54:05.706098 ip-10-0-129-23 systemd[1]: kubelet.service: Failed to schedule restart job: Unit openvswitch.service not found.
Jul 06 23:54:05.706112 ip-10-0-129-23 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 7f1eb4d343f64f7ca8df63a96af0d7d9 --
Jul 06 23:55:33.770542 ip-10-0-129-23 systemd[1]: Starting Kubernetes Kubelet...
Jul 06 23:55:34.199550 ip-10-0-129-23 kubenswrapper[2578]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 06 23:55:34.199550 ip-10-0-129-23 kubenswrapper[2578]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 06 23:55:34.199550 ip-10-0-129-23 kubenswrapper[2578]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 06 23:55:34.199550 ip-10-0-129-23 kubenswrapper[2578]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 06 23:55:34.199550 ip-10-0-129-23 kubenswrapper[2578]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 06 23:55:34.201806 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.201722    2578 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 06 23:55:34.207943 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.207929    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 23:55:34.207943 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.207944    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 23:55:34.208005 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.207948    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 23:55:34.208005 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.207950    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 23:55:34.208005 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.207953    2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 23:55:34.208005 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.207956    2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 23:55:34.208005 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.207958    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 23:55:34.208005 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.207961    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 23:55:34.208005 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.207964    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 23:55:34.208005 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.207966    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 23:55:34.208005 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.207968    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 23:55:34.208005 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.207971    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 23:55:34.208005 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.207973    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 23:55:34.208005 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.207976    2578 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 23:55:34.208005 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.207979    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 23:55:34.208005 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.207981    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 23:55:34.208005 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.207984    2578 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 23:55:34.208005 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.207986    2578 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 23:55:34.208005 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.207989    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 23:55:34.208005 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.207995    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 23:55:34.208005 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.207998    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 23:55:34.208005 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.208000    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 23:55:34.208514 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.208003    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 23:55:34.208514 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.208005    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 23:55:34.208514 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.208008    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 23:55:34.208514 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.208011    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 23:55:34.208514 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.208013    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 23:55:34.208514 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.208016    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 23:55:34.208514 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.208018    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 23:55:34.208514 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.208021    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 23:55:34.208514 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.208023    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 23:55:34.208514 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.208025    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 23:55:34.208514 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.208028    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 23:55:34.208514 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.208030    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 23:55:34.208514 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.208032    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 23:55:34.208514 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.208035    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 23:55:34.208514 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.208037    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 23:55:34.208514 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.208040    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 23:55:34.208514 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.208042    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 23:55:34.208514 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.208044    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 23:55:34.208514 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.208047    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 23:55:34.208958 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.208049    2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 23:55:34.208958 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.208052    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 23:55:34.208958 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.208054    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 23:55:34.208958 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.208062    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 23:55:34.208958 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.208066    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 23:55:34.208958 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.208070    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 23:55:34.208958 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.208074    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 23:55:34.208958 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.208077    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 23:55:34.208958 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.208079    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 23:55:34.208958 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.208082    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 23:55:34.208958 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.208084    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 23:55:34.208958 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.208087    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 23:55:34.208958 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.208089    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 23:55:34.208958 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.208092    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 23:55:34.208958 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.208095    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 23:55:34.208958 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.208099    2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 23:55:34.208958 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.208102    2578 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 23:55:34.208958 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.208104    2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 23:55:34.208958 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.208107    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 23:55:34.208958 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.208109    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 23:55:34.209466 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.208112    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 23:55:34.209466 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.208114    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 23:55:34.209466 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.208117    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 23:55:34.209466 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.208119    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 23:55:34.209466 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.208121    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 23:55:34.209466 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.208123    2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 23:55:34.209466 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.208126    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 23:55:34.209466 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.208129    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 23:55:34.209466 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.208132    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 23:55:34.209466 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.208134    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 23:55:34.209466 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.208136    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 23:55:34.209466 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.208139    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 23:55:34.209466 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.208148    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 23:55:34.209466 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.208150    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 23:55:34.209466 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.208153    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 23:55:34.209466 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.208155    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 23:55:34.209466 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.208158    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 23:55:34.209466 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.208160    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 23:55:34.209466 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.208162    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 23:55:34.209466 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.208164    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 23:55:34.209934 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.208167    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 23:55:34.209934 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.208169    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 23:55:34.209934 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.208172    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 23:55:34.209934 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.208176    2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 23:55:34.209934 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.208179    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 23:55:34.209934 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.208183    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 23:55:34.209934 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.208186    2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 23:55:34.209934 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.208190    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 23:55:34.209934 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.208194    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 23:55:34.209934 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.208196    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 23:55:34.209934 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.208199    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 23:55:34.209934 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.208201    2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 23:55:34.209934 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.208203    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 23:55:34.209934 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.208206    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 23:55:34.209934 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.208209    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 23:55:34.209934 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.208211    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 23:55:34.209934 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.208214    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 23:55:34.209934 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.208216    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 23:55:34.210774 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.210762    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 23:55:34.210774 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.210775    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 23:55:34.210826 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.210778    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 23:55:34.210826 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.210781    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 23:55:34.210826 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.210784    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 23:55:34.210826 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.210787    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 23:55:34.210826 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.210790    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 23:55:34.210826 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.210795    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 23:55:34.210826 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.210798    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 23:55:34.210826 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.210803    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 23:55:34.210826 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.210807    2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 23:55:34.210826 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.210810    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 23:55:34.210826 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.210813    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 23:55:34.210826 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.210815    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 23:55:34.210826 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.210818    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 23:55:34.210826 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.210820    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 23:55:34.210826 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.210822    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 23:55:34.210826 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.210825    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 23:55:34.211207 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.210841    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 23:55:34.211207 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.210845    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 23:55:34.211207 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.210848    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 23:55:34.211207 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.210850    2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 23:55:34.211207 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.210853    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 23:55:34.211207 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.210856    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 23:55:34.211207 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.210858    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 23:55:34.211207 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.210860    2578 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 23:55:34.211207 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.210862    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 23:55:34.211207 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.210865    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 23:55:34.211207 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.210867    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 23:55:34.211207 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.210869    2578 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 23:55:34.211207 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.210872    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 23:55:34.211207 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.210874    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 23:55:34.211207 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.210876    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 23:55:34.211207 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.210879    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 23:55:34.211207 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.210881    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 23:55:34.211207 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.210883    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 23:55:34.211207 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.210885    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 23:55:34.211207 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.210888    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 23:55:34.211716 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.210890    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 23:55:34.211716 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.210892    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 23:55:34.211716 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.210900    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 23:55:34.211716 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.210902    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 23:55:34.211716 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.210904    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 23:55:34.211716 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.210907    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 23:55:34.211716 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.210909    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 23:55:34.211716 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.210911    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 23:55:34.211716 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.210913    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 23:55:34.211716 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.210916    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 23:55:34.211716 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.210918    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 23:55:34.211716 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.210920    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 23:55:34.211716 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.210922    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 23:55:34.211716 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.210925    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 23:55:34.211716 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.210928    2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 23:55:34.211716 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.210930    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 23:55:34.211716 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.210933    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 23:55:34.211716 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.210935    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 23:55:34.211716 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.210939    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 23:55:34.212166 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.210943    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 23:55:34.212166 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.210945    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 23:55:34.212166 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.210947    2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 23:55:34.212166 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.210950    2578 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 23:55:34.212166 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.210953    2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 23:55:34.212166 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.210955    2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 23:55:34.212166 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.210958    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 23:55:34.212166 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.210960    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 23:55:34.212166 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.210962    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 23:55:34.212166 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.210965    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 23:55:34.212166 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.210967    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 23:55:34.212166 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.210969    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 23:55:34.212166 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.210972    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 23:55:34.212166 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.210974    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 23:55:34.212166 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.210977    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 23:55:34.212166 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.210979    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 23:55:34.212166 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.210982    2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 23:55:34.212166 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.210985    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 23:55:34.212166 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.210987    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 23:55:34.212166 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.210989    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 23:55:34.212653 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.210991    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 23:55:34.212653 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.210994    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 23:55:34.212653 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.210997    2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 23:55:34.212653 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.211000    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 23:55:34.212653 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.211003    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 23:55:34.212653 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.211006    2578 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 23:55:34.212653 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.211010    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 23:55:34.212653 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.211014    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 23:55:34.212653 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.211017    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 23:55:34.212653 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.211019    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 23:55:34.212653 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.211021    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 23:55:34.212653 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.211024    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 23:55:34.212653 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.211026    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 23:55:34.212653 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.211029    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 23:55:34.212653 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.211031    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 23:55:34.212653 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.211034    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 23:55:34.212653 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.211036    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 23:55:34.212653 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.211038    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 23:55:34.212653 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.211040    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 23:55:34.212653 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.211043    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 23:55:34.213121 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.211045    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 23:55:34.213121 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.211047    2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 23:55:34.213121 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.211406    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 23:55:34.213121 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.211411    2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 23:55:34.213121 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.211414    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 23:55:34.213121 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.211417    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 23:55:34.213121 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.211419    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 23:55:34.213121 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.211422    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 23:55:34.213121 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.211425    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 23:55:34.213121 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.211427    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 23:55:34.213121 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.211430    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 23:55:34.213121 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.211432    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 23:55:34.213121 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.211435    2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 23:55:34.213121 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.211437    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 23:55:34.213121 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.211439    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 23:55:34.213121 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.211442    2578 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 23:55:34.213121 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.211445    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 23:55:34.213121 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.211447    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 23:55:34.213121 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.211450    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 23:55:34.213573 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.211453    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 23:55:34.213573 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.211455    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 23:55:34.213573 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.211458    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 23:55:34.213573 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.211460    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 23:55:34.213573 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.211463    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 23:55:34.213573 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.211467    2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 23:55:34.213573 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.211471    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 23:55:34.213573 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.211474    2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 23:55:34.213573 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.211477    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 23:55:34.213573 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.211479    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 23:55:34.213573 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.211482    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 23:55:34.213573 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.211484    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 23:55:34.213573 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.211486    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 23:55:34.213573 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.211489    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 23:55:34.213573 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.211491    2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 23:55:34.213573 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.211494    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 23:55:34.213573 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.211496    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 23:55:34.213573 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.211499    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 23:55:34.213573 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.211501    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 23:55:34.214016 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.211503    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 23:55:34.214016 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.211506    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 23:55:34.214016 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.211508    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 23:55:34.214016 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.211511    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 23:55:34.214016 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.211514    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 23:55:34.214016 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.211516    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 23:55:34.214016 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.211518    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 23:55:34.214016 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.211521    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 23:55:34.214016 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.211523    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 23:55:34.214016 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.211525    2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 23:55:34.214016 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.211527    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 23:55:34.214016 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.211530    2578 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 23:55:34.214016 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.211532    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 23:55:34.214016 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.211535    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 23:55:34.214016 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.211537    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 23:55:34.214016 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.211540    2578 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 23:55:34.214016 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.211542    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 23:55:34.214016 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.211544    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 23:55:34.214016 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.211548    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 23:55:34.214016 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.211551    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 23:55:34.214510 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.211553    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 23:55:34.214510 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.211555    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 23:55:34.214510 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.211558    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 23:55:34.214510 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.211560    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 23:55:34.214510 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.211562    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 23:55:34.214510 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.211565    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 23:55:34.214510 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.211567    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 23:55:34.214510 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.211570    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 23:55:34.214510 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.211572    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 23:55:34.214510 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.211574    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 23:55:34.214510 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.211578    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 23:55:34.214510 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.211581    2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 23:55:34.214510 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.211583    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 23:55:34.214510 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.211586    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 23:55:34.214510 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.211588    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 23:55:34.214510 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.211591    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 23:55:34.214510 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.211595    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 23:55:34.214510 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.211597    2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 23:55:34.214510 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.211600    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 23:55:34.214510 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.211602    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 23:55:34.214965 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.211605    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 23:55:34.214965 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.211607    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 23:55:34.214965 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.211610    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 23:55:34.214965 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.211612    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 23:55:34.214965 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.211615    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 23:55:34.214965 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.211617    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 23:55:34.214965 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.211619    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 23:55:34.214965 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.211622    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 23:55:34.214965 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.211625    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 23:55:34.214965 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.211627    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 23:55:34.214965 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.211630    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 23:55:34.214965 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.211632    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 23:55:34.214965 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.211636    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 23:55:34.214965 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.211639    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 23:55:34.214965 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.211642    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 23:55:34.214965 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.211645    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 23:55:34.214965 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.211647    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 23:55:34.214965 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.211650    2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 23:55:34.214965 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.211652    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 23:55:34.215413 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.211654    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 23:55:34.215413 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.211657    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 23:55:34.215413 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.211659    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 23:55:34.215413 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.211662    2578 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 23:55:34.215413 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.211738    2578 flags.go:64] FLAG: --address="0.0.0.0"
Jul 06 23:55:34.215413 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.211753    2578 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 06 23:55:34.215413 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.211761    2578 flags.go:64] FLAG: --anonymous-auth="true"
Jul 06 23:55:34.215413 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.211768    2578 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 06 23:55:34.215413 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.211773    2578 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 06 23:55:34.215413 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.211776    2578 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 06 23:55:34.215413 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.211781    2578 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 06 23:55:34.215413 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.211785    2578 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 06 23:55:34.215413 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.211788    2578 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 06 23:55:34.215413 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.211791    2578 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 06 23:55:34.215413 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.211794    2578 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 06 23:55:34.215413 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.211797    2578 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 06 23:55:34.215413 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.211800    2578 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 06 23:55:34.215413 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.211803    2578 flags.go:64] FLAG: --cgroup-root=""
Jul 06 23:55:34.215413 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.211806    2578 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 06 23:55:34.215413 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.211808    2578 flags.go:64] FLAG: --client-ca-file=""
Jul 06 23:55:34.215413 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.211811    2578 flags.go:64] FLAG: --cloud-provider="external"
Jul 06 23:55:34.215413 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.211814    2578 flags.go:64] FLAG: --cluster-dns="[]"
Jul 06 23:55:34.215413 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.211817    2578 flags.go:64] FLAG: --cluster-domain=""
Jul 06 23:55:34.215413 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.211820    2578 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 06 23:55:34.215963 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.211822    2578 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 06 23:55:34.215963 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.211825    2578 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 06 23:55:34.215963 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.211828    2578 flags.go:64] FLAG: --container-log-max-files="5"
Jul 06 23:55:34.215963 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.211834    2578 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 06 23:55:34.215963 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.211837    2578 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 06 23:55:34.215963 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.211840    2578 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 06 23:55:34.215963 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.211842    2578 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 06 23:55:34.215963 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.211845    2578 flags.go:64] FLAG: --contention-profiling="false"
Jul 06 23:55:34.215963 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.211848    2578 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 06 23:55:34.215963 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.211851    2578 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 06 23:55:34.215963 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.211854    2578 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 06 23:55:34.215963 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.211856    2578 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 06 23:55:34.215963 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.211860    2578 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 06 23:55:34.215963 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.211863    2578 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 06 23:55:34.215963 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.211865    2578 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 06 23:55:34.215963 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.211868    2578 flags.go:64] FLAG: --enable-load-reader="false"
Jul 06 23:55:34.215963 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.211870    2578 flags.go:64] FLAG: --enable-server="true"
Jul 06 23:55:34.215963 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.211873    2578 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 06 23:55:34.215963 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.211877    2578 flags.go:64] FLAG: --event-burst="100"
Jul 06 23:55:34.215963 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.211881    2578 flags.go:64] FLAG: --event-qps="50"
Jul 06 23:55:34.215963 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.211883    2578 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 06 23:55:34.215963 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.211886    2578 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 06 23:55:34.215963 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.211889    2578 flags.go:64] FLAG: --eviction-hard=""
Jul 06 23:55:34.215963 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.211892    2578 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 06 23:55:34.216646 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.211897    2578 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 06 23:55:34.216646 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.211900    2578 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 06 23:55:34.216646 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.211903    2578 flags.go:64] FLAG: --eviction-soft=""
Jul 06 23:55:34.216646 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.211905    2578 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 06 23:55:34.216646 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.211908    2578 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 06 23:55:34.216646 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.211911    2578 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 06 23:55:34.216646 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.211913    2578 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 06 23:55:34.216646 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.211916    2578 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 06 23:55:34.216646 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.211919    2578 flags.go:64] FLAG: --fail-swap-on="true"
Jul 06 23:55:34.216646 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.211921    2578 flags.go:64] FLAG: --feature-gates=""
Jul 06 23:55:34.216646 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.211925    2578 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 06 23:55:34.216646 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.211927    2578 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 06 23:55:34.216646 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.211930    2578 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 06 23:55:34.216646 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.211933    2578 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 06 23:55:34.216646 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.211936    2578 flags.go:64] FLAG: --healthz-port="10248"
Jul 06 23:55:34.216646 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.211938    2578 flags.go:64] FLAG: --help="false"
Jul 06 23:55:34.216646 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.211941    2578 flags.go:64] FLAG: --hostname-override="ip-10-0-129-23.ec2.internal"
Jul 06 23:55:34.216646 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.211944    2578 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 06 23:55:34.216646 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.211946    2578 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 06 23:55:34.216646 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.211949    2578 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 06 23:55:34.216646 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.211952    2578 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 06 23:55:34.216646 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.211956    2578 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 06 23:55:34.216646 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.211958    2578 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 06 23:55:34.216646 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.211961    2578 flags.go:64] FLAG: --image-service-endpoint=""
Jul 06 23:55:34.217250 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.211964    2578 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 06 23:55:34.217250 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.211968    2578 flags.go:64] FLAG: --kube-api-burst="100"
Jul 06 23:55:34.217250 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.211970    2578 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 06 23:55:34.217250 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.211973    2578 flags.go:64] FLAG: --kube-api-qps="50"
Jul 06 23:55:34.217250 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.211977    2578 flags.go:64] FLAG: --kube-reserved=""
Jul 06 23:55:34.217250 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.211979    2578 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 06 23:55:34.217250 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.211981    2578 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 06 23:55:34.217250 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.211984    2578 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 06 23:55:34.217250 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.211989    2578 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 06 23:55:34.217250 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.211992    2578 flags.go:64] FLAG: --lock-file=""
Jul 06 23:55:34.217250 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.211994    2578 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 06 23:55:34.217250 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.211997    2578 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 06 23:55:34.217250 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.212000    2578 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 06 23:55:34.217250 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.212005    2578 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 06 23:55:34.217250 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.212007    2578 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 06 23:55:34.217250 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.212010    2578 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 06 23:55:34.217250 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.212012    2578 flags.go:64] FLAG: --logging-format="text"
Jul 06 23:55:34.217250 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.212015    2578 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 06 23:55:34.217250 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.212018    2578 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 06 23:55:34.217250 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.212021    2578 flags.go:64] FLAG: --manifest-url=""
Jul 06 23:55:34.217250 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.212023    2578 flags.go:64] FLAG: --manifest-url-header=""
Jul 06 23:55:34.217250 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.212027    2578 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 06 23:55:34.217250 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.212030    2578 flags.go:64] FLAG: --max-open-files="1000000"
Jul 06 23:55:34.217250 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.212034    2578 flags.go:64] FLAG: --max-pods="110"
Jul 06 23:55:34.217250 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.212037    2578 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 06 23:55:34.217860 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.212039    2578 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 06 23:55:34.217860 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.212043    2578 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 06 23:55:34.217860 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.212045    2578 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 06 23:55:34.217860 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.212048    2578 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 06 23:55:34.217860 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.212051    2578 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 06 23:55:34.217860 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.212053    2578 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 06 23:55:34.217860 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.212067    2578 flags.go:64] FLAG: --node-status-max-images="50"
Jul 06 23:55:34.217860 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.212070    2578 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 06 23:55:34.217860 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.212074    2578 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 06 23:55:34.217860 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.212077    2578 flags.go:64] FLAG: --pod-cidr=""
Jul 06 23:55:34.217860 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.212080    2578 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5"
Jul 06 23:55:34.217860 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.212084    2578 flags.go:64] FLAG: --pod-manifest-path=""
Jul 06 23:55:34.217860 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.212088    2578 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 06 23:55:34.217860 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.212090    2578 flags.go:64] FLAG: --pods-per-core="0"
Jul 06 23:55:34.217860 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.212093    2578 flags.go:64] FLAG: --port="10250"
Jul 06 23:55:34.217860 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.212096    2578 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 06 23:55:34.217860 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.212099    2578 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0ca94e0cbf0e5c506"
Jul 06 23:55:34.217860 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.212102    2578 flags.go:64] FLAG: --qos-reserved=""
Jul 06 23:55:34.217860 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.212105    2578 flags.go:64] FLAG: --read-only-port="10255"
Jul 06 23:55:34.217860 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.212108    2578 flags.go:64] FLAG: --register-node="true"
Jul 06 23:55:34.217860 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.212110    2578 flags.go:64] FLAG: --register-with-taints=""
Jul 06 23:55:34.217860 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.212114    2578 flags.go:64] FLAG: --registry-burst="10"
Jul 06 23:55:34.217860 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.212116    2578 flags.go:64] FLAG: --registry-qps="5"
Jul 06 23:55:34.217860 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.212119    2578 flags.go:64] FLAG: --reserved-cpus=""
Jul 06 23:55:34.218467 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.212121    2578 flags.go:64] FLAG: --reserved-memory=""
Jul 06 23:55:34.218467 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.212125    2578 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 06 23:55:34.218467 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.212128    2578 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 06 23:55:34.218467 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.212130    2578 flags.go:64] FLAG: --rotate-certificates="false"
Jul 06 23:55:34.218467 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.212133    2578 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 06 23:55:34.218467 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.212135    2578 flags.go:64] FLAG: --runonce="false"
Jul 06 23:55:34.218467 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.212138    2578 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 06 23:55:34.218467 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.212141    2578 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 06 23:55:34.218467 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.212144    2578 flags.go:64] FLAG: --seccomp-default="false"
Jul 06 23:55:34.218467 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.212146    2578 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 06 23:55:34.218467 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.212149    2578 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 06 23:55:34.218467 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.212151    2578 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 06 23:55:34.218467 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.212154    2578 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 06 23:55:34.218467 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.212157    2578 flags.go:64] FLAG: --storage-driver-password="root"
Jul 06 23:55:34.218467 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.212159    2578 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 06 23:55:34.218467 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.212162    2578 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 06 23:55:34.218467 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.212165    2578 flags.go:64] FLAG: --storage-driver-user="root"
Jul 06 23:55:34.218467 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.212168    2578 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 06 23:55:34.218467 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.212171    2578 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 06 23:55:34.218467 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.212174    2578 flags.go:64] FLAG: --system-cgroups=""
Jul 06 23:55:34.218467 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.212176    2578 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 06 23:55:34.218467 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.212182    2578 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 06 23:55:34.218467 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.212185    2578 flags.go:64] FLAG: --tls-cert-file=""
Jul 06 23:55:34.218467 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.212187    2578 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 06 23:55:34.218467 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.212191    2578 flags.go:64] FLAG: --tls-min-version=""
Jul 06 23:55:34.219058 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.212194    2578 flags.go:64] FLAG: --tls-private-key-file=""
Jul 06 23:55:34.219058 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.212197    2578 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 06 23:55:34.219058 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.212199    2578 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 06 23:55:34.219058 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.212202    2578 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 06 23:55:34.219058 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.212204    2578 flags.go:64] FLAG: --v="2"
Jul 06 23:55:34.219058 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.212208    2578 flags.go:64] FLAG: --version="false"
Jul 06 23:55:34.219058 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.212211    2578 flags.go:64] FLAG: --vmodule=""
Jul 06 23:55:34.219058 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.212214    2578 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 06 23:55:34.219058 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.212218    2578 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 06 23:55:34.219058 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.212344    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 23:55:34.219058 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.212348    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 23:55:34.219058 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.212351    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 23:55:34.219058 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.212354    2578 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 23:55:34.219058 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.212357    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 23:55:34.219058 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.212360    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 23:55:34.219058 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.212362    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 23:55:34.219058 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.212365    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 23:55:34.219058 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.212367    2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 23:55:34.219058 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.212369    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 23:55:34.219058 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.212372    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 23:55:34.219058 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.212374    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 23:55:34.219058 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.212376    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 23:55:34.219906 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.212379    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 23:55:34.219906 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.212383    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 23:55:34.219906 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.212385    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 23:55:34.219906 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.212388    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 23:55:34.219906 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.212391    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 23:55:34.219906 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.212393    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 23:55:34.219906 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.212395    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 23:55:34.219906 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.212398    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 23:55:34.219906 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.212401    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 23:55:34.219906 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.212405    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 23:55:34.219906 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.212408    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 23:55:34.219906 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.212410    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 23:55:34.219906 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.212413    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 23:55:34.219906 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.212415    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 23:55:34.219906 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.212417    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 23:55:34.219906 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.212420    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 23:55:34.219906 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.212422    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 23:55:34.219906 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.212425    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 23:55:34.219906 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.212427    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 23:55:34.219906 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.212429    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 23:55:34.220640 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.212432    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 23:55:34.220640 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.212434    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 23:55:34.220640 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.212437    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 23:55:34.220640 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.212439    2578 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 23:55:34.220640 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.212441    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 23:55:34.220640 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.212444    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 23:55:34.220640 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.212447    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 23:55:34.220640 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.212449    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 23:55:34.220640 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.212451    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 23:55:34.220640 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.212455    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 23:55:34.220640 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.212458    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 23:55:34.220640 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.212461    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 23:55:34.220640 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.212463    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 23:55:34.220640 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.212467    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 23:55:34.220640 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.212469    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 23:55:34.220640 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.212472    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 23:55:34.220640 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.212474    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 23:55:34.220640 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.212477    2578 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 23:55:34.220640 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.212479    2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 23:55:34.221178 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.212482    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 23:55:34.221178 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.212484    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 23:55:34.221178 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.212488    2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 23:55:34.221178 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.212491    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 23:55:34.221178 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.212493    2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 23:55:34.221178 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.212495    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 23:55:34.221178 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.212498    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 23:55:34.221178 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.212500    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 23:55:34.221178 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.212502    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 23:55:34.221178 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.212505    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 23:55:34.221178 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.212507    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 23:55:34.221178 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.212509    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 23:55:34.221178 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.212512    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 23:55:34.221178 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.212514    2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 23:55:34.221178 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.212517    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 23:55:34.221178 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.212519    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 23:55:34.221178 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.212522    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 23:55:34.221178 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.212524    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 23:55:34.221178 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.212526    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 23:55:34.221657 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.212529    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 23:55:34.221657 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.212531    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 23:55:34.221657 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.212533    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 23:55:34.221657 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.212535    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 23:55:34.221657 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.212538    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 23:55:34.221657 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.212540    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 23:55:34.221657 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.212542    2578 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 23:55:34.221657 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.212546    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 23:55:34.221657 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.212550    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 23:55:34.221657 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.212553    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 23:55:34.221657 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.212555    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 23:55:34.221657 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.212557    2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 23:55:34.221657 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.212560    2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 23:55:34.221657 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.212562    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 23:55:34.221657 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.212565    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 23:55:34.221657 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.212569    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 23:55:34.221657 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.212571    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 23:55:34.221657 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.212574    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 23:55:34.221657 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.212576    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 23:55:34.221657 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.212579    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 23:55:34.222120 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.212581    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 23:55:34.222120 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.212584    2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 23:55:34.222120 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.212586    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 23:55:34.222120 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.212588    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 23:55:34.222120 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.212591    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 23:55:34.222120 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.212595    2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 23:55:34.222120 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.212598    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 23:55:34.222120 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.212600    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 23:55:34.222120 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.213306    2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 06 23:55:34.222120 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.221572    2578 server.go:529] "Kubelet version" kubeletVersion="v1.34.8"
Jul 06 23:55:34.222120 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.221586    2578 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 06 23:55:34.222423 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.222413    2578 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 06 23:55:34.222453 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.222426    2578 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 06 23:55:34.222484 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.222479    2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 23:55:34.222511 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.222485    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 23:55:34.222511 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.222490    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 23:55:34.222511 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.222494    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 23:55:34.222511 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.222496    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 23:55:34.222511 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.222499    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 23:55:34.222511 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.222502    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 23:55:34.222511 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.222505    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 23:55:34.222511 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.222508    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 23:55:34.222511 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.222511    2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 23:55:34.222511 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.222514    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 23:55:34.222746 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.222517    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 23:55:34.222746 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.222519    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 23:55:34.222746 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.222522    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 23:55:34.222746 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.222525    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 23:55:34.222746 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.222527    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 23:55:34.222746 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.222530    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 23:55:34.222746 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.222532    2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 23:55:34.222746 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.222535    2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 23:55:34.222746 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.222537    2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 23:55:34.222746 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.222539    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 23:55:34.222746 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.222542    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 23:55:34.222746 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.222544    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 23:55:34.222746 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.222546    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 23:55:34.222746 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.222549    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 23:55:34.222746 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.222551    2578 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 23:55:34.222746 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.222553    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 23:55:34.222746 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.222561    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 23:55:34.222746 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.222563    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 23:55:34.222746 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.222565    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 23:55:34.222746 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.222568    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 23:55:34.223202 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.222570    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 23:55:34.223202 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.222572    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 23:55:34.223202 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.222574    2578 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 23:55:34.223202 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.222577    2578 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 23:55:34.223202 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.222579    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 23:55:34.223202 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.222581    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 23:55:34.223202 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.222584    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 23:55:34.223202 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.222586    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 23:55:34.223202 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.222588    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 23:55:34.223202 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.222590    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 23:55:34.223202 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.222593    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 23:55:34.223202 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.222595    2578 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 23:55:34.223202 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.222597    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 23:55:34.223202 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.222601    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 23:55:34.223202 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.222603    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 23:55:34.223202 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.222605    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 23:55:34.223202 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.222608    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 23:55:34.223202 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.222610    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 23:55:34.223202 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.222612    2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 23:55:34.223202 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.222615    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 23:55:34.223202 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.222617    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 23:55:34.223720 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.222619    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 23:55:34.223720 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.222622    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 23:55:34.223720 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.222624    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 23:55:34.223720 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.222627    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 23:55:34.223720 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.222629    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 23:55:34.223720 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.222631    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 23:55:34.223720 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.222634    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 23:55:34.223720 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.222636    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 23:55:34.223720 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.222639    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 23:55:34.223720 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.222641    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 23:55:34.223720 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.222643    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 23:55:34.223720 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.222645    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 23:55:34.223720 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.222648    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 23:55:34.223720 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.222650    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 23:55:34.223720 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.222652    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 23:55:34.223720 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.222654    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 23:55:34.223720 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.222657    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 23:55:34.223720 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.222659    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 23:55:34.223720 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.222663    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 23:55:34.224161 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.222666    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 23:55:34.224161 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.222669    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 23:55:34.224161 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.222672    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 23:55:34.224161 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.222674    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 23:55:34.224161 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.222677    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 23:55:34.224161 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.222679    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 23:55:34.224161 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.222682    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 23:55:34.224161 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.222684    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 23:55:34.224161 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.222688    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 23:55:34.224161 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.222690    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 23:55:34.224161 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.222692    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 23:55:34.224161 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.222695    2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 23:55:34.224161 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.222697    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 23:55:34.224161 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.222699    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 23:55:34.224161 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.222703    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 23:55:34.224161 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.222706    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 23:55:34.224161 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.222708    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 23:55:34.224161 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.222711    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 23:55:34.224161 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.222713    2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 23:55:34.224632 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.222715    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 23:55:34.224632 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.222718    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 23:55:34.224632 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.222720    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 23:55:34.224632 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.222722    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 23:55:34.224632 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.222724    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 23:55:34.224632 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.222727    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 23:55:34.224632 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.222729    2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 23:55:34.224632 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.222731    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 23:55:34.224632 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.222734    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 23:55:34.224632 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.222738    2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 06 23:55:34.224632 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.222850    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 23:55:34.224632 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.222855    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 23:55:34.224632 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.222858    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 23:55:34.224632 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.222861    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 23:55:34.224632 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.222864    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 23:55:34.224988 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.222867    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 23:55:34.224988 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.222870    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 23:55:34.224988 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.222873    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 23:55:34.224988 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.222875    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 23:55:34.224988 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.222877    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 23:55:34.224988 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.222880    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 23:55:34.224988 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.222882    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 23:55:34.224988 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.222885    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 23:55:34.224988 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.222887    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 23:55:34.224988 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.222890    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 23:55:34.224988 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.222892    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 23:55:34.224988 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.222895    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 23:55:34.224988 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.222897    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 23:55:34.224988 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.222899    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 23:55:34.224988 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.222902    2578 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 23:55:34.224988 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.222904    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 23:55:34.224988 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.222906    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 23:55:34.224988 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.222908    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 23:55:34.224988 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.222911    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 23:55:34.224988 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.222913    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 23:55:34.225549 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.222915    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 23:55:34.225549 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.222917    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 23:55:34.225549 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.222920    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 23:55:34.225549 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.222923    2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 23:55:34.225549 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.222926    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 23:55:34.225549 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.222930    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 23:55:34.225549 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.222932    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 23:55:34.225549 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.222935    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 23:55:34.225549 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.222938    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 23:55:34.225549 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.222941    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 23:55:34.225549 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.222944    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 23:55:34.225549 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.222946    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 23:55:34.225549 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.222948    2578 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 23:55:34.225549 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.222951    2578 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 23:55:34.225549 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.222953    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 23:55:34.225549 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.222956    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 23:55:34.225549 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.222958    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 23:55:34.225549 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.222960    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 23:55:34.225549 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.222962    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 23:55:34.225549 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.222965    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 23:55:34.226050 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.222967    2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 23:55:34.226050 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.222970    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 23:55:34.226050 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.222972    2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 23:55:34.226050 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.222974    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 23:55:34.226050 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.222976    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 23:55:34.226050 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.222979    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 23:55:34.226050 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.222981    2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 23:55:34.226050 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.222983    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 23:55:34.226050 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.222985    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 23:55:34.226050 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.222988    2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 23:55:34.226050 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.222990    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 23:55:34.226050 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.222992    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 23:55:34.226050 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.222995    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 23:55:34.226050 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.222997    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 23:55:34.226050 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.222999    2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 23:55:34.226050 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.223001    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 23:55:34.226050 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.223004    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 23:55:34.226050 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.223006    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 23:55:34.226050 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.223008    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 23:55:34.226514 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.223011    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 23:55:34.226514 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.223013    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 23:55:34.226514 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.223015    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 23:55:34.226514 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.223017    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 23:55:34.226514 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.223020    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 23:55:34.226514 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.223022    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 23:55:34.226514 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.223024    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 23:55:34.226514 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.223027    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 23:55:34.226514 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.223029    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 23:55:34.226514 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.223032    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 23:55:34.226514 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.223034    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 23:55:34.226514 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.223036    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 23:55:34.226514 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.223039    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 23:55:34.226514 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.223041    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 23:55:34.226514 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.223044    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 23:55:34.226514 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.223046    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 23:55:34.226514 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.223049    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 23:55:34.226514 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.223051    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 23:55:34.226514 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.223053    2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 23:55:34.226514 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.223056    2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 23:55:34.226976 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.223058    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 23:55:34.226976 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.223060    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 23:55:34.226976 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.223062    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 23:55:34.226976 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.223065    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 23:55:34.226976 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.223067    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 23:55:34.226976 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.223069    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 23:55:34.226976 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.223072    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 23:55:34.226976 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.223074    2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 23:55:34.226976 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.223076    2578 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 23:55:34.226976 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.223078    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 23:55:34.226976 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.223081    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 23:55:34.226976 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.223083    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 23:55:34.226976 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.223089    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 23:55:34.226976 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.223092    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 23:55:34.226976 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:34.223095    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 23:55:34.227328 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.223099    2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 06 23:55:34.227328 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.223196    2578 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 06 23:55:34.227328 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.225869    2578 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 06 23:55:34.227408 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.227331    2578 server.go:1019] "Starting client certificate rotation"
Jul 06 23:55:34.227444 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.227427    2578 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 06 23:55:34.227480 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.227463    2578 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 06 23:55:34.230855 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.230842    2578 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 06 23:55:34.235489 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.235472    2578 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 06 23:55:34.241440 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.241421    2578 log.go:25] "Validated CRI v1 runtime API"
Jul 06 23:55:34.245064 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.245051    2578 log.go:25] "Validated CRI v1 image API"
Jul 06 23:55:34.246663 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.246650    2578 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 06 23:55:34.249114 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.249097    2578 fs.go:135] Filesystem UUIDs: map[070b9471-73c5-4dd4-87a7-2e0aab6a7388:/dev/nvme0n1p3 16bbc5a9-3a8d-492a-aefd-26a673900b20:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2]
Jul 06 23:55:34.249158 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.249114    2578 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 06 23:55:34.256453 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.256185    2578 manager.go:216] Machine: {Timestamp:2026-07-06 23:55:34.255246703 +0000 UTC m=+0.366320498 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3199196 MemoryCapacity:32812183552 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2beb04652c58c776b3cd7a1266aa62 SystemUUID:ec2beb04-652c-58c7-76b3-cd7a1266aa62 BootID:7f1eb4d3-43f6-4f7c-a8df-63a96af0d7d9 Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406093824 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406089728 Type:vfs Inodes:4005393 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562439168 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:84:25:0a:48:ed Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:84:25:0a:48:ed Speed:0 Mtu:9001} {Name:ovs-system MacAddress:26:c5:9d:52:0f:78 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812183552 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 06 23:55:34.256453 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.256446    2578 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 06 23:55:34.256565 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.256520    2578 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 06 23:55:34.258208 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.258178    2578 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 06 23:55:34.258345 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.258212    2578 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-129-23.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 06 23:55:34.259482 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.259470    2578 topology_manager.go:138] "Creating topology manager with none policy"
Jul 06 23:55:34.259482 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.259482    2578 container_manager_linux.go:309] "Creating device plugin manager"
Jul 06 23:55:34.259564 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.259489    2578 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 06 23:55:34.260162 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.260149    2578 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 06 23:55:34.260263 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.260250    2578 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 06 23:55:34.261465 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.261454    2578 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 06 23:55:34.264870 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.264860    2578 state_mem.go:36] "Initialized new in-memory state store"
Jul 06 23:55:34.264993 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.264967    2578 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 06 23:55:34.265029 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.265011    2578 kubelet.go:486] "Attempting to sync node with API server"
Jul 06 23:55:34.265029 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.265023    2578 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 06 23:55:34.265084 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.265034    2578 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 06 23:55:34.265084 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.265043    2578 kubelet.go:398] "Adding apiserver pod source"
Jul 06 23:55:34.265084 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.265050    2578 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 06 23:55:34.265416 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.265402    2578 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 06 23:55:34.265463 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.265431    2578 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 06 23:55:34.267957 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.267941    2578 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1"
Jul 06 23:55:34.270019 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.270006    2578 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 06 23:55:34.270066 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.270035    2578 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 06 23:55:34.271378 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.271364    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 06 23:55:34.271417 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.271387    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 06 23:55:34.271417 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.271393    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 06 23:55:34.271417 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.271398    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 06 23:55:34.271417 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.271407    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 06 23:55:34.271417 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.271413    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 06 23:55:34.271549 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.271422    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 06 23:55:34.271549 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.271427    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 06 23:55:34.271549 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.271433    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 06 23:55:34.271549 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.271438    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 06 23:55:34.271549 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.271446    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 06 23:55:34.271549 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.271452    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 06 23:55:34.272169 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.272160    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 06 23:55:34.272169 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.272169    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 06 23:55:34.275183 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.275169    2578 server.go:1268] "Started kubelet"
Jul 06 23:55:34.275257 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.275235    2578 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 06 23:55:34.275389 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.275342    2578 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 06 23:55:34.275452 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.275411    2578 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 06 23:55:34.276020 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.276002    2578 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-129-23.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 06 23:55:34.276078 ip-10-0-129-23 systemd[1]: Started Kubernetes Kubelet.
Jul 06 23:55:34.276501 ip-10-0-129-23 kubenswrapper[2578]: E0706 23:55:34.276171    2578 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 06 23:55:34.276501 ip-10-0-129-23 kubenswrapper[2578]: E0706 23:55:34.276371    2578 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-129-23.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 06 23:55:34.276724 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.276715    2578 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 06 23:55:34.277549 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.277536    2578 server.go:310] "Adding debug handlers to kubelet server"
Jul 06 23:55:34.281724 ip-10-0-129-23 kubenswrapper[2578]: E0706 23:55:34.281694    2578 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 06 23:55:34.282979 ip-10-0-129-23 kubenswrapper[2578]: E0706 23:55:34.282041    2578 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-23.ec2.internal.18bfd89a343f69ff  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-23.ec2.internal,UID:ip-10-0-129-23.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-129-23.ec2.internal,},FirstTimestamp:2026-07-06 23:55:34.275140095 +0000 UTC m=+0.386213889,LastTimestamp:2026-07-06 23:55:34.275140095 +0000 UTC m=+0.386213889,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-23.ec2.internal,}"
Jul 06 23:55:34.284188 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.284174    2578 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 06 23:55:34.285179 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.285155    2578 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 06 23:55:34.285268 ip-10-0-129-23 kubenswrapper[2578]: E0706 23:55:34.285253    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-23.ec2.internal\" not found"
Jul 06 23:55:34.285757 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.285741    2578 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 06 23:55:34.285835 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.285743    2578 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 06 23:55:34.285835 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.285782    2578 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 06 23:55:34.285917 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.285876    2578 reconstruct.go:97] "Volume reconstruction finished"
Jul 06 23:55:34.285917 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.285886    2578 reconciler.go:29] "Reconciler: start to sync state"
Jul 06 23:55:34.286081 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.286068    2578 factory.go:55] Registering systemd factory
Jul 06 23:55:34.286081 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.286081    2578 factory.go:223] Registration of the systemd container factory successfully
Jul 06 23:55:34.286276 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.286263    2578 factory.go:153] Registering CRI-O factory
Jul 06 23:55:34.286355 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.286295    2578 factory.go:223] Registration of the crio container factory successfully
Jul 06 23:55:34.286355 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.286350    2578 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 06 23:55:34.286453 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.286386    2578 factory.go:103] Registering Raw factory
Jul 06 23:55:34.286453 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.286402    2578 manager.go:1196] Started watching for new ooms in manager
Jul 06 23:55:34.286786 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.286773    2578 manager.go:349] Starting recovery of all containers
Jul 06 23:55:34.287480 ip-10-0-129-23 kubenswrapper[2578]: E0706 23:55:34.287456    2578 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-129-23.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 06 23:55:34.287570 ip-10-0-129-23 kubenswrapper[2578]: E0706 23:55:34.287479    2578 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 06 23:55:34.298643 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.298516    2578 manager.go:354] Recovery completed
Jul 06 23:55:34.299809 ip-10-0-129-23 kubenswrapper[2578]: E0706 23:55:34.299793    2578 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory
Jul 06 23:55:34.302503 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.302490    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 23:55:34.303883 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.303868    2578 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-xmx6m"
Jul 06 23:55:34.304361 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.304348    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-23.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 23:55:34.304419 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.304375    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-23.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 23:55:34.304419 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.304385    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-23.ec2.internal" event="NodeHasSufficientPID"
Jul 06 23:55:34.304858 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.304844    2578 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 06 23:55:34.304858 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.304854    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 23:55:34.304935 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.304857    2578 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 06 23:55:34.304935 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.304927    2578 state_mem.go:36] "Initialized new in-memory state store"
Jul 06 23:55:34.305523 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.305506    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-23.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 23:55:34.305593 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.305542    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-23.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 23:55:34.305593 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.305556    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-23.ec2.internal" event="NodeHasSufficientPID"
Jul 06 23:55:34.306115 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.306104    2578 policy_none.go:49] "None policy: Start"
Jul 06 23:55:34.306147 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.306118    2578 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 06 23:55:34.306147 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.306128    2578 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 06 23:55:34.307119 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.307109    2578 policy_none.go:47] "Start"
Jul 06 23:55:34.311168 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.311150    2578 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-xmx6m"
Jul 06 23:55:34.316195 ip-10-0-129-23 kubenswrapper[2578]: E0706 23:55:34.316134    2578 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-23.ec2.internal.18bfd89a35fd4e57  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-23.ec2.internal,UID:ip-10-0-129-23.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-129-23.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-129-23.ec2.internal,},FirstTimestamp:2026-07-06 23:55:34.304362071 +0000 UTC m=+0.415435866,LastTimestamp:2026-07-06 23:55:34.304362071 +0000 UTC m=+0.415435866,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-23.ec2.internal,}"
Jul 06 23:55:34.340847 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.340826    2578 manager.go:337] "Starting Device Plugin manager"
Jul 06 23:55:34.340935 ip-10-0-129-23 kubenswrapper[2578]: E0706 23:55:34.340860    2578 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 06 23:55:34.340935 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.340876    2578 server.go:87] "Starting device plugin registration server"
Jul 06 23:55:34.341147 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.341095    2578 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 06 23:55:34.341147 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.341121    2578 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 06 23:55:34.341508 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.341296    2578 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 06 23:55:34.341508 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.341465    2578 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 06 23:55:34.341508 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.341475    2578 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 06 23:55:34.342557 ip-10-0-129-23 kubenswrapper[2578]: E0706 23:55:34.342542    2578 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 06 23:55:34.342609 ip-10-0-129-23 kubenswrapper[2578]: E0706 23:55:34.342584    2578 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-129-23.ec2.internal\" not found"
Jul 06 23:55:34.382844 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.382823    2578 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 06 23:55:34.384050 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.384031    2578 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 06 23:55:34.384121 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.384074    2578 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 06 23:55:34.384121 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.384096    2578 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 06 23:55:34.384218 ip-10-0-129-23 kubenswrapper[2578]: E0706 23:55:34.384132    2578 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 06 23:55:34.386779 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.386763    2578 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 23:55:34.441821 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.441803    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 23:55:34.442694 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.442680    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-23.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 23:55:34.442755 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.442704    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-23.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 23:55:34.442755 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.442716    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-23.ec2.internal" event="NodeHasSufficientPID"
Jul 06 23:55:34.442755 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.442733    2578 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-129-23.ec2.internal"
Jul 06 23:55:34.454503 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.454465    2578 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-129-23.ec2.internal"
Jul 06 23:55:34.454503 ip-10-0-129-23 kubenswrapper[2578]: E0706 23:55:34.454484    2578 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-129-23.ec2.internal\": node \"ip-10-0-129-23.ec2.internal\" not found"
Jul 06 23:55:34.484550 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.484531    2578 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-23.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-129-23.ec2.internal"]
Jul 06 23:55:34.484625 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.484585    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 23:55:34.485509 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.485494    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-23.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 23:55:34.485567 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.485521    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-23.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 23:55:34.485567 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.485530    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-23.ec2.internal" event="NodeHasSufficientPID"
Jul 06 23:55:34.486796 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.486784    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 23:55:34.486910 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.486896    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-23.ec2.internal"
Jul 06 23:55:34.486948 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.486940    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 23:55:34.487575 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.487554    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-23.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 23:55:34.487575 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.487554    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-23.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 23:55:34.487680 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.487604    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-23.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 23:55:34.487680 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.487578    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-23.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 23:55:34.487680 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.487630    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-23.ec2.internal" event="NodeHasSufficientPID"
Jul 06 23:55:34.487680 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.487640    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-23.ec2.internal" event="NodeHasSufficientPID"
Jul 06 23:55:34.488681 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.488669    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-23.ec2.internal"
Jul 06 23:55:34.488742 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.488690    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 23:55:34.490156 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.490138    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-23.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 23:55:34.490246 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.490165    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-23.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 23:55:34.490246 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.490176    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-23.ec2.internal" event="NodeHasSufficientPID"
Jul 06 23:55:34.509295 ip-10-0-129-23 kubenswrapper[2578]: E0706 23:55:34.509268    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-23.ec2.internal\" not found"
Jul 06 23:55:34.514791 ip-10-0-129-23 kubenswrapper[2578]: E0706 23:55:34.514775    2578 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-23.ec2.internal\" not found" node="ip-10-0-129-23.ec2.internal"
Jul 06 23:55:34.518969 ip-10-0-129-23 kubenswrapper[2578]: E0706 23:55:34.518955    2578 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-23.ec2.internal\" not found" node="ip-10-0-129-23.ec2.internal"
Jul 06 23:55:34.586718 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.586701    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/69102573f9114d1d93cb35c1c9fbaca4-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-23.ec2.internal\" (UID: \"69102573f9114d1d93cb35c1c9fbaca4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-23.ec2.internal"
Jul 06 23:55:34.586787 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.586729    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/69102573f9114d1d93cb35c1c9fbaca4-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-23.ec2.internal\" (UID: \"69102573f9114d1d93cb35c1c9fbaca4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-23.ec2.internal"
Jul 06 23:55:34.586787 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.586745    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/dac848c666487bcdf1b079d63eb47623-config\") pod \"kube-apiserver-proxy-ip-10-0-129-23.ec2.internal\" (UID: \"dac848c666487bcdf1b079d63eb47623\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-23.ec2.internal"
Jul 06 23:55:34.609332 ip-10-0-129-23 kubenswrapper[2578]: E0706 23:55:34.609311    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-23.ec2.internal\" not found"
Jul 06 23:55:34.687372 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.687347    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/69102573f9114d1d93cb35c1c9fbaca4-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-23.ec2.internal\" (UID: \"69102573f9114d1d93cb35c1c9fbaca4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-23.ec2.internal"
Jul 06 23:55:34.687424 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.687376    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/69102573f9114d1d93cb35c1c9fbaca4-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-23.ec2.internal\" (UID: \"69102573f9114d1d93cb35c1c9fbaca4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-23.ec2.internal"
Jul 06 23:55:34.687424 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.687391    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/dac848c666487bcdf1b079d63eb47623-config\") pod \"kube-apiserver-proxy-ip-10-0-129-23.ec2.internal\" (UID: \"dac848c666487bcdf1b079d63eb47623\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-23.ec2.internal"
Jul 06 23:55:34.687424 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.687413    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/dac848c666487bcdf1b079d63eb47623-config\") pod \"kube-apiserver-proxy-ip-10-0-129-23.ec2.internal\" (UID: \"dac848c666487bcdf1b079d63eb47623\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-23.ec2.internal"
Jul 06 23:55:34.687517 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.687437    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/69102573f9114d1d93cb35c1c9fbaca4-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-23.ec2.internal\" (UID: \"69102573f9114d1d93cb35c1c9fbaca4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-23.ec2.internal"
Jul 06 23:55:34.687517 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.687448    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/69102573f9114d1d93cb35c1c9fbaca4-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-23.ec2.internal\" (UID: \"69102573f9114d1d93cb35c1c9fbaca4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-23.ec2.internal"
Jul 06 23:55:34.709444 ip-10-0-129-23 kubenswrapper[2578]: E0706 23:55:34.709404    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-23.ec2.internal\" not found"
Jul 06 23:55:34.810148 ip-10-0-129-23 kubenswrapper[2578]: E0706 23:55:34.810126    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-23.ec2.internal\" not found"
Jul 06 23:55:34.817271 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.817256    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-23.ec2.internal"
Jul 06 23:55:34.821901 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:34.821888    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-23.ec2.internal"
Jul 06 23:55:34.910839 ip-10-0-129-23 kubenswrapper[2578]: E0706 23:55:34.910817    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-23.ec2.internal\" not found"
Jul 06 23:55:35.011313 ip-10-0-129-23 kubenswrapper[2578]: E0706 23:55:35.011254    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-23.ec2.internal\" not found"
Jul 06 23:55:35.111724 ip-10-0-129-23 kubenswrapper[2578]: E0706 23:55:35.111704    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-23.ec2.internal\" not found"
Jul 06 23:55:35.212186 ip-10-0-129-23 kubenswrapper[2578]: E0706 23:55:35.212168    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-23.ec2.internal\" not found"
Jul 06 23:55:35.226344 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:35.226327    2578 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 06 23:55:35.226453 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:35.226436    2578 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 06 23:55:35.312614 ip-10-0-129-23 kubenswrapper[2578]: E0706 23:55:35.312598    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-23.ec2.internal\" not found"
Jul 06 23:55:35.315795 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:35.315758    2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-05 23:50:34 +0000 UTC" deadline="2028-02-06 13:26:38.929462183 +0000 UTC"
Jul 06 23:55:35.315843 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:35.315796    2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13909h31m3.613668989s"
Jul 06 23:55:35.339501 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:35.339478    2578 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 23:55:35.385672 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:35.385648    2578 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-23.ec2.internal"
Jul 06 23:55:35.398257 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:35.398238    2578 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 06 23:55:35.400179 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:35.400166    2578 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-23.ec2.internal"
Jul 06 23:55:35.408700 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:35.408687    2578 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 06 23:55:35.432812 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:35.432788    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddac848c666487bcdf1b079d63eb47623.slice/crio-fd8d733001aab0b7affb8815a175016849a9326eb099a22be15a3bfb9cfe7fd2 WatchSource:0}: Error finding container fd8d733001aab0b7affb8815a175016849a9326eb099a22be15a3bfb9cfe7fd2: Status 404 returned error can't find the container with id fd8d733001aab0b7affb8815a175016849a9326eb099a22be15a3bfb9cfe7fd2
Jul 06 23:55:35.433668 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:35.433647    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69102573f9114d1d93cb35c1c9fbaca4.slice/crio-c5c34698d659b557279c863a87bb013cd56b6002c5aa94e391390b8e6bfd1fb6 WatchSource:0}: Error finding container c5c34698d659b557279c863a87bb013cd56b6002c5aa94e391390b8e6bfd1fb6: Status 404 returned error can't find the container with id c5c34698d659b557279c863a87bb013cd56b6002c5aa94e391390b8e6bfd1fb6
Jul 06 23:55:35.437941 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:35.437918    2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 06 23:55:35.453453 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:35.453428    2578 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 23:55:35.719715 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:35.719656    2578 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 23:55:36.076895 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.076703    2578 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 23:55:36.266603 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.266343    2578 apiserver.go:52] "Watching apiserver"
Jul 06 23:55:36.278018 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.277986    2578 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 06 23:55:36.278430 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.278404    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-node-tuning-operator/tuned-7f4mc","openshift-dns/node-resolver-2h2rk","openshift-image-registry/node-ca-qndzw","openshift-multus/multus-gk9q8","openshift-network-operator/iptables-alerter-sg4kc","kube-system/konnectivity-agent-dfsn2","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-23.ec2.internal","openshift-multus/multus-additional-cni-plugins-kmhhp","openshift-multus/network-metrics-daemon-g45vp","openshift-network-diagnostics/network-check-target-sqcsc","openshift-ovn-kubernetes/ovnkube-node-jfngf","kube-system/global-pull-secret-syncer-cm65t","kube-system/kube-apiserver-proxy-ip-10-0-129-23.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4hfmp"]
Jul 06 23:55:36.281467 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.281138    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g45vp"
Jul 06 23:55:36.281467 ip-10-0-129-23 kubenswrapper[2578]: E0706 23:55:36.281224    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g45vp" podUID="ed50a99b-7856-44b3-bb1a-12f8b25546b9"
Jul 06 23:55:36.283909 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.283888    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-2h2rk"
Jul 06 23:55:36.284944 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.284924    2578 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 06 23:55:36.286788 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.286767    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 06 23:55:36.286893 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.286792    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 06 23:55:36.287012 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.286998    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-8s2lb\""
Jul 06 23:55:36.288992 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.288496    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4hfmp"
Jul 06 23:55:36.290962 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.290685    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-gk9q8"
Jul 06 23:55:36.291221 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.291199    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 06 23:55:36.291627 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.291600    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 06 23:55:36.291860 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.291839    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 06 23:55:36.291860 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.291857    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-9h5rp\""
Jul 06 23:55:36.293488 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.293332    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-sg4kc"
Jul 06 23:55:36.294302 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.294281    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 06 23:55:36.294451 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.294426    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-w6v94\""
Jul 06 23:55:36.294556 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.294517    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 06 23:55:36.294651 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.294636    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 06 23:55:36.294918 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.294766    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 06 23:55:36.296527 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.296505    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 06 23:55:36.296840 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.296819    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 06 23:55:36.297049 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.297032    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-6b7w4\""
Jul 06 23:55:36.297550 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.297526    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8nf2n\" (UniqueName: \"kubernetes.io/projected/ed50a99b-7856-44b3-bb1a-12f8b25546b9-kube-api-access-8nf2n\") pod \"network-metrics-daemon-g45vp\" (UID: \"ed50a99b-7856-44b3-bb1a-12f8b25546b9\") " pod="openshift-multus/network-metrics-daemon-g45vp"
Jul 06 23:55:36.297634 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.297565    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/66f64c88-7770-4613-81c2-97f105d345e5-hosts-file\") pod \"node-resolver-2h2rk\" (UID: \"66f64c88-7770-4613-81c2-97f105d345e5\") " pod="openshift-dns/node-resolver-2h2rk"
Jul 06 23:55:36.297634 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.297592    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4e757f80-3ca9-43c3-9e22-224374be02d8-device-dir\") pod \"aws-ebs-csi-driver-node-4hfmp\" (UID: \"4e757f80-3ca9-43c3-9e22-224374be02d8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4hfmp"
Jul 06 23:55:36.297634 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.297619    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zxw5c\" (UniqueName: \"kubernetes.io/projected/66f64c88-7770-4613-81c2-97f105d345e5-kube-api-access-zxw5c\") pod \"node-resolver-2h2rk\" (UID: \"66f64c88-7770-4613-81c2-97f105d345e5\") " pod="openshift-dns/node-resolver-2h2rk"
Jul 06 23:55:36.297792 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.297645    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4e757f80-3ca9-43c3-9e22-224374be02d8-registration-dir\") pod \"aws-ebs-csi-driver-node-4hfmp\" (UID: \"4e757f80-3ca9-43c3-9e22-224374be02d8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4hfmp"
Jul 06 23:55:36.297792 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.297668    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4e757f80-3ca9-43c3-9e22-224374be02d8-etc-selinux\") pod \"aws-ebs-csi-driver-node-4hfmp\" (UID: \"4e757f80-3ca9-43c3-9e22-224374be02d8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4hfmp"
Jul 06 23:55:36.297792 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.297704    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ed50a99b-7856-44b3-bb1a-12f8b25546b9-metrics-certs\") pod \"network-metrics-daemon-g45vp\" (UID: \"ed50a99b-7856-44b3-bb1a-12f8b25546b9\") " pod="openshift-multus/network-metrics-daemon-g45vp"
Jul 06 23:55:36.297792 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.297727    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/66f64c88-7770-4613-81c2-97f105d345e5-tmp-dir\") pod \"node-resolver-2h2rk\" (UID: \"66f64c88-7770-4613-81c2-97f105d345e5\") " pod="openshift-dns/node-resolver-2h2rk"
Jul 06 23:55:36.297792 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.297752    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4e757f80-3ca9-43c3-9e22-224374be02d8-kubelet-dir\") pod \"aws-ebs-csi-driver-node-4hfmp\" (UID: \"4e757f80-3ca9-43c3-9e22-224374be02d8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4hfmp"
Jul 06 23:55:36.297792 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.297778    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4e757f80-3ca9-43c3-9e22-224374be02d8-socket-dir\") pod \"aws-ebs-csi-driver-node-4hfmp\" (UID: \"4e757f80-3ca9-43c3-9e22-224374be02d8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4hfmp"
Jul 06 23:55:36.298085 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.297804    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4e757f80-3ca9-43c3-9e22-224374be02d8-sys-fs\") pod \"aws-ebs-csi-driver-node-4hfmp\" (UID: \"4e757f80-3ca9-43c3-9e22-224374be02d8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4hfmp"
Jul 06 23:55:36.298085 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.297829    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gqz2n\" (UniqueName: \"kubernetes.io/projected/4e757f80-3ca9-43c3-9e22-224374be02d8-kube-api-access-gqz2n\") pod \"aws-ebs-csi-driver-node-4hfmp\" (UID: \"4e757f80-3ca9-43c3-9e22-224374be02d8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4hfmp"
Jul 06 23:55:36.298277 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.298255    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 06 23:55:36.298453 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.298431    2578 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 06 23:55:36.298572 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.298555    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-dfsn2"
Jul 06 23:55:36.299041 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.299025    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-jfngf"
Jul 06 23:55:36.302000 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.301980    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-z8kw2\""
Jul 06 23:55:36.302090 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.302083    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 06 23:55:36.302203 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.302187    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 06 23:55:36.302385 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.302360    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-kmhhp"
Jul 06 23:55:36.304482 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.304466    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sqcsc"
Jul 06 23:55:36.304652 ip-10-0-129-23 kubenswrapper[2578]: E0706 23:55:36.304631    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sqcsc" podUID="7db1fb04-9b13-425c-abb1-05f4274fe959"
Jul 06 23:55:36.307429 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.306935    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-7f4mc"
Jul 06 23:55:36.313377 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.309433    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cm65t"
Jul 06 23:55:36.313377 ip-10-0-129-23 kubenswrapper[2578]: E0706 23:55:36.309536    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cm65t" podUID="f6ae72be-9753-46d1-a665-c2124741a26a"
Jul 06 23:55:36.313377 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.310511    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 06 23:55:36.313377 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.311152    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 06 23:55:36.313377 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.311590    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 06 23:55:36.313377 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.311680    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 06 23:55:36.313377 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.312149    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 06 23:55:36.313377 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.312335    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 06 23:55:36.313377 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.312436    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 06 23:55:36.313377 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.312867    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 06 23:55:36.313377 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.313344    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 06 23:55:36.313922 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.313672    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-8g88m\""
Jul 06 23:55:36.314990 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.314936    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-mtjlm\""
Jul 06 23:55:36.315987 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.315913    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-wjt67\""
Jul 06 23:55:36.317041 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.317016    2578 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-pb7bd"
Jul 06 23:55:36.317671 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.317649    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 06 23:55:36.318367 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.318348    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-qndzw"
Jul 06 23:55:36.321170 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.321146    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 06 23:55:36.321408 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.321391    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 06 23:55:36.321588 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.321572    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-l2m9d\""
Jul 06 23:55:36.321782 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.321767    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 06 23:55:36.324496 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.324473    2578 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-pb7bd"
Jul 06 23:55:36.386814 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.386787    2578 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 06 23:55:36.390374 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.390271    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-23.ec2.internal" event={"ID":"dac848c666487bcdf1b079d63eb47623","Type":"ContainerStarted","Data":"fd8d733001aab0b7affb8815a175016849a9326eb099a22be15a3bfb9cfe7fd2"}
Jul 06 23:55:36.391809 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.391784    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-23.ec2.internal" event={"ID":"69102573f9114d1d93cb35c1c9fbaca4","Type":"ContainerStarted","Data":"c5c34698d659b557279c863a87bb013cd56b6002c5aa94e391390b8e6bfd1fb6"}
Jul 06 23:55:36.398222 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.398202    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/df4215f7-4f0d-4ba1-b66d-b8902a323531-serviceca\") pod \"node-ca-qndzw\" (UID: \"df4215f7-4f0d-4ba1-b66d-b8902a323531\") " pod="openshift-image-registry/node-ca-qndzw"
Jul 06 23:55:36.398403 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.398373    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w2f2w\" (UniqueName: \"kubernetes.io/projected/df4215f7-4f0d-4ba1-b66d-b8902a323531-kube-api-access-w2f2w\") pod \"node-ca-qndzw\" (UID: \"df4215f7-4f0d-4ba1-b66d-b8902a323531\") " pod="openshift-image-registry/node-ca-qndzw"
Jul 06 23:55:36.398538 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.398409    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/aba6ad45-845e-4916-8cf1-b8c76da93308-host-slash\") pod \"ovnkube-node-jfngf\" (UID: \"aba6ad45-845e-4916-8cf1-b8c76da93308\") " pod="openshift-ovn-kubernetes/ovnkube-node-jfngf"
Jul 06 23:55:36.398538 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.398436    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c9a06bd6-5b2c-4d39-8401-06cd95486de7-host\") pod \"tuned-7f4mc\" (UID: \"c9a06bd6-5b2c-4d39-8401-06cd95486de7\") " pod="openshift-cluster-node-tuning-operator/tuned-7f4mc"
Jul 06 23:55:36.398538 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.398462    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b9a2aa01-bfc8-40f8-b4d7-962428e95667-system-cni-dir\") pod \"multus-additional-cni-plugins-kmhhp\" (UID: \"b9a2aa01-bfc8-40f8-b4d7-962428e95667\") " pod="openshift-multus/multus-additional-cni-plugins-kmhhp"
Jul 06 23:55:36.398538 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.398488    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/aba6ad45-845e-4916-8cf1-b8c76da93308-systemd-units\") pod \"ovnkube-node-jfngf\" (UID: \"aba6ad45-845e-4916-8cf1-b8c76da93308\") " pod="openshift-ovn-kubernetes/ovnkube-node-jfngf"
Jul 06 23:55:36.398538 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.398510    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3afd5761-b4ad-4002-b9e7-d646b63d53f0-os-release\") pod \"multus-gk9q8\" (UID: \"3afd5761-b4ad-4002-b9e7-d646b63d53f0\") " pod="openshift-multus/multus-gk9q8"
Jul 06 23:55:36.398740 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.398538    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3afd5761-b4ad-4002-b9e7-d646b63d53f0-host-var-lib-cni-bin\") pod \"multus-gk9q8\" (UID: \"3afd5761-b4ad-4002-b9e7-d646b63d53f0\") " pod="openshift-multus/multus-gk9q8"
Jul 06 23:55:36.398740 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.398567    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b9a2aa01-bfc8-40f8-b4d7-962428e95667-cnibin\") pod \"multus-additional-cni-plugins-kmhhp\" (UID: \"b9a2aa01-bfc8-40f8-b4d7-962428e95667\") " pod="openshift-multus/multus-additional-cni-plugins-kmhhp"
Jul 06 23:55:36.398740 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.398585    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f6ae72be-9753-46d1-a665-c2124741a26a-kubelet-config\") pod \"global-pull-secret-syncer-cm65t\" (UID: \"f6ae72be-9753-46d1-a665-c2124741a26a\") " pod="kube-system/global-pull-secret-syncer-cm65t"
Jul 06 23:55:36.398740 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.398609    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/aba6ad45-845e-4916-8cf1-b8c76da93308-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-jfngf\" (UID: \"aba6ad45-845e-4916-8cf1-b8c76da93308\") " pod="openshift-ovn-kubernetes/ovnkube-node-jfngf"
Jul 06 23:55:36.398740 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.398636    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/aba6ad45-845e-4916-8cf1-b8c76da93308-ovnkube-config\") pod \"ovnkube-node-jfngf\" (UID: \"aba6ad45-845e-4916-8cf1-b8c76da93308\") " pod="openshift-ovn-kubernetes/ovnkube-node-jfngf"
Jul 06 23:55:36.398740 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.398652    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c9a06bd6-5b2c-4d39-8401-06cd95486de7-lib-modules\") pod \"tuned-7f4mc\" (UID: \"c9a06bd6-5b2c-4d39-8401-06cd95486de7\") " pod="openshift-cluster-node-tuning-operator/tuned-7f4mc"
Jul 06 23:55:36.398740 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.398665    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3afd5761-b4ad-4002-b9e7-d646b63d53f0-multus-cni-dir\") pod \"multus-gk9q8\" (UID: \"3afd5761-b4ad-4002-b9e7-d646b63d53f0\") " pod="openshift-multus/multus-gk9q8"
Jul 06 23:55:36.398740 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.398680    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/aba6ad45-845e-4916-8cf1-b8c76da93308-host-kubelet\") pod \"ovnkube-node-jfngf\" (UID: \"aba6ad45-845e-4916-8cf1-b8c76da93308\") " pod="openshift-ovn-kubernetes/ovnkube-node-jfngf"
Jul 06 23:55:36.399170 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.398724    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gqz2n\" (UniqueName: \"kubernetes.io/projected/4e757f80-3ca9-43c3-9e22-224374be02d8-kube-api-access-gqz2n\") pod \"aws-ebs-csi-driver-node-4hfmp\" (UID: \"4e757f80-3ca9-43c3-9e22-224374be02d8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4hfmp"
Jul 06 23:55:36.399170 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.398772    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3afd5761-b4ad-4002-b9e7-d646b63d53f0-multus-conf-dir\") pod \"multus-gk9q8\" (UID: \"3afd5761-b4ad-4002-b9e7-d646b63d53f0\") " pod="openshift-multus/multus-gk9q8"
Jul 06 23:55:36.399170 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.398788    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/9a5fa453-505c-4742-86da-db343c8d36af-agent-certs\") pod \"konnectivity-agent-dfsn2\" (UID: \"9a5fa453-505c-4742-86da-db343c8d36af\") " pod="kube-system/konnectivity-agent-dfsn2"
Jul 06 23:55:36.399170 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.398807    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/aba6ad45-845e-4916-8cf1-b8c76da93308-host-run-ovn-kubernetes\") pod \"ovnkube-node-jfngf\" (UID: \"aba6ad45-845e-4916-8cf1-b8c76da93308\") " pod="openshift-ovn-kubernetes/ovnkube-node-jfngf"
Jul 06 23:55:36.399170 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.398898    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/aba6ad45-845e-4916-8cf1-b8c76da93308-env-overrides\") pod \"ovnkube-node-jfngf\" (UID: \"aba6ad45-845e-4916-8cf1-b8c76da93308\") " pod="openshift-ovn-kubernetes/ovnkube-node-jfngf"
Jul 06 23:55:36.399170 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.398918    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/aba6ad45-845e-4916-8cf1-b8c76da93308-ovn-node-metrics-cert\") pod \"ovnkube-node-jfngf\" (UID: \"aba6ad45-845e-4916-8cf1-b8c76da93308\") " pod="openshift-ovn-kubernetes/ovnkube-node-jfngf"
Jul 06 23:55:36.399170 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.398957    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4e757f80-3ca9-43c3-9e22-224374be02d8-device-dir\") pod \"aws-ebs-csi-driver-node-4hfmp\" (UID: \"4e757f80-3ca9-43c3-9e22-224374be02d8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4hfmp"
Jul 06 23:55:36.399170 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.398979    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3afd5761-b4ad-4002-b9e7-d646b63d53f0-host-run-k8s-cni-cncf-io\") pod \"multus-gk9q8\" (UID: \"3afd5761-b4ad-4002-b9e7-d646b63d53f0\") " pod="openshift-multus/multus-gk9q8"
Jul 06 23:55:36.399170 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.399001    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3afd5761-b4ad-4002-b9e7-d646b63d53f0-etc-kubernetes\") pod \"multus-gk9q8\" (UID: \"3afd5761-b4ad-4002-b9e7-d646b63d53f0\") " pod="openshift-multus/multus-gk9q8"
Jul 06 23:55:36.399170 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.399016    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f6ae72be-9753-46d1-a665-c2124741a26a-original-pull-secret\") pod \"global-pull-secret-syncer-cm65t\" (UID: \"f6ae72be-9753-46d1-a665-c2124741a26a\") " pod="kube-system/global-pull-secret-syncer-cm65t"
Jul 06 23:55:36.399170 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.399033    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4e757f80-3ca9-43c3-9e22-224374be02d8-etc-selinux\") pod \"aws-ebs-csi-driver-node-4hfmp\" (UID: \"4e757f80-3ca9-43c3-9e22-224374be02d8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4hfmp"
Jul 06 23:55:36.399170 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.399069    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c9a06bd6-5b2c-4d39-8401-06cd95486de7-sys\") pod \"tuned-7f4mc\" (UID: \"c9a06bd6-5b2c-4d39-8401-06cd95486de7\") " pod="openshift-cluster-node-tuning-operator/tuned-7f4mc"
Jul 06 23:55:36.399170 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.399092    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c9a06bd6-5b2c-4d39-8401-06cd95486de7-tmp\") pod \"tuned-7f4mc\" (UID: \"c9a06bd6-5b2c-4d39-8401-06cd95486de7\") " pod="openshift-cluster-node-tuning-operator/tuned-7f4mc"
Jul 06 23:55:36.399726 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.399193    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f1501e51-2268-4e04-800c-72e6af073f5e-host-slash\") pod \"iptables-alerter-sg4kc\" (UID: \"f1501e51-2268-4e04-800c-72e6af073f5e\") " pod="openshift-network-operator/iptables-alerter-sg4kc"
Jul 06 23:55:36.399726 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.399209    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4e757f80-3ca9-43c3-9e22-224374be02d8-etc-selinux\") pod \"aws-ebs-csi-driver-node-4hfmp\" (UID: \"4e757f80-3ca9-43c3-9e22-224374be02d8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4hfmp"
Jul 06 23:55:36.399726 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.399211    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4e757f80-3ca9-43c3-9e22-224374be02d8-device-dir\") pod \"aws-ebs-csi-driver-node-4hfmp\" (UID: \"4e757f80-3ca9-43c3-9e22-224374be02d8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4hfmp"
Jul 06 23:55:36.399726 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.399222    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wm5xx\" (UniqueName: \"kubernetes.io/projected/7db1fb04-9b13-425c-abb1-05f4274fe959-kube-api-access-wm5xx\") pod \"network-check-target-sqcsc\" (UID: \"7db1fb04-9b13-425c-abb1-05f4274fe959\") " pod="openshift-network-diagnostics/network-check-target-sqcsc"
Jul 06 23:55:36.399726 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.399300    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c9a06bd6-5b2c-4d39-8401-06cd95486de7-etc-sysconfig\") pod \"tuned-7f4mc\" (UID: \"c9a06bd6-5b2c-4d39-8401-06cd95486de7\") " pod="openshift-cluster-node-tuning-operator/tuned-7f4mc"
Jul 06 23:55:36.399726 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.399325    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c9a06bd6-5b2c-4d39-8401-06cd95486de7-etc-sysctl-conf\") pod \"tuned-7f4mc\" (UID: \"c9a06bd6-5b2c-4d39-8401-06cd95486de7\") " pod="openshift-cluster-node-tuning-operator/tuned-7f4mc"
Jul 06 23:55:36.399726 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.399366    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3afd5761-b4ad-4002-b9e7-d646b63d53f0-cnibin\") pod \"multus-gk9q8\" (UID: \"3afd5761-b4ad-4002-b9e7-d646b63d53f0\") " pod="openshift-multus/multus-gk9q8"
Jul 06 23:55:36.399726 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.399400    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b9a2aa01-bfc8-40f8-b4d7-962428e95667-os-release\") pod \"multus-additional-cni-plugins-kmhhp\" (UID: \"b9a2aa01-bfc8-40f8-b4d7-962428e95667\") " pod="openshift-multus/multus-additional-cni-plugins-kmhhp"
Jul 06 23:55:36.399726 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.399423    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/aba6ad45-845e-4916-8cf1-b8c76da93308-host-run-netns\") pod \"ovnkube-node-jfngf\" (UID: \"aba6ad45-845e-4916-8cf1-b8c76da93308\") " pod="openshift-ovn-kubernetes/ovnkube-node-jfngf"
Jul 06 23:55:36.399726 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.399445    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/aba6ad45-845e-4916-8cf1-b8c76da93308-host-cni-bin\") pod \"ovnkube-node-jfngf\" (UID: \"aba6ad45-845e-4916-8cf1-b8c76da93308\") " pod="openshift-ovn-kubernetes/ovnkube-node-jfngf"
Jul 06 23:55:36.399726 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.399490    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/66f64c88-7770-4613-81c2-97f105d345e5-hosts-file\") pod \"node-resolver-2h2rk\" (UID: \"66f64c88-7770-4613-81c2-97f105d345e5\") " pod="openshift-dns/node-resolver-2h2rk"
Jul 06 23:55:36.399726 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.399557    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/66f64c88-7770-4613-81c2-97f105d345e5-hosts-file\") pod \"node-resolver-2h2rk\" (UID: \"66f64c88-7770-4613-81c2-97f105d345e5\") " pod="openshift-dns/node-resolver-2h2rk"
Jul 06 23:55:36.399726 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.399561    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c9a06bd6-5b2c-4d39-8401-06cd95486de7-etc-sysctl-d\") pod \"tuned-7f4mc\" (UID: \"c9a06bd6-5b2c-4d39-8401-06cd95486de7\") " pod="openshift-cluster-node-tuning-operator/tuned-7f4mc"
Jul 06 23:55:36.399726 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.399599    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3afd5761-b4ad-4002-b9e7-d646b63d53f0-system-cni-dir\") pod \"multus-gk9q8\" (UID: \"3afd5761-b4ad-4002-b9e7-d646b63d53f0\") " pod="openshift-multus/multus-gk9q8"
Jul 06 23:55:36.399726 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.399620    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3afd5761-b4ad-4002-b9e7-d646b63d53f0-host-run-netns\") pod \"multus-gk9q8\" (UID: \"3afd5761-b4ad-4002-b9e7-d646b63d53f0\") " pod="openshift-multus/multus-gk9q8"
Jul 06 23:55:36.399726 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.399638    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f1501e51-2268-4e04-800c-72e6af073f5e-iptables-alerter-script\") pod \"iptables-alerter-sg4kc\" (UID: \"f1501e51-2268-4e04-800c-72e6af073f5e\") " pod="openshift-network-operator/iptables-alerter-sg4kc"
Jul 06 23:55:36.399726 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.399657    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/aba6ad45-845e-4916-8cf1-b8c76da93308-run-openvswitch\") pod \"ovnkube-node-jfngf\" (UID: \"aba6ad45-845e-4916-8cf1-b8c76da93308\") " pod="openshift-ovn-kubernetes/ovnkube-node-jfngf"
Jul 06 23:55:36.400519 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.399675    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/aba6ad45-845e-4916-8cf1-b8c76da93308-node-log\") pod \"ovnkube-node-jfngf\" (UID: \"aba6ad45-845e-4916-8cf1-b8c76da93308\") " pod="openshift-ovn-kubernetes/ovnkube-node-jfngf"
Jul 06 23:55:36.400519 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.399697    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/aba6ad45-845e-4916-8cf1-b8c76da93308-ovnkube-script-lib\") pod \"ovnkube-node-jfngf\" (UID: \"aba6ad45-845e-4916-8cf1-b8c76da93308\") " pod="openshift-ovn-kubernetes/ovnkube-node-jfngf"
Jul 06 23:55:36.400519 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.399739    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zxw5c\" (UniqueName: \"kubernetes.io/projected/66f64c88-7770-4613-81c2-97f105d345e5-kube-api-access-zxw5c\") pod \"node-resolver-2h2rk\" (UID: \"66f64c88-7770-4613-81c2-97f105d345e5\") " pod="openshift-dns/node-resolver-2h2rk"
Jul 06 23:55:36.400519 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.399800    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4e757f80-3ca9-43c3-9e22-224374be02d8-registration-dir\") pod \"aws-ebs-csi-driver-node-4hfmp\" (UID: \"4e757f80-3ca9-43c3-9e22-224374be02d8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4hfmp"
Jul 06 23:55:36.400519 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.399830    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/df4215f7-4f0d-4ba1-b66d-b8902a323531-host\") pod \"node-ca-qndzw\" (UID: \"df4215f7-4f0d-4ba1-b66d-b8902a323531\") " pod="openshift-image-registry/node-ca-qndzw"
Jul 06 23:55:36.400519 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.399852    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3afd5761-b4ad-4002-b9e7-d646b63d53f0-host-var-lib-cni-multus\") pod \"multus-gk9q8\" (UID: \"3afd5761-b4ad-4002-b9e7-d646b63d53f0\") " pod="openshift-multus/multus-gk9q8"
Jul 06 23:55:36.400519 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.399901    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b9a2aa01-bfc8-40f8-b4d7-962428e95667-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-kmhhp\" (UID: \"b9a2aa01-bfc8-40f8-b4d7-962428e95667\") " pod="openshift-multus/multus-additional-cni-plugins-kmhhp"
Jul 06 23:55:36.400519 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.399966    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f6ae72be-9753-46d1-a665-c2124741a26a-dbus\") pod \"global-pull-secret-syncer-cm65t\" (UID: \"f6ae72be-9753-46d1-a665-c2124741a26a\") " pod="kube-system/global-pull-secret-syncer-cm65t"
Jul 06 23:55:36.400519 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.399993    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/aba6ad45-845e-4916-8cf1-b8c76da93308-etc-openvswitch\") pod \"ovnkube-node-jfngf\" (UID: \"aba6ad45-845e-4916-8cf1-b8c76da93308\") " pod="openshift-ovn-kubernetes/ovnkube-node-jfngf"
Jul 06 23:55:36.400519 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.400023    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ed50a99b-7856-44b3-bb1a-12f8b25546b9-metrics-certs\") pod \"network-metrics-daemon-g45vp\" (UID: \"ed50a99b-7856-44b3-bb1a-12f8b25546b9\") " pod="openshift-multus/network-metrics-daemon-g45vp"
Jul 06 23:55:36.400519 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.400048    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c9a06bd6-5b2c-4d39-8401-06cd95486de7-etc-kubernetes\") pod \"tuned-7f4mc\" (UID: \"c9a06bd6-5b2c-4d39-8401-06cd95486de7\") " pod="openshift-cluster-node-tuning-operator/tuned-7f4mc"
Jul 06 23:55:36.400519 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.400075    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c9a06bd6-5b2c-4d39-8401-06cd95486de7-var-lib-kubelet\") pod \"tuned-7f4mc\" (UID: \"c9a06bd6-5b2c-4d39-8401-06cd95486de7\") " pod="openshift-cluster-node-tuning-operator/tuned-7f4mc"
Jul 06 23:55:36.400519 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.400100    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3afd5761-b4ad-4002-b9e7-d646b63d53f0-host-run-multus-certs\") pod \"multus-gk9q8\" (UID: \"3afd5761-b4ad-4002-b9e7-d646b63d53f0\") " pod="openshift-multus/multus-gk9q8"
Jul 06 23:55:36.400519 ip-10-0-129-23 kubenswrapper[2578]: E0706 23:55:36.400121    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 23:55:36.400519 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.400140    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4j6ct\" (UniqueName: \"kubernetes.io/projected/b9a2aa01-bfc8-40f8-b4d7-962428e95667-kube-api-access-4j6ct\") pod \"multus-additional-cni-plugins-kmhhp\" (UID: \"b9a2aa01-bfc8-40f8-b4d7-962428e95667\") " pod="openshift-multus/multus-additional-cni-plugins-kmhhp"
Jul 06 23:55:36.400519 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.400165    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/aba6ad45-845e-4916-8cf1-b8c76da93308-run-systemd\") pod \"ovnkube-node-jfngf\" (UID: \"aba6ad45-845e-4916-8cf1-b8c76da93308\") " pod="openshift-ovn-kubernetes/ovnkube-node-jfngf"
Jul 06 23:55:36.400519 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.400191    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xz6xn\" (UniqueName: \"kubernetes.io/projected/aba6ad45-845e-4916-8cf1-b8c76da93308-kube-api-access-xz6xn\") pod \"ovnkube-node-jfngf\" (UID: \"aba6ad45-845e-4916-8cf1-b8c76da93308\") " pod="openshift-ovn-kubernetes/ovnkube-node-jfngf"
Jul 06 23:55:36.401191 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.400216    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4e757f80-3ca9-43c3-9e22-224374be02d8-sys-fs\") pod \"aws-ebs-csi-driver-node-4hfmp\" (UID: \"4e757f80-3ca9-43c3-9e22-224374be02d8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4hfmp"
Jul 06 23:55:36.401191 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.400241    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kgsls\" (UniqueName: \"kubernetes.io/projected/c9a06bd6-5b2c-4d39-8401-06cd95486de7-kube-api-access-kgsls\") pod \"tuned-7f4mc\" (UID: \"c9a06bd6-5b2c-4d39-8401-06cd95486de7\") " pod="openshift-cluster-node-tuning-operator/tuned-7f4mc"
Jul 06 23:55:36.401191 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.400277    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3afd5761-b4ad-4002-b9e7-d646b63d53f0-host-var-lib-kubelet\") pod \"multus-gk9q8\" (UID: \"3afd5761-b4ad-4002-b9e7-d646b63d53f0\") " pod="openshift-multus/multus-gk9q8"
Jul 06 23:55:36.401191 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.400352    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/3afd5761-b4ad-4002-b9e7-d646b63d53f0-multus-daemon-config\") pod \"multus-gk9q8\" (UID: \"3afd5761-b4ad-4002-b9e7-d646b63d53f0\") " pod="openshift-multus/multus-gk9q8"
Jul 06 23:55:36.401191 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.400356    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4e757f80-3ca9-43c3-9e22-224374be02d8-sys-fs\") pod \"aws-ebs-csi-driver-node-4hfmp\" (UID: \"4e757f80-3ca9-43c3-9e22-224374be02d8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4hfmp"
Jul 06 23:55:36.401191 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.400401    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/9a5fa453-505c-4742-86da-db343c8d36af-konnectivity-ca\") pod \"konnectivity-agent-dfsn2\" (UID: \"9a5fa453-505c-4742-86da-db343c8d36af\") " pod="kube-system/konnectivity-agent-dfsn2"
Jul 06 23:55:36.401191 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.400425    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b9a2aa01-bfc8-40f8-b4d7-962428e95667-tuning-conf-dir\") pod \"multus-additional-cni-plugins-kmhhp\" (UID: \"b9a2aa01-bfc8-40f8-b4d7-962428e95667\") " pod="openshift-multus/multus-additional-cni-plugins-kmhhp"
Jul 06 23:55:36.401191 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.400454    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b9a2aa01-bfc8-40f8-b4d7-962428e95667-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-kmhhp\" (UID: \"b9a2aa01-bfc8-40f8-b4d7-962428e95667\") " pod="openshift-multus/multus-additional-cni-plugins-kmhhp"
Jul 06 23:55:36.401191 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.400484    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/aba6ad45-845e-4916-8cf1-b8c76da93308-log-socket\") pod \"ovnkube-node-jfngf\" (UID: \"aba6ad45-845e-4916-8cf1-b8c76da93308\") " pod="openshift-ovn-kubernetes/ovnkube-node-jfngf"
Jul 06 23:55:36.401191 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.399946    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4e757f80-3ca9-43c3-9e22-224374be02d8-registration-dir\") pod \"aws-ebs-csi-driver-node-4hfmp\" (UID: \"4e757f80-3ca9-43c3-9e22-224374be02d8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4hfmp"
Jul 06 23:55:36.401191 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.400517    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8nf2n\" (UniqueName: \"kubernetes.io/projected/ed50a99b-7856-44b3-bb1a-12f8b25546b9-kube-api-access-8nf2n\") pod \"network-metrics-daemon-g45vp\" (UID: \"ed50a99b-7856-44b3-bb1a-12f8b25546b9\") " pod="openshift-multus/network-metrics-daemon-g45vp"
Jul 06 23:55:36.401191 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.400589    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c9a06bd6-5b2c-4d39-8401-06cd95486de7-run\") pod \"tuned-7f4mc\" (UID: \"c9a06bd6-5b2c-4d39-8401-06cd95486de7\") " pod="openshift-cluster-node-tuning-operator/tuned-7f4mc"
Jul 06 23:55:36.401191 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.400626    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c9a06bd6-5b2c-4d39-8401-06cd95486de7-etc-tuned\") pod \"tuned-7f4mc\" (UID: \"c9a06bd6-5b2c-4d39-8401-06cd95486de7\") " pod="openshift-cluster-node-tuning-operator/tuned-7f4mc"
Jul 06 23:55:36.401191 ip-10-0-129-23 kubenswrapper[2578]: E0706 23:55:36.400670    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ed50a99b-7856-44b3-bb1a-12f8b25546b9-metrics-certs podName:ed50a99b-7856-44b3-bb1a-12f8b25546b9 nodeName:}" failed. No retries permitted until 2026-07-06 23:55:36.900651159 +0000 UTC m=+3.011724942 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ed50a99b-7856-44b3-bb1a-12f8b25546b9-metrics-certs") pod "network-metrics-daemon-g45vp" (UID: "ed50a99b-7856-44b3-bb1a-12f8b25546b9") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 23:55:36.401191 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.400688    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3afd5761-b4ad-4002-b9e7-d646b63d53f0-multus-socket-dir-parent\") pod \"multus-gk9q8\" (UID: \"3afd5761-b4ad-4002-b9e7-d646b63d53f0\") " pod="openshift-multus/multus-gk9q8"
Jul 06 23:55:36.401191 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.400706    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3afd5761-b4ad-4002-b9e7-d646b63d53f0-hostroot\") pod \"multus-gk9q8\" (UID: \"3afd5761-b4ad-4002-b9e7-d646b63d53f0\") " pod="openshift-multus/multus-gk9q8"
Jul 06 23:55:36.402036 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.400721    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b9a2aa01-bfc8-40f8-b4d7-962428e95667-cni-binary-copy\") pod \"multus-additional-cni-plugins-kmhhp\" (UID: \"b9a2aa01-bfc8-40f8-b4d7-962428e95667\") " pod="openshift-multus/multus-additional-cni-plugins-kmhhp"
Jul 06 23:55:36.402036 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.400735    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/aba6ad45-845e-4916-8cf1-b8c76da93308-host-cni-netd\") pod \"ovnkube-node-jfngf\" (UID: \"aba6ad45-845e-4916-8cf1-b8c76da93308\") " pod="openshift-ovn-kubernetes/ovnkube-node-jfngf"
Jul 06 23:55:36.402036 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.400750    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c9a06bd6-5b2c-4d39-8401-06cd95486de7-etc-systemd\") pod \"tuned-7f4mc\" (UID: \"c9a06bd6-5b2c-4d39-8401-06cd95486de7\") " pod="openshift-cluster-node-tuning-operator/tuned-7f4mc"
Jul 06 23:55:36.402036 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.400763    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3afd5761-b4ad-4002-b9e7-d646b63d53f0-cni-binary-copy\") pod \"multus-gk9q8\" (UID: \"3afd5761-b4ad-4002-b9e7-d646b63d53f0\") " pod="openshift-multus/multus-gk9q8"
Jul 06 23:55:36.402036 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.400883    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mrnmq\" (UniqueName: \"kubernetes.io/projected/f1501e51-2268-4e04-800c-72e6af073f5e-kube-api-access-mrnmq\") pod \"iptables-alerter-sg4kc\" (UID: \"f1501e51-2268-4e04-800c-72e6af073f5e\") " pod="openshift-network-operator/iptables-alerter-sg4kc"
Jul 06 23:55:36.402036 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.400911    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/aba6ad45-845e-4916-8cf1-b8c76da93308-run-ovn\") pod \"ovnkube-node-jfngf\" (UID: \"aba6ad45-845e-4916-8cf1-b8c76da93308\") " pod="openshift-ovn-kubernetes/ovnkube-node-jfngf"
Jul 06 23:55:36.402036 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.400932    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/66f64c88-7770-4613-81c2-97f105d345e5-tmp-dir\") pod \"node-resolver-2h2rk\" (UID: \"66f64c88-7770-4613-81c2-97f105d345e5\") " pod="openshift-dns/node-resolver-2h2rk"
Jul 06 23:55:36.402036 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.400949    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4e757f80-3ca9-43c3-9e22-224374be02d8-kubelet-dir\") pod \"aws-ebs-csi-driver-node-4hfmp\" (UID: \"4e757f80-3ca9-43c3-9e22-224374be02d8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4hfmp"
Jul 06 23:55:36.402036 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.400973    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4e757f80-3ca9-43c3-9e22-224374be02d8-socket-dir\") pod \"aws-ebs-csi-driver-node-4hfmp\" (UID: \"4e757f80-3ca9-43c3-9e22-224374be02d8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4hfmp"
Jul 06 23:55:36.402036 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.401007    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c9a06bd6-5b2c-4d39-8401-06cd95486de7-etc-modprobe-d\") pod \"tuned-7f4mc\" (UID: \"c9a06bd6-5b2c-4d39-8401-06cd95486de7\") " pod="openshift-cluster-node-tuning-operator/tuned-7f4mc"
Jul 06 23:55:36.402036 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.401032    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-657q2\" (UniqueName: \"kubernetes.io/projected/3afd5761-b4ad-4002-b9e7-d646b63d53f0-kube-api-access-657q2\") pod \"multus-gk9q8\" (UID: \"3afd5761-b4ad-4002-b9e7-d646b63d53f0\") " pod="openshift-multus/multus-gk9q8"
Jul 06 23:55:36.402036 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.401088    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/aba6ad45-845e-4916-8cf1-b8c76da93308-var-lib-openvswitch\") pod \"ovnkube-node-jfngf\" (UID: \"aba6ad45-845e-4916-8cf1-b8c76da93308\") " pod="openshift-ovn-kubernetes/ovnkube-node-jfngf"
Jul 06 23:55:36.402036 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.401112    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4e757f80-3ca9-43c3-9e22-224374be02d8-socket-dir\") pod \"aws-ebs-csi-driver-node-4hfmp\" (UID: \"4e757f80-3ca9-43c3-9e22-224374be02d8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4hfmp"
Jul 06 23:55:36.402036 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.401266    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4e757f80-3ca9-43c3-9e22-224374be02d8-kubelet-dir\") pod \"aws-ebs-csi-driver-node-4hfmp\" (UID: \"4e757f80-3ca9-43c3-9e22-224374be02d8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4hfmp"
Jul 06 23:55:36.402036 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.401480    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/66f64c88-7770-4613-81c2-97f105d345e5-tmp-dir\") pod \"node-resolver-2h2rk\" (UID: \"66f64c88-7770-4613-81c2-97f105d345e5\") " pod="openshift-dns/node-resolver-2h2rk"
Jul 06 23:55:36.405251 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.405229    2578 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 06 23:55:36.408919 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.408901    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gqz2n\" (UniqueName: \"kubernetes.io/projected/4e757f80-3ca9-43c3-9e22-224374be02d8-kube-api-access-gqz2n\") pod \"aws-ebs-csi-driver-node-4hfmp\" (UID: \"4e757f80-3ca9-43c3-9e22-224374be02d8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4hfmp"
Jul 06 23:55:36.409023 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.409005    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zxw5c\" (UniqueName: \"kubernetes.io/projected/66f64c88-7770-4613-81c2-97f105d345e5-kube-api-access-zxw5c\") pod \"node-resolver-2h2rk\" (UID: \"66f64c88-7770-4613-81c2-97f105d345e5\") " pod="openshift-dns/node-resolver-2h2rk"
Jul 06 23:55:36.411642 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.411618    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8nf2n\" (UniqueName: \"kubernetes.io/projected/ed50a99b-7856-44b3-bb1a-12f8b25546b9-kube-api-access-8nf2n\") pod \"network-metrics-daemon-g45vp\" (UID: \"ed50a99b-7856-44b3-bb1a-12f8b25546b9\") " pod="openshift-multus/network-metrics-daemon-g45vp"
Jul 06 23:55:36.502008 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.501979    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c9a06bd6-5b2c-4d39-8401-06cd95486de7-sys\") pod \"tuned-7f4mc\" (UID: \"c9a06bd6-5b2c-4d39-8401-06cd95486de7\") " pod="openshift-cluster-node-tuning-operator/tuned-7f4mc"
Jul 06 23:55:36.502188 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.502019    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c9a06bd6-5b2c-4d39-8401-06cd95486de7-tmp\") pod \"tuned-7f4mc\" (UID: \"c9a06bd6-5b2c-4d39-8401-06cd95486de7\") " pod="openshift-cluster-node-tuning-operator/tuned-7f4mc"
Jul 06 23:55:36.502188 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.502047    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f1501e51-2268-4e04-800c-72e6af073f5e-host-slash\") pod \"iptables-alerter-sg4kc\" (UID: \"f1501e51-2268-4e04-800c-72e6af073f5e\") " pod="openshift-network-operator/iptables-alerter-sg4kc"
Jul 06 23:55:36.502188 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.502071    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wm5xx\" (UniqueName: \"kubernetes.io/projected/7db1fb04-9b13-425c-abb1-05f4274fe959-kube-api-access-wm5xx\") pod \"network-check-target-sqcsc\" (UID: \"7db1fb04-9b13-425c-abb1-05f4274fe959\") " pod="openshift-network-diagnostics/network-check-target-sqcsc"
Jul 06 23:55:36.502188 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.502070    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c9a06bd6-5b2c-4d39-8401-06cd95486de7-sys\") pod \"tuned-7f4mc\" (UID: \"c9a06bd6-5b2c-4d39-8401-06cd95486de7\") " pod="openshift-cluster-node-tuning-operator/tuned-7f4mc"
Jul 06 23:55:36.502188 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.502093    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c9a06bd6-5b2c-4d39-8401-06cd95486de7-etc-sysconfig\") pod \"tuned-7f4mc\" (UID: \"c9a06bd6-5b2c-4d39-8401-06cd95486de7\") " pod="openshift-cluster-node-tuning-operator/tuned-7f4mc"
Jul 06 23:55:36.502188 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.502115    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c9a06bd6-5b2c-4d39-8401-06cd95486de7-etc-sysctl-conf\") pod \"tuned-7f4mc\" (UID: \"c9a06bd6-5b2c-4d39-8401-06cd95486de7\") " pod="openshift-cluster-node-tuning-operator/tuned-7f4mc"
Jul 06 23:55:36.502188 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.502137    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3afd5761-b4ad-4002-b9e7-d646b63d53f0-cnibin\") pod \"multus-gk9q8\" (UID: \"3afd5761-b4ad-4002-b9e7-d646b63d53f0\") " pod="openshift-multus/multus-gk9q8"
Jul 06 23:55:36.502188 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.502158    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b9a2aa01-bfc8-40f8-b4d7-962428e95667-os-release\") pod \"multus-additional-cni-plugins-kmhhp\" (UID: \"b9a2aa01-bfc8-40f8-b4d7-962428e95667\") " pod="openshift-multus/multus-additional-cni-plugins-kmhhp"
Jul 06 23:55:36.502188 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.502165    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f1501e51-2268-4e04-800c-72e6af073f5e-host-slash\") pod \"iptables-alerter-sg4kc\" (UID: \"f1501e51-2268-4e04-800c-72e6af073f5e\") " pod="openshift-network-operator/iptables-alerter-sg4kc"
Jul 06 23:55:36.502188 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.502180    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/aba6ad45-845e-4916-8cf1-b8c76da93308-host-run-netns\") pod \"ovnkube-node-jfngf\" (UID: \"aba6ad45-845e-4916-8cf1-b8c76da93308\") " pod="openshift-ovn-kubernetes/ovnkube-node-jfngf"
Jul 06 23:55:36.502188 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.502204    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/aba6ad45-845e-4916-8cf1-b8c76da93308-host-cni-bin\") pod \"ovnkube-node-jfngf\" (UID: \"aba6ad45-845e-4916-8cf1-b8c76da93308\") " pod="openshift-ovn-kubernetes/ovnkube-node-jfngf"
Jul 06 23:55:36.502958 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.502241    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c9a06bd6-5b2c-4d39-8401-06cd95486de7-etc-sysctl-d\") pod \"tuned-7f4mc\" (UID: \"c9a06bd6-5b2c-4d39-8401-06cd95486de7\") " pod="openshift-cluster-node-tuning-operator/tuned-7f4mc"
Jul 06 23:55:36.502958 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.502260    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/aba6ad45-845e-4916-8cf1-b8c76da93308-host-cni-bin\") pod \"ovnkube-node-jfngf\" (UID: \"aba6ad45-845e-4916-8cf1-b8c76da93308\") " pod="openshift-ovn-kubernetes/ovnkube-node-jfngf"
Jul 06 23:55:36.502958 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.502287    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c9a06bd6-5b2c-4d39-8401-06cd95486de7-etc-sysconfig\") pod \"tuned-7f4mc\" (UID: \"c9a06bd6-5b2c-4d39-8401-06cd95486de7\") " pod="openshift-cluster-node-tuning-operator/tuned-7f4mc"
Jul 06 23:55:36.502958 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.502361    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/aba6ad45-845e-4916-8cf1-b8c76da93308-host-run-netns\") pod \"ovnkube-node-jfngf\" (UID: \"aba6ad45-845e-4916-8cf1-b8c76da93308\") " pod="openshift-ovn-kubernetes/ovnkube-node-jfngf"
Jul 06 23:55:36.502958 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.502414    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3afd5761-b4ad-4002-b9e7-d646b63d53f0-cnibin\") pod \"multus-gk9q8\" (UID: \"3afd5761-b4ad-4002-b9e7-d646b63d53f0\") " pod="openshift-multus/multus-gk9q8"
Jul 06 23:55:36.502958 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.502448    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c9a06bd6-5b2c-4d39-8401-06cd95486de7-etc-sysctl-d\") pod \"tuned-7f4mc\" (UID: \"c9a06bd6-5b2c-4d39-8401-06cd95486de7\") " pod="openshift-cluster-node-tuning-operator/tuned-7f4mc"
Jul 06 23:55:36.502958 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.502460    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b9a2aa01-bfc8-40f8-b4d7-962428e95667-os-release\") pod \"multus-additional-cni-plugins-kmhhp\" (UID: \"b9a2aa01-bfc8-40f8-b4d7-962428e95667\") " pod="openshift-multus/multus-additional-cni-plugins-kmhhp"
Jul 06 23:55:36.502958 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.502271    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3afd5761-b4ad-4002-b9e7-d646b63d53f0-system-cni-dir\") pod \"multus-gk9q8\" (UID: \"3afd5761-b4ad-4002-b9e7-d646b63d53f0\") " pod="openshift-multus/multus-gk9q8"
Jul 06 23:55:36.502958 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.502683    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3afd5761-b4ad-4002-b9e7-d646b63d53f0-host-run-netns\") pod \"multus-gk9q8\" (UID: \"3afd5761-b4ad-4002-b9e7-d646b63d53f0\") " pod="openshift-multus/multus-gk9q8"
Jul 06 23:55:36.502958 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.502715    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f1501e51-2268-4e04-800c-72e6af073f5e-iptables-alerter-script\") pod \"iptables-alerter-sg4kc\" (UID: \"f1501e51-2268-4e04-800c-72e6af073f5e\") " pod="openshift-network-operator/iptables-alerter-sg4kc"
Jul 06 23:55:36.502958 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.502926    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/aba6ad45-845e-4916-8cf1-b8c76da93308-run-openvswitch\") pod \"ovnkube-node-jfngf\" (UID: \"aba6ad45-845e-4916-8cf1-b8c76da93308\") " pod="openshift-ovn-kubernetes/ovnkube-node-jfngf"
Jul 06 23:55:36.502958 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.502945    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/aba6ad45-845e-4916-8cf1-b8c76da93308-node-log\") pod \"ovnkube-node-jfngf\" (UID: \"aba6ad45-845e-4916-8cf1-b8c76da93308\") " pod="openshift-ovn-kubernetes/ovnkube-node-jfngf"
Jul 06 23:55:36.503593 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.502968    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/aba6ad45-845e-4916-8cf1-b8c76da93308-ovnkube-script-lib\") pod \"ovnkube-node-jfngf\" (UID: \"aba6ad45-845e-4916-8cf1-b8c76da93308\") " pod="openshift-ovn-kubernetes/ovnkube-node-jfngf"
Jul 06 23:55:36.503593 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.502794    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3afd5761-b4ad-4002-b9e7-d646b63d53f0-system-cni-dir\") pod \"multus-gk9q8\" (UID: \"3afd5761-b4ad-4002-b9e7-d646b63d53f0\") " pod="openshift-multus/multus-gk9q8"
Jul 06 23:55:36.503593 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.502805    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3afd5761-b4ad-4002-b9e7-d646b63d53f0-host-run-netns\") pod \"multus-gk9q8\" (UID: \"3afd5761-b4ad-4002-b9e7-d646b63d53f0\") " pod="openshift-multus/multus-gk9q8"
Jul 06 23:55:36.503593 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.503011    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/df4215f7-4f0d-4ba1-b66d-b8902a323531-host\") pod \"node-ca-qndzw\" (UID: \"df4215f7-4f0d-4ba1-b66d-b8902a323531\") " pod="openshift-image-registry/node-ca-qndzw"
Jul 06 23:55:36.503593 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.503032    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/aba6ad45-845e-4916-8cf1-b8c76da93308-node-log\") pod \"ovnkube-node-jfngf\" (UID: \"aba6ad45-845e-4916-8cf1-b8c76da93308\") " pod="openshift-ovn-kubernetes/ovnkube-node-jfngf"
Jul 06 23:55:36.503593 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.502735    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c9a06bd6-5b2c-4d39-8401-06cd95486de7-etc-sysctl-conf\") pod \"tuned-7f4mc\" (UID: \"c9a06bd6-5b2c-4d39-8401-06cd95486de7\") " pod="openshift-cluster-node-tuning-operator/tuned-7f4mc"
Jul 06 23:55:36.503593 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.503040    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/aba6ad45-845e-4916-8cf1-b8c76da93308-run-openvswitch\") pod \"ovnkube-node-jfngf\" (UID: \"aba6ad45-845e-4916-8cf1-b8c76da93308\") " pod="openshift-ovn-kubernetes/ovnkube-node-jfngf"
Jul 06 23:55:36.503593 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.503040    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3afd5761-b4ad-4002-b9e7-d646b63d53f0-host-var-lib-cni-multus\") pod \"multus-gk9q8\" (UID: \"3afd5761-b4ad-4002-b9e7-d646b63d53f0\") " pod="openshift-multus/multus-gk9q8"
Jul 06 23:55:36.503593 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.503072    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3afd5761-b4ad-4002-b9e7-d646b63d53f0-host-var-lib-cni-multus\") pod \"multus-gk9q8\" (UID: \"3afd5761-b4ad-4002-b9e7-d646b63d53f0\") " pod="openshift-multus/multus-gk9q8"
Jul 06 23:55:36.503593 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.503119    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b9a2aa01-bfc8-40f8-b4d7-962428e95667-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-kmhhp\" (UID: \"b9a2aa01-bfc8-40f8-b4d7-962428e95667\") " pod="openshift-multus/multus-additional-cni-plugins-kmhhp"
Jul 06 23:55:36.503593 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.503145    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f6ae72be-9753-46d1-a665-c2124741a26a-dbus\") pod \"global-pull-secret-syncer-cm65t\" (UID: \"f6ae72be-9753-46d1-a665-c2124741a26a\") " pod="kube-system/global-pull-secret-syncer-cm65t"
Jul 06 23:55:36.503593 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.503175    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/aba6ad45-845e-4916-8cf1-b8c76da93308-etc-openvswitch\") pod \"ovnkube-node-jfngf\" (UID: \"aba6ad45-845e-4916-8cf1-b8c76da93308\") " pod="openshift-ovn-kubernetes/ovnkube-node-jfngf"
Jul 06 23:55:36.503593 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.503212    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c9a06bd6-5b2c-4d39-8401-06cd95486de7-etc-kubernetes\") pod \"tuned-7f4mc\" (UID: \"c9a06bd6-5b2c-4d39-8401-06cd95486de7\") " pod="openshift-cluster-node-tuning-operator/tuned-7f4mc"
Jul 06 23:55:36.503593 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.503255    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/aba6ad45-845e-4916-8cf1-b8c76da93308-etc-openvswitch\") pod \"ovnkube-node-jfngf\" (UID: \"aba6ad45-845e-4916-8cf1-b8c76da93308\") " pod="openshift-ovn-kubernetes/ovnkube-node-jfngf"
Jul 06 23:55:36.503593 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.503283    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c9a06bd6-5b2c-4d39-8401-06cd95486de7-var-lib-kubelet\") pod \"tuned-7f4mc\" (UID: \"c9a06bd6-5b2c-4d39-8401-06cd95486de7\") " pod="openshift-cluster-node-tuning-operator/tuned-7f4mc"
Jul 06 23:55:36.503593 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.503320    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f1501e51-2268-4e04-800c-72e6af073f5e-iptables-alerter-script\") pod \"iptables-alerter-sg4kc\" (UID: \"f1501e51-2268-4e04-800c-72e6af073f5e\") " pod="openshift-network-operator/iptables-alerter-sg4kc"
Jul 06 23:55:36.503593 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.503324    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3afd5761-b4ad-4002-b9e7-d646b63d53f0-host-run-multus-certs\") pod \"multus-gk9q8\" (UID: \"3afd5761-b4ad-4002-b9e7-d646b63d53f0\") " pod="openshift-multus/multus-gk9q8"
Jul 06 23:55:36.503593 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.503376    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3afd5761-b4ad-4002-b9e7-d646b63d53f0-host-run-multus-certs\") pod \"multus-gk9q8\" (UID: \"3afd5761-b4ad-4002-b9e7-d646b63d53f0\") " pod="openshift-multus/multus-gk9q8"
Jul 06 23:55:36.504347 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.503390    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c9a06bd6-5b2c-4d39-8401-06cd95486de7-etc-kubernetes\") pod \"tuned-7f4mc\" (UID: \"c9a06bd6-5b2c-4d39-8401-06cd95486de7\") " pod="openshift-cluster-node-tuning-operator/tuned-7f4mc"
Jul 06 23:55:36.504347 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.503416    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4j6ct\" (UniqueName: \"kubernetes.io/projected/b9a2aa01-bfc8-40f8-b4d7-962428e95667-kube-api-access-4j6ct\") pod \"multus-additional-cni-plugins-kmhhp\" (UID: \"b9a2aa01-bfc8-40f8-b4d7-962428e95667\") " pod="openshift-multus/multus-additional-cni-plugins-kmhhp"
Jul 06 23:55:36.504347 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.503443    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/df4215f7-4f0d-4ba1-b66d-b8902a323531-host\") pod \"node-ca-qndzw\" (UID: \"df4215f7-4f0d-4ba1-b66d-b8902a323531\") " pod="openshift-image-registry/node-ca-qndzw"
Jul 06 23:55:36.504347 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.503444    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/aba6ad45-845e-4916-8cf1-b8c76da93308-run-systemd\") pod \"ovnkube-node-jfngf\" (UID: \"aba6ad45-845e-4916-8cf1-b8c76da93308\") " pod="openshift-ovn-kubernetes/ovnkube-node-jfngf"
Jul 06 23:55:36.504347 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.503475    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/aba6ad45-845e-4916-8cf1-b8c76da93308-run-systemd\") pod \"ovnkube-node-jfngf\" (UID: \"aba6ad45-845e-4916-8cf1-b8c76da93308\") " pod="openshift-ovn-kubernetes/ovnkube-node-jfngf"
Jul 06 23:55:36.504347 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.503498    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xz6xn\" (UniqueName: \"kubernetes.io/projected/aba6ad45-845e-4916-8cf1-b8c76da93308-kube-api-access-xz6xn\") pod \"ovnkube-node-jfngf\" (UID: \"aba6ad45-845e-4916-8cf1-b8c76da93308\") " pod="openshift-ovn-kubernetes/ovnkube-node-jfngf"
Jul 06 23:55:36.504347 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.503515    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c9a06bd6-5b2c-4d39-8401-06cd95486de7-var-lib-kubelet\") pod \"tuned-7f4mc\" (UID: \"c9a06bd6-5b2c-4d39-8401-06cd95486de7\") " pod="openshift-cluster-node-tuning-operator/tuned-7f4mc"
Jul 06 23:55:36.504347 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.503632    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f6ae72be-9753-46d1-a665-c2124741a26a-dbus\") pod \"global-pull-secret-syncer-cm65t\" (UID: \"f6ae72be-9753-46d1-a665-c2124741a26a\") " pod="kube-system/global-pull-secret-syncer-cm65t"
Jul 06 23:55:36.504347 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.503644    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/aba6ad45-845e-4916-8cf1-b8c76da93308-ovnkube-script-lib\") pod \"ovnkube-node-jfngf\" (UID: \"aba6ad45-845e-4916-8cf1-b8c76da93308\") " pod="openshift-ovn-kubernetes/ovnkube-node-jfngf"
Jul 06 23:55:36.504347 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.503687    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kgsls\" (UniqueName: \"kubernetes.io/projected/c9a06bd6-5b2c-4d39-8401-06cd95486de7-kube-api-access-kgsls\") pod \"tuned-7f4mc\" (UID: \"c9a06bd6-5b2c-4d39-8401-06cd95486de7\") " pod="openshift-cluster-node-tuning-operator/tuned-7f4mc"
Jul 06 23:55:36.504347 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.503708    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b9a2aa01-bfc8-40f8-b4d7-962428e95667-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-kmhhp\" (UID: \"b9a2aa01-bfc8-40f8-b4d7-962428e95667\") " pod="openshift-multus/multus-additional-cni-plugins-kmhhp"
Jul 06 23:55:36.504347 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.503722    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3afd5761-b4ad-4002-b9e7-d646b63d53f0-host-var-lib-kubelet\") pod \"multus-gk9q8\" (UID: \"3afd5761-b4ad-4002-b9e7-d646b63d53f0\") " pod="openshift-multus/multus-gk9q8"
Jul 06 23:55:36.504347 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.503823    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3afd5761-b4ad-4002-b9e7-d646b63d53f0-host-var-lib-kubelet\") pod \"multus-gk9q8\" (UID: \"3afd5761-b4ad-4002-b9e7-d646b63d53f0\") " pod="openshift-multus/multus-gk9q8"
Jul 06 23:55:36.504347 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.503855    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/3afd5761-b4ad-4002-b9e7-d646b63d53f0-multus-daemon-config\") pod \"multus-gk9q8\" (UID: \"3afd5761-b4ad-4002-b9e7-d646b63d53f0\") " pod="openshift-multus/multus-gk9q8"
Jul 06 23:55:36.504347 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.503885    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/9a5fa453-505c-4742-86da-db343c8d36af-konnectivity-ca\") pod \"konnectivity-agent-dfsn2\" (UID: \"9a5fa453-505c-4742-86da-db343c8d36af\") " pod="kube-system/konnectivity-agent-dfsn2"
Jul 06 23:55:36.504347 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.503902    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b9a2aa01-bfc8-40f8-b4d7-962428e95667-tuning-conf-dir\") pod \"multus-additional-cni-plugins-kmhhp\" (UID: \"b9a2aa01-bfc8-40f8-b4d7-962428e95667\") " pod="openshift-multus/multus-additional-cni-plugins-kmhhp"
Jul 06 23:55:36.504347 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.503922    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b9a2aa01-bfc8-40f8-b4d7-962428e95667-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-kmhhp\" (UID: \"b9a2aa01-bfc8-40f8-b4d7-962428e95667\") " pod="openshift-multus/multus-additional-cni-plugins-kmhhp"
Jul 06 23:55:36.506016 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.503952    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/aba6ad45-845e-4916-8cf1-b8c76da93308-log-socket\") pod \"ovnkube-node-jfngf\" (UID: \"aba6ad45-845e-4916-8cf1-b8c76da93308\") " pod="openshift-ovn-kubernetes/ovnkube-node-jfngf"
Jul 06 23:55:36.506016 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.503980    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c9a06bd6-5b2c-4d39-8401-06cd95486de7-run\") pod \"tuned-7f4mc\" (UID: \"c9a06bd6-5b2c-4d39-8401-06cd95486de7\") " pod="openshift-cluster-node-tuning-operator/tuned-7f4mc"
Jul 06 23:55:36.506016 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.504004    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c9a06bd6-5b2c-4d39-8401-06cd95486de7-etc-tuned\") pod \"tuned-7f4mc\" (UID: \"c9a06bd6-5b2c-4d39-8401-06cd95486de7\") " pod="openshift-cluster-node-tuning-operator/tuned-7f4mc"
Jul 06 23:55:36.506016 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.504026    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/aba6ad45-845e-4916-8cf1-b8c76da93308-log-socket\") pod \"ovnkube-node-jfngf\" (UID: \"aba6ad45-845e-4916-8cf1-b8c76da93308\") " pod="openshift-ovn-kubernetes/ovnkube-node-jfngf"
Jul 06 23:55:36.506016 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.504027    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3afd5761-b4ad-4002-b9e7-d646b63d53f0-multus-socket-dir-parent\") pod \"multus-gk9q8\" (UID: \"3afd5761-b4ad-4002-b9e7-d646b63d53f0\") " pod="openshift-multus/multus-gk9q8"
Jul 06 23:55:36.506016 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.504078    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3afd5761-b4ad-4002-b9e7-d646b63d53f0-multus-socket-dir-parent\") pod \"multus-gk9q8\" (UID: \"3afd5761-b4ad-4002-b9e7-d646b63d53f0\") " pod="openshift-multus/multus-gk9q8"
Jul 06 23:55:36.506016 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.504080    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3afd5761-b4ad-4002-b9e7-d646b63d53f0-hostroot\") pod \"multus-gk9q8\" (UID: \"3afd5761-b4ad-4002-b9e7-d646b63d53f0\") " pod="openshift-multus/multus-gk9q8"
Jul 06 23:55:36.506016 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.504105    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3afd5761-b4ad-4002-b9e7-d646b63d53f0-hostroot\") pod \"multus-gk9q8\" (UID: \"3afd5761-b4ad-4002-b9e7-d646b63d53f0\") " pod="openshift-multus/multus-gk9q8"
Jul 06 23:55:36.506016 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.504145    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b9a2aa01-bfc8-40f8-b4d7-962428e95667-cni-binary-copy\") pod \"multus-additional-cni-plugins-kmhhp\" (UID: \"b9a2aa01-bfc8-40f8-b4d7-962428e95667\") " pod="openshift-multus/multus-additional-cni-plugins-kmhhp"
Jul 06 23:55:36.506016 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.504170    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/aba6ad45-845e-4916-8cf1-b8c76da93308-host-cni-netd\") pod \"ovnkube-node-jfngf\" (UID: \"aba6ad45-845e-4916-8cf1-b8c76da93308\") " pod="openshift-ovn-kubernetes/ovnkube-node-jfngf"
Jul 06 23:55:36.506016 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.504192    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c9a06bd6-5b2c-4d39-8401-06cd95486de7-etc-systemd\") pod \"tuned-7f4mc\" (UID: \"c9a06bd6-5b2c-4d39-8401-06cd95486de7\") " pod="openshift-cluster-node-tuning-operator/tuned-7f4mc"
Jul 06 23:55:36.506016 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.504226    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3afd5761-b4ad-4002-b9e7-d646b63d53f0-cni-binary-copy\") pod \"multus-gk9q8\" (UID: \"3afd5761-b4ad-4002-b9e7-d646b63d53f0\") " pod="openshift-multus/multus-gk9q8"
Jul 06 23:55:36.506016 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.504242    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mrnmq\" (UniqueName: \"kubernetes.io/projected/f1501e51-2268-4e04-800c-72e6af073f5e-kube-api-access-mrnmq\") pod \"iptables-alerter-sg4kc\" (UID: \"f1501e51-2268-4e04-800c-72e6af073f5e\") " pod="openshift-network-operator/iptables-alerter-sg4kc"
Jul 06 23:55:36.506016 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.504258    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/aba6ad45-845e-4916-8cf1-b8c76da93308-run-ovn\") pod \"ovnkube-node-jfngf\" (UID: \"aba6ad45-845e-4916-8cf1-b8c76da93308\") " pod="openshift-ovn-kubernetes/ovnkube-node-jfngf"
Jul 06 23:55:36.506016 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.504277    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c9a06bd6-5b2c-4d39-8401-06cd95486de7-etc-modprobe-d\") pod \"tuned-7f4mc\" (UID: \"c9a06bd6-5b2c-4d39-8401-06cd95486de7\") " pod="openshift-cluster-node-tuning-operator/tuned-7f4mc"
Jul 06 23:55:36.506016 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.504292    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-657q2\" (UniqueName: \"kubernetes.io/projected/3afd5761-b4ad-4002-b9e7-d646b63d53f0-kube-api-access-657q2\") pod \"multus-gk9q8\" (UID: \"3afd5761-b4ad-4002-b9e7-d646b63d53f0\") " pod="openshift-multus/multus-gk9q8"
Jul 06 23:55:36.506016 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.504307    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/aba6ad45-845e-4916-8cf1-b8c76da93308-var-lib-openvswitch\") pod \"ovnkube-node-jfngf\" (UID: \"aba6ad45-845e-4916-8cf1-b8c76da93308\") " pod="openshift-ovn-kubernetes/ovnkube-node-jfngf"
Jul 06 23:55:36.506016 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.504328    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b9a2aa01-bfc8-40f8-b4d7-962428e95667-tuning-conf-dir\") pod \"multus-additional-cni-plugins-kmhhp\" (UID: \"b9a2aa01-bfc8-40f8-b4d7-962428e95667\") " pod="openshift-multus/multus-additional-cni-plugins-kmhhp"
Jul 06 23:55:36.506676 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.504345    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/df4215f7-4f0d-4ba1-b66d-b8902a323531-serviceca\") pod \"node-ca-qndzw\" (UID: \"df4215f7-4f0d-4ba1-b66d-b8902a323531\") " pod="openshift-image-registry/node-ca-qndzw"
Jul 06 23:55:36.506676 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.504365    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w2f2w\" (UniqueName: \"kubernetes.io/projected/df4215f7-4f0d-4ba1-b66d-b8902a323531-kube-api-access-w2f2w\") pod \"node-ca-qndzw\" (UID: \"df4215f7-4f0d-4ba1-b66d-b8902a323531\") " pod="openshift-image-registry/node-ca-qndzw"
Jul 06 23:55:36.506676 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.504380    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/aba6ad45-845e-4916-8cf1-b8c76da93308-host-slash\") pod \"ovnkube-node-jfngf\" (UID: \"aba6ad45-845e-4916-8cf1-b8c76da93308\") " pod="openshift-ovn-kubernetes/ovnkube-node-jfngf"
Jul 06 23:55:36.506676 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.504394    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c9a06bd6-5b2c-4d39-8401-06cd95486de7-host\") pod \"tuned-7f4mc\" (UID: \"c9a06bd6-5b2c-4d39-8401-06cd95486de7\") " pod="openshift-cluster-node-tuning-operator/tuned-7f4mc"
Jul 06 23:55:36.506676 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.504429    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b9a2aa01-bfc8-40f8-b4d7-962428e95667-system-cni-dir\") pod \"multus-additional-cni-plugins-kmhhp\" (UID: \"b9a2aa01-bfc8-40f8-b4d7-962428e95667\") " pod="openshift-multus/multus-additional-cni-plugins-kmhhp"
Jul 06 23:55:36.506676 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.504461    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/aba6ad45-845e-4916-8cf1-b8c76da93308-systemd-units\") pod \"ovnkube-node-jfngf\" (UID: \"aba6ad45-845e-4916-8cf1-b8c76da93308\") " pod="openshift-ovn-kubernetes/ovnkube-node-jfngf"
Jul 06 23:55:36.506676 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.504467    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/9a5fa453-505c-4742-86da-db343c8d36af-konnectivity-ca\") pod \"konnectivity-agent-dfsn2\" (UID: \"9a5fa453-505c-4742-86da-db343c8d36af\") " pod="kube-system/konnectivity-agent-dfsn2"
Jul 06 23:55:36.506676 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.504485    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3afd5761-b4ad-4002-b9e7-d646b63d53f0-os-release\") pod \"multus-gk9q8\" (UID: \"3afd5761-b4ad-4002-b9e7-d646b63d53f0\") " pod="openshift-multus/multus-gk9q8"
Jul 06 23:55:36.506676 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.504491    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/3afd5761-b4ad-4002-b9e7-d646b63d53f0-multus-daemon-config\") pod \"multus-gk9q8\" (UID: \"3afd5761-b4ad-4002-b9e7-d646b63d53f0\") " pod="openshift-multus/multus-gk9q8"
Jul 06 23:55:36.506676 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.504466    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c9a06bd6-5b2c-4d39-8401-06cd95486de7-run\") pod \"tuned-7f4mc\" (UID: \"c9a06bd6-5b2c-4d39-8401-06cd95486de7\") " pod="openshift-cluster-node-tuning-operator/tuned-7f4mc"
Jul 06 23:55:36.506676 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.504530    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/aba6ad45-845e-4916-8cf1-b8c76da93308-host-cni-netd\") pod \"ovnkube-node-jfngf\" (UID: \"aba6ad45-845e-4916-8cf1-b8c76da93308\") " pod="openshift-ovn-kubernetes/ovnkube-node-jfngf"
Jul 06 23:55:36.506676 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.504561    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3afd5761-b4ad-4002-b9e7-d646b63d53f0-host-var-lib-cni-bin\") pod \"multus-gk9q8\" (UID: \"3afd5761-b4ad-4002-b9e7-d646b63d53f0\") " pod="openshift-multus/multus-gk9q8"
Jul 06 23:55:36.506676 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.504590    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b9a2aa01-bfc8-40f8-b4d7-962428e95667-cnibin\") pod \"multus-additional-cni-plugins-kmhhp\" (UID: \"b9a2aa01-bfc8-40f8-b4d7-962428e95667\") " pod="openshift-multus/multus-additional-cni-plugins-kmhhp"
Jul 06 23:55:36.506676 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.504617    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f6ae72be-9753-46d1-a665-c2124741a26a-kubelet-config\") pod \"global-pull-secret-syncer-cm65t\" (UID: \"f6ae72be-9753-46d1-a665-c2124741a26a\") " pod="kube-system/global-pull-secret-syncer-cm65t"
Jul 06 23:55:36.506676 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.504651    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/aba6ad45-845e-4916-8cf1-b8c76da93308-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-jfngf\" (UID: \"aba6ad45-845e-4916-8cf1-b8c76da93308\") " pod="openshift-ovn-kubernetes/ovnkube-node-jfngf"
Jul 06 23:55:36.506676 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.504680    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/aba6ad45-845e-4916-8cf1-b8c76da93308-ovnkube-config\") pod \"ovnkube-node-jfngf\" (UID: \"aba6ad45-845e-4916-8cf1-b8c76da93308\") " pod="openshift-ovn-kubernetes/ovnkube-node-jfngf"
Jul 06 23:55:36.506676 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.504701    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c9a06bd6-5b2c-4d39-8401-06cd95486de7-lib-modules\") pod \"tuned-7f4mc\" (UID: \"c9a06bd6-5b2c-4d39-8401-06cd95486de7\") " pod="openshift-cluster-node-tuning-operator/tuned-7f4mc"
Jul 06 23:55:36.506676 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.504727    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3afd5761-b4ad-4002-b9e7-d646b63d53f0-multus-cni-dir\") pod \"multus-gk9q8\" (UID: \"3afd5761-b4ad-4002-b9e7-d646b63d53f0\") " pod="openshift-multus/multus-gk9q8"
Jul 06 23:55:36.507191 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.504754    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/aba6ad45-845e-4916-8cf1-b8c76da93308-host-kubelet\") pod \"ovnkube-node-jfngf\" (UID: \"aba6ad45-845e-4916-8cf1-b8c76da93308\") " pod="openshift-ovn-kubernetes/ovnkube-node-jfngf"
Jul 06 23:55:36.507191 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.504779    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3afd5761-b4ad-4002-b9e7-d646b63d53f0-multus-conf-dir\") pod \"multus-gk9q8\" (UID: \"3afd5761-b4ad-4002-b9e7-d646b63d53f0\") " pod="openshift-multus/multus-gk9q8"
Jul 06 23:55:36.507191 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.504809    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/9a5fa453-505c-4742-86da-db343c8d36af-agent-certs\") pod \"konnectivity-agent-dfsn2\" (UID: \"9a5fa453-505c-4742-86da-db343c8d36af\") " pod="kube-system/konnectivity-agent-dfsn2"
Jul 06 23:55:36.507191 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.504863    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3afd5761-b4ad-4002-b9e7-d646b63d53f0-cni-binary-copy\") pod \"multus-gk9q8\" (UID: \"3afd5761-b4ad-4002-b9e7-d646b63d53f0\") " pod="openshift-multus/multus-gk9q8"
Jul 06 23:55:36.507191 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.504885    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/aba6ad45-845e-4916-8cf1-b8c76da93308-run-ovn\") pod \"ovnkube-node-jfngf\" (UID: \"aba6ad45-845e-4916-8cf1-b8c76da93308\") " pod="openshift-ovn-kubernetes/ovnkube-node-jfngf"
Jul 06 23:55:36.507191 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.504932    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/aba6ad45-845e-4916-8cf1-b8c76da93308-host-run-ovn-kubernetes\") pod \"ovnkube-node-jfngf\" (UID: \"aba6ad45-845e-4916-8cf1-b8c76da93308\") " pod="openshift-ovn-kubernetes/ovnkube-node-jfngf"
Jul 06 23:55:36.507191 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.504959    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c9a06bd6-5b2c-4d39-8401-06cd95486de7-etc-systemd\") pod \"tuned-7f4mc\" (UID: \"c9a06bd6-5b2c-4d39-8401-06cd95486de7\") " pod="openshift-cluster-node-tuning-operator/tuned-7f4mc"
Jul 06 23:55:36.507191 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.504964    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/aba6ad45-845e-4916-8cf1-b8c76da93308-env-overrides\") pod \"ovnkube-node-jfngf\" (UID: \"aba6ad45-845e-4916-8cf1-b8c76da93308\") " pod="openshift-ovn-kubernetes/ovnkube-node-jfngf"
Jul 06 23:55:36.507191 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.504978    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/aba6ad45-845e-4916-8cf1-b8c76da93308-host-slash\") pod \"ovnkube-node-jfngf\" (UID: \"aba6ad45-845e-4916-8cf1-b8c76da93308\") " pod="openshift-ovn-kubernetes/ovnkube-node-jfngf"
Jul 06 23:55:36.507191 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.505021    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/aba6ad45-845e-4916-8cf1-b8c76da93308-ovn-node-metrics-cert\") pod \"ovnkube-node-jfngf\" (UID: \"aba6ad45-845e-4916-8cf1-b8c76da93308\") " pod="openshift-ovn-kubernetes/ovnkube-node-jfngf"
Jul 06 23:55:36.507191 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.505054    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3afd5761-b4ad-4002-b9e7-d646b63d53f0-host-run-k8s-cni-cncf-io\") pod \"multus-gk9q8\" (UID: \"3afd5761-b4ad-4002-b9e7-d646b63d53f0\") " pod="openshift-multus/multus-gk9q8"
Jul 06 23:55:36.507191 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.505089    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3afd5761-b4ad-4002-b9e7-d646b63d53f0-etc-kubernetes\") pod \"multus-gk9q8\" (UID: \"3afd5761-b4ad-4002-b9e7-d646b63d53f0\") " pod="openshift-multus/multus-gk9q8"
Jul 06 23:55:36.507191 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.505156    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f6ae72be-9753-46d1-a665-c2124741a26a-original-pull-secret\") pod \"global-pull-secret-syncer-cm65t\" (UID: \"f6ae72be-9753-46d1-a665-c2124741a26a\") " pod="kube-system/global-pull-secret-syncer-cm65t"
Jul 06 23:55:36.507191 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.505258    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/df4215f7-4f0d-4ba1-b66d-b8902a323531-serviceca\") pod \"node-ca-qndzw\" (UID: \"df4215f7-4f0d-4ba1-b66d-b8902a323531\") " pod="openshift-image-registry/node-ca-qndzw"
Jul 06 23:55:36.507191 ip-10-0-129-23 kubenswrapper[2578]: E0706 23:55:36.505324    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 23:55:36.507191 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.505353    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3afd5761-b4ad-4002-b9e7-d646b63d53f0-host-var-lib-cni-bin\") pod \"multus-gk9q8\" (UID: \"3afd5761-b4ad-4002-b9e7-d646b63d53f0\") " pod="openshift-multus/multus-gk9q8"
Jul 06 23:55:36.507191 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.504562    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3afd5761-b4ad-4002-b9e7-d646b63d53f0-os-release\") pod \"multus-gk9q8\" (UID: \"3afd5761-b4ad-4002-b9e7-d646b63d53f0\") " pod="openshift-multus/multus-gk9q8"
Jul 06 23:55:36.507191 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.505454    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/aba6ad45-845e-4916-8cf1-b8c76da93308-env-overrides\") pod \"ovnkube-node-jfngf\" (UID: \"aba6ad45-845e-4916-8cf1-b8c76da93308\") " pod="openshift-ovn-kubernetes/ovnkube-node-jfngf"
Jul 06 23:55:36.507948 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.505468    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b9a2aa01-bfc8-40f8-b4d7-962428e95667-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-kmhhp\" (UID: \"b9a2aa01-bfc8-40f8-b4d7-962428e95667\") " pod="openshift-multus/multus-additional-cni-plugins-kmhhp"
Jul 06 23:55:36.507948 ip-10-0-129-23 kubenswrapper[2578]: E0706 23:55:36.505487    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f6ae72be-9753-46d1-a665-c2124741a26a-original-pull-secret podName:f6ae72be-9753-46d1-a665-c2124741a26a nodeName:}" failed. No retries permitted until 2026-07-06 23:55:37.005466226 +0000 UTC m=+3.116540024 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f6ae72be-9753-46d1-a665-c2124741a26a-original-pull-secret") pod "global-pull-secret-syncer-cm65t" (UID: "f6ae72be-9753-46d1-a665-c2124741a26a") : object "kube-system"/"original-pull-secret" not registered
Jul 06 23:55:36.507948 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.505484    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c9a06bd6-5b2c-4d39-8401-06cd95486de7-etc-modprobe-d\") pod \"tuned-7f4mc\" (UID: \"c9a06bd6-5b2c-4d39-8401-06cd95486de7\") " pod="openshift-cluster-node-tuning-operator/tuned-7f4mc"
Jul 06 23:55:36.507948 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.505503    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b9a2aa01-bfc8-40f8-b4d7-962428e95667-system-cni-dir\") pod \"multus-additional-cni-plugins-kmhhp\" (UID: \"b9a2aa01-bfc8-40f8-b4d7-962428e95667\") " pod="openshift-multus/multus-additional-cni-plugins-kmhhp"
Jul 06 23:55:36.507948 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.505453    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/aba6ad45-845e-4916-8cf1-b8c76da93308-systemd-units\") pod \"ovnkube-node-jfngf\" (UID: \"aba6ad45-845e-4916-8cf1-b8c76da93308\") " pod="openshift-ovn-kubernetes/ovnkube-node-jfngf"
Jul 06 23:55:36.507948 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.505517    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/aba6ad45-845e-4916-8cf1-b8c76da93308-host-run-ovn-kubernetes\") pod \"ovnkube-node-jfngf\" (UID: \"aba6ad45-845e-4916-8cf1-b8c76da93308\") " pod="openshift-ovn-kubernetes/ovnkube-node-jfngf"
Jul 06 23:55:36.507948 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.505521    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/aba6ad45-845e-4916-8cf1-b8c76da93308-ovnkube-config\") pod \"ovnkube-node-jfngf\" (UID: \"aba6ad45-845e-4916-8cf1-b8c76da93308\") " pod="openshift-ovn-kubernetes/ovnkube-node-jfngf"
Jul 06 23:55:36.507948 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.505525    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/aba6ad45-845e-4916-8cf1-b8c76da93308-var-lib-openvswitch\") pod \"ovnkube-node-jfngf\" (UID: \"aba6ad45-845e-4916-8cf1-b8c76da93308\") " pod="openshift-ovn-kubernetes/ovnkube-node-jfngf"
Jul 06 23:55:36.507948 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.505560    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3afd5761-b4ad-4002-b9e7-d646b63d53f0-host-run-k8s-cni-cncf-io\") pod \"multus-gk9q8\" (UID: \"3afd5761-b4ad-4002-b9e7-d646b63d53f0\") " pod="openshift-multus/multus-gk9q8"
Jul 06 23:55:36.507948 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.505577    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3afd5761-b4ad-4002-b9e7-d646b63d53f0-multus-cni-dir\") pod \"multus-gk9q8\" (UID: \"3afd5761-b4ad-4002-b9e7-d646b63d53f0\") " pod="openshift-multus/multus-gk9q8"
Jul 06 23:55:36.507948 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.505325    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b9a2aa01-bfc8-40f8-b4d7-962428e95667-cnibin\") pod \"multus-additional-cni-plugins-kmhhp\" (UID: \"b9a2aa01-bfc8-40f8-b4d7-962428e95667\") " pod="openshift-multus/multus-additional-cni-plugins-kmhhp"
Jul 06 23:55:36.507948 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.505590    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/aba6ad45-845e-4916-8cf1-b8c76da93308-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-jfngf\" (UID: \"aba6ad45-845e-4916-8cf1-b8c76da93308\") " pod="openshift-ovn-kubernetes/ovnkube-node-jfngf"
Jul 06 23:55:36.507948 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.505578    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f6ae72be-9753-46d1-a665-c2124741a26a-kubelet-config\") pod \"global-pull-secret-syncer-cm65t\" (UID: \"f6ae72be-9753-46d1-a665-c2124741a26a\") " pod="kube-system/global-pull-secret-syncer-cm65t"
Jul 06 23:55:36.507948 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.505610    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c9a06bd6-5b2c-4d39-8401-06cd95486de7-host\") pod \"tuned-7f4mc\" (UID: \"c9a06bd6-5b2c-4d39-8401-06cd95486de7\") " pod="openshift-cluster-node-tuning-operator/tuned-7f4mc"
Jul 06 23:55:36.507948 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.505617    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3afd5761-b4ad-4002-b9e7-d646b63d53f0-etc-kubernetes\") pod \"multus-gk9q8\" (UID: \"3afd5761-b4ad-4002-b9e7-d646b63d53f0\") " pod="openshift-multus/multus-gk9q8"
Jul 06 23:55:36.507948 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.505628    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/aba6ad45-845e-4916-8cf1-b8c76da93308-host-kubelet\") pod \"ovnkube-node-jfngf\" (UID: \"aba6ad45-845e-4916-8cf1-b8c76da93308\") " pod="openshift-ovn-kubernetes/ovnkube-node-jfngf"
Jul 06 23:55:36.507948 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.505668    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3afd5761-b4ad-4002-b9e7-d646b63d53f0-multus-conf-dir\") pod \"multus-gk9q8\" (UID: \"3afd5761-b4ad-4002-b9e7-d646b63d53f0\") " pod="openshift-multus/multus-gk9q8"
Jul 06 23:55:36.508747 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.505696    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c9a06bd6-5b2c-4d39-8401-06cd95486de7-lib-modules\") pod \"tuned-7f4mc\" (UID: \"c9a06bd6-5b2c-4d39-8401-06cd95486de7\") " pod="openshift-cluster-node-tuning-operator/tuned-7f4mc"
Jul 06 23:55:36.508747 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.505838    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b9a2aa01-bfc8-40f8-b4d7-962428e95667-cni-binary-copy\") pod \"multus-additional-cni-plugins-kmhhp\" (UID: \"b9a2aa01-bfc8-40f8-b4d7-962428e95667\") " pod="openshift-multus/multus-additional-cni-plugins-kmhhp"
Jul 06 23:55:36.508747 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.506565    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c9a06bd6-5b2c-4d39-8401-06cd95486de7-tmp\") pod \"tuned-7f4mc\" (UID: \"c9a06bd6-5b2c-4d39-8401-06cd95486de7\") " pod="openshift-cluster-node-tuning-operator/tuned-7f4mc"
Jul 06 23:55:36.508747 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.508048    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/aba6ad45-845e-4916-8cf1-b8c76da93308-ovn-node-metrics-cert\") pod \"ovnkube-node-jfngf\" (UID: \"aba6ad45-845e-4916-8cf1-b8c76da93308\") " pod="openshift-ovn-kubernetes/ovnkube-node-jfngf"
Jul 06 23:55:36.508747 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.508535    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/9a5fa453-505c-4742-86da-db343c8d36af-agent-certs\") pod \"konnectivity-agent-dfsn2\" (UID: \"9a5fa453-505c-4742-86da-db343c8d36af\") " pod="kube-system/konnectivity-agent-dfsn2"
Jul 06 23:55:36.508747 ip-10-0-129-23 kubenswrapper[2578]: E0706 23:55:36.508585    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 23:55:36.508747 ip-10-0-129-23 kubenswrapper[2578]: E0706 23:55:36.508606    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 23:55:36.508747 ip-10-0-129-23 kubenswrapper[2578]: E0706 23:55:36.508620    2578 projected.go:196] Error preparing data for projected volume kube-api-access-wm5xx for pod openshift-network-diagnostics/network-check-target-sqcsc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 23:55:36.508747 ip-10-0-129-23 kubenswrapper[2578]: E0706 23:55:36.508675    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7db1fb04-9b13-425c-abb1-05f4274fe959-kube-api-access-wm5xx podName:7db1fb04-9b13-425c-abb1-05f4274fe959 nodeName:}" failed. No retries permitted until 2026-07-06 23:55:37.008657088 +0000 UTC m=+3.119730904 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-wm5xx" (UniqueName: "kubernetes.io/projected/7db1fb04-9b13-425c-abb1-05f4274fe959-kube-api-access-wm5xx") pod "network-check-target-sqcsc" (UID: "7db1fb04-9b13-425c-abb1-05f4274fe959") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 23:55:36.509404 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.509381    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c9a06bd6-5b2c-4d39-8401-06cd95486de7-etc-tuned\") pod \"tuned-7f4mc\" (UID: \"c9a06bd6-5b2c-4d39-8401-06cd95486de7\") " pod="openshift-cluster-node-tuning-operator/tuned-7f4mc"
Jul 06 23:55:36.513301 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.513260    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w2f2w\" (UniqueName: \"kubernetes.io/projected/df4215f7-4f0d-4ba1-b66d-b8902a323531-kube-api-access-w2f2w\") pod \"node-ca-qndzw\" (UID: \"df4215f7-4f0d-4ba1-b66d-b8902a323531\") " pod="openshift-image-registry/node-ca-qndzw"
Jul 06 23:55:36.515133 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.515110    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xz6xn\" (UniqueName: \"kubernetes.io/projected/aba6ad45-845e-4916-8cf1-b8c76da93308-kube-api-access-xz6xn\") pod \"ovnkube-node-jfngf\" (UID: \"aba6ad45-845e-4916-8cf1-b8c76da93308\") " pod="openshift-ovn-kubernetes/ovnkube-node-jfngf"
Jul 06 23:55:36.515712 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.515690    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mrnmq\" (UniqueName: \"kubernetes.io/projected/f1501e51-2268-4e04-800c-72e6af073f5e-kube-api-access-mrnmq\") pod \"iptables-alerter-sg4kc\" (UID: \"f1501e51-2268-4e04-800c-72e6af073f5e\") " pod="openshift-network-operator/iptables-alerter-sg4kc"
Jul 06 23:55:36.515784 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.515771    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kgsls\" (UniqueName: \"kubernetes.io/projected/c9a06bd6-5b2c-4d39-8401-06cd95486de7-kube-api-access-kgsls\") pod \"tuned-7f4mc\" (UID: \"c9a06bd6-5b2c-4d39-8401-06cd95486de7\") " pod="openshift-cluster-node-tuning-operator/tuned-7f4mc"
Jul 06 23:55:36.518092 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.518071    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4j6ct\" (UniqueName: \"kubernetes.io/projected/b9a2aa01-bfc8-40f8-b4d7-962428e95667-kube-api-access-4j6ct\") pod \"multus-additional-cni-plugins-kmhhp\" (UID: \"b9a2aa01-bfc8-40f8-b4d7-962428e95667\") " pod="openshift-multus/multus-additional-cni-plugins-kmhhp"
Jul 06 23:55:36.518184 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.518129    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-657q2\" (UniqueName: \"kubernetes.io/projected/3afd5761-b4ad-4002-b9e7-d646b63d53f0-kube-api-access-657q2\") pod \"multus-gk9q8\" (UID: \"3afd5761-b4ad-4002-b9e7-d646b63d53f0\") " pod="openshift-multus/multus-gk9q8"
Jul 06 23:55:36.600441 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.600370    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-2h2rk"
Jul 06 23:55:36.619393 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.619367    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4hfmp"
Jul 06 23:55:36.628418 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.628395    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-gk9q8"
Jul 06 23:55:36.634353 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.634334    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-sg4kc"
Jul 06 23:55:36.643373 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.643337    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-dfsn2"
Jul 06 23:55:36.650540 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.650510    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-jfngf"
Jul 06 23:55:36.657425 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.657400    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-kmhhp"
Jul 06 23:55:36.665612 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.665566    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-7f4mc"
Jul 06 23:55:36.672729 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.672705    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-qndzw"
Jul 06 23:55:36.909355 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:36.909278    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ed50a99b-7856-44b3-bb1a-12f8b25546b9-metrics-certs\") pod \"network-metrics-daemon-g45vp\" (UID: \"ed50a99b-7856-44b3-bb1a-12f8b25546b9\") " pod="openshift-multus/network-metrics-daemon-g45vp"
Jul 06 23:55:36.909510 ip-10-0-129-23 kubenswrapper[2578]: E0706 23:55:36.909453    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 23:55:36.909576 ip-10-0-129-23 kubenswrapper[2578]: E0706 23:55:36.909528    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ed50a99b-7856-44b3-bb1a-12f8b25546b9-metrics-certs podName:ed50a99b-7856-44b3-bb1a-12f8b25546b9 nodeName:}" failed. No retries permitted until 2026-07-06 23:55:37.909507166 +0000 UTC m=+4.020580949 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ed50a99b-7856-44b3-bb1a-12f8b25546b9-metrics-certs") pod "network-metrics-daemon-g45vp" (UID: "ed50a99b-7856-44b3-bb1a-12f8b25546b9") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 23:55:37.010055 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:37.010026    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f6ae72be-9753-46d1-a665-c2124741a26a-original-pull-secret\") pod \"global-pull-secret-syncer-cm65t\" (UID: \"f6ae72be-9753-46d1-a665-c2124741a26a\") " pod="kube-system/global-pull-secret-syncer-cm65t"
Jul 06 23:55:37.010212 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:37.010065    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wm5xx\" (UniqueName: \"kubernetes.io/projected/7db1fb04-9b13-425c-abb1-05f4274fe959-kube-api-access-wm5xx\") pod \"network-check-target-sqcsc\" (UID: \"7db1fb04-9b13-425c-abb1-05f4274fe959\") " pod="openshift-network-diagnostics/network-check-target-sqcsc"
Jul 06 23:55:37.010256 ip-10-0-129-23 kubenswrapper[2578]: E0706 23:55:37.010200    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 23:55:37.010256 ip-10-0-129-23 kubenswrapper[2578]: E0706 23:55:37.010232    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 23:55:37.010256 ip-10-0-129-23 kubenswrapper[2578]: E0706 23:55:37.010247    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 23:55:37.010256 ip-10-0-129-23 kubenswrapper[2578]: E0706 23:55:37.010256    2578 projected.go:196] Error preparing data for projected volume kube-api-access-wm5xx for pod openshift-network-diagnostics/network-check-target-sqcsc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 23:55:37.010402 ip-10-0-129-23 kubenswrapper[2578]: E0706 23:55:37.010276    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f6ae72be-9753-46d1-a665-c2124741a26a-original-pull-secret podName:f6ae72be-9753-46d1-a665-c2124741a26a nodeName:}" failed. No retries permitted until 2026-07-06 23:55:38.010259908 +0000 UTC m=+4.121333690 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f6ae72be-9753-46d1-a665-c2124741a26a-original-pull-secret") pod "global-pull-secret-syncer-cm65t" (UID: "f6ae72be-9753-46d1-a665-c2124741a26a") : object "kube-system"/"original-pull-secret" not registered
Jul 06 23:55:37.010402 ip-10-0-129-23 kubenswrapper[2578]: E0706 23:55:37.010294    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7db1fb04-9b13-425c-abb1-05f4274fe959-kube-api-access-wm5xx podName:7db1fb04-9b13-425c-abb1-05f4274fe959 nodeName:}" failed. No retries permitted until 2026-07-06 23:55:38.01028346 +0000 UTC m=+4.121357242 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-wm5xx" (UniqueName: "kubernetes.io/projected/7db1fb04-9b13-425c-abb1-05f4274fe959-kube-api-access-wm5xx") pod "network-check-target-sqcsc" (UID: "7db1fb04-9b13-425c-abb1-05f4274fe959") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 23:55:37.327807 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:37.327715    2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-05 23:50:36 +0000 UTC" deadline="2027-12-10 17:42:02.915420484 +0000 UTC"
Jul 06 23:55:37.327807 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:37.327754    2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12521h46m25.587670852s"
Jul 06 23:55:37.385484 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:37.385458    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sqcsc"
Jul 06 23:55:37.385622 ip-10-0-129-23 kubenswrapper[2578]: E0706 23:55:37.385588    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sqcsc" podUID="7db1fb04-9b13-425c-abb1-05f4274fe959"
Jul 06 23:55:37.549439 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:37.549407    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc9a06bd6_5b2c_4d39_8401_06cd95486de7.slice/crio-920c94a82cf18e7185224ff657ad9e228c44db324f9e3a66c2d5be907357e05f WatchSource:0}: Error finding container 920c94a82cf18e7185224ff657ad9e228c44db324f9e3a66c2d5be907357e05f: Status 404 returned error can't find the container with id 920c94a82cf18e7185224ff657ad9e228c44db324f9e3a66c2d5be907357e05f
Jul 06 23:55:37.561151 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:55:37.560862    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaba6ad45_845e_4916_8cf1_b8c76da93308.slice/crio-52d464656d5a29f91e65562219010954a88538e7ba540c9445f2594fe8488eb8 WatchSource:0}: Error finding container 52d464656d5a29f91e65562219010954a88538e7ba540c9445f2594fe8488eb8: Status 404 returned error can't find the container with id 52d464656d5a29f91e65562219010954a88538e7ba540c9445f2594fe8488eb8
Jul 06 23:55:37.917786 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:37.917760    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ed50a99b-7856-44b3-bb1a-12f8b25546b9-metrics-certs\") pod \"network-metrics-daemon-g45vp\" (UID: \"ed50a99b-7856-44b3-bb1a-12f8b25546b9\") " pod="openshift-multus/network-metrics-daemon-g45vp"
Jul 06 23:55:37.917899 ip-10-0-129-23 kubenswrapper[2578]: E0706 23:55:37.917864    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 23:55:37.917952 ip-10-0-129-23 kubenswrapper[2578]: E0706 23:55:37.917910    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ed50a99b-7856-44b3-bb1a-12f8b25546b9-metrics-certs podName:ed50a99b-7856-44b3-bb1a-12f8b25546b9 nodeName:}" failed. No retries permitted until 2026-07-06 23:55:39.917896907 +0000 UTC m=+6.028970690 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ed50a99b-7856-44b3-bb1a-12f8b25546b9-metrics-certs") pod "network-metrics-daemon-g45vp" (UID: "ed50a99b-7856-44b3-bb1a-12f8b25546b9") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 23:55:38.018303 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:38.018277    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f6ae72be-9753-46d1-a665-c2124741a26a-original-pull-secret\") pod \"global-pull-secret-syncer-cm65t\" (UID: \"f6ae72be-9753-46d1-a665-c2124741a26a\") " pod="kube-system/global-pull-secret-syncer-cm65t"
Jul 06 23:55:38.018401 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:38.018340    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wm5xx\" (UniqueName: \"kubernetes.io/projected/7db1fb04-9b13-425c-abb1-05f4274fe959-kube-api-access-wm5xx\") pod \"network-check-target-sqcsc\" (UID: \"7db1fb04-9b13-425c-abb1-05f4274fe959\") " pod="openshift-network-diagnostics/network-check-target-sqcsc"
Jul 06 23:55:38.018439 ip-10-0-129-23 kubenswrapper[2578]: E0706 23:55:38.018422    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 23:55:38.018476 ip-10-0-129-23 kubenswrapper[2578]: E0706 23:55:38.018437    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 23:55:38.018476 ip-10-0-129-23 kubenswrapper[2578]: E0706 23:55:38.018452    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 23:55:38.018476 ip-10-0-129-23 kubenswrapper[2578]: E0706 23:55:38.018462    2578 projected.go:196] Error preparing data for projected volume kube-api-access-wm5xx for pod openshift-network-diagnostics/network-check-target-sqcsc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 23:55:38.018564 ip-10-0-129-23 kubenswrapper[2578]: E0706 23:55:38.018480    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f6ae72be-9753-46d1-a665-c2124741a26a-original-pull-secret podName:f6ae72be-9753-46d1-a665-c2124741a26a nodeName:}" failed. No retries permitted until 2026-07-06 23:55:40.018461596 +0000 UTC m=+6.129535379 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f6ae72be-9753-46d1-a665-c2124741a26a-original-pull-secret") pod "global-pull-secret-syncer-cm65t" (UID: "f6ae72be-9753-46d1-a665-c2124741a26a") : object "kube-system"/"original-pull-secret" not registered
Jul 06 23:55:38.018564 ip-10-0-129-23 kubenswrapper[2578]: E0706 23:55:38.018499    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7db1fb04-9b13-425c-abb1-05f4274fe959-kube-api-access-wm5xx podName:7db1fb04-9b13-425c-abb1-05f4274fe959 nodeName:}" failed. No retries permitted until 2026-07-06 23:55:40.018486759 +0000 UTC m=+6.129560557 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-wm5xx" (UniqueName: "kubernetes.io/projected/7db1fb04-9b13-425c-abb1-05f4274fe959-kube-api-access-wm5xx") pod "network-check-target-sqcsc" (UID: "7db1fb04-9b13-425c-abb1-05f4274fe959") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 23:55:38.328693 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:38.328622    2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-05 23:50:36 +0000 UTC" deadline="2028-01-21 14:11:08.45090855 +0000 UTC"
Jul 06 23:55:38.328693 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:38.328682    2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13526h15m30.12223051s"
Jul 06 23:55:38.387636 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:38.387607    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cm65t"
Jul 06 23:55:38.387780 ip-10-0-129-23 kubenswrapper[2578]: E0706 23:55:38.387735    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cm65t" podUID="f6ae72be-9753-46d1-a665-c2124741a26a"
Jul 06 23:55:38.388150 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:38.388129    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g45vp"
Jul 06 23:55:38.388253 ip-10-0-129-23 kubenswrapper[2578]: E0706 23:55:38.388240    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g45vp" podUID="ed50a99b-7856-44b3-bb1a-12f8b25546b9"
Jul 06 23:55:38.400344 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:38.400317    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-23.ec2.internal" event={"ID":"dac848c666487bcdf1b079d63eb47623","Type":"ContainerStarted","Data":"28900688654e41e6b10058b32499b94ccc72a98b70b79eaf57c86c41fe0d9059"}
Jul 06 23:55:38.414165 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:38.414127    2578 generic.go:356] "Generic (PLEG): container finished" podID="69102573f9114d1d93cb35c1c9fbaca4" containerID="a51dd9ced6921e8d222c97fa257a49a83bbd01ede4c678e7074eca44cf4f6659" exitCode=0
Jul 06 23:55:38.414269 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:38.414210    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-23.ec2.internal" event={"ID":"69102573f9114d1d93cb35c1c9fbaca4","Type":"ContainerDied","Data":"a51dd9ced6921e8d222c97fa257a49a83bbd01ede4c678e7074eca44cf4f6659"}
Jul 06 23:55:38.425333 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:38.425235    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jfngf" event={"ID":"aba6ad45-845e-4916-8cf1-b8c76da93308","Type":"ContainerStarted","Data":"52d464656d5a29f91e65562219010954a88538e7ba540c9445f2594fe8488eb8"}
Jul 06 23:55:38.430268 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:38.430201    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-dfsn2" event={"ID":"9a5fa453-505c-4742-86da-db343c8d36af","Type":"ContainerStarted","Data":"62e6a0dd8284886938912bfa0e330eead7e7c8de3a0b113287d21e8c8e2db669"}
Jul 06 23:55:38.436676 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:38.433627    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-23.ec2.internal" podStartSLOduration=3.433610231 podStartE2EDuration="3.433610231s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 23:55:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:55:38.416956232 +0000 UTC m=+4.528030038" watchObservedRunningTime="2026-07-06 23:55:38.433610231 +0000 UTC m=+4.544684040"
Jul 06 23:55:38.436676 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:38.435274    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-2h2rk" event={"ID":"66f64c88-7770-4613-81c2-97f105d345e5","Type":"ContainerStarted","Data":"2a4f2a86f1203bc3145774c345ebb692c5e5bd5c40481715feb05bd090628952"}
Jul 06 23:55:38.443669 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:38.443641    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-qndzw" event={"ID":"df4215f7-4f0d-4ba1-b66d-b8902a323531","Type":"ContainerStarted","Data":"ca1eddf282e8326029cec8af6650c360b88e79ebaee7013a75d5b2ef2686897c"}
Jul 06 23:55:38.457807 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:38.457779    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-sg4kc" event={"ID":"f1501e51-2268-4e04-800c-72e6af073f5e","Type":"ContainerStarted","Data":"b5b123d3c89d3d8000092a260c9b9a2efaf0951d9072660853c756b60b1cdba2"}
Jul 06 23:55:38.491539 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:38.491508    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kmhhp" event={"ID":"b9a2aa01-bfc8-40f8-b4d7-962428e95667","Type":"ContainerStarted","Data":"c31f764db77a2bcbc884944286966fdcf67ddd71120aa430acc9846546ad0033"}
Jul 06 23:55:38.511807 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:38.511774    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4hfmp" event={"ID":"4e757f80-3ca9-43c3-9e22-224374be02d8","Type":"ContainerStarted","Data":"40b4e2b327e8ef419f2adae4172674c646b2099e6cad8f6e406bd21f04c6e6c9"}
Jul 06 23:55:38.525813 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:38.525785    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-gk9q8" event={"ID":"3afd5761-b4ad-4002-b9e7-d646b63d53f0","Type":"ContainerStarted","Data":"919fba271cf1d3c7c933f96c58ead7789bb4b79b4b6d858ee11120c44b9b6672"}
Jul 06 23:55:38.530428 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:38.530302    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-7f4mc" event={"ID":"c9a06bd6-5b2c-4d39-8401-06cd95486de7","Type":"ContainerStarted","Data":"920c94a82cf18e7185224ff657ad9e228c44db324f9e3a66c2d5be907357e05f"}
Jul 06 23:55:39.385066 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:39.384562    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sqcsc"
Jul 06 23:55:39.385066 ip-10-0-129-23 kubenswrapper[2578]: E0706 23:55:39.384699    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sqcsc" podUID="7db1fb04-9b13-425c-abb1-05f4274fe959"
Jul 06 23:55:39.556001 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:39.555964    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-23.ec2.internal" event={"ID":"69102573f9114d1d93cb35c1c9fbaca4","Type":"ContainerStarted","Data":"ce4467cb247c1482ba5256f64c49161d60e48b576cff5cb9aa1dbd3cd7dfeee8"}
Jul 06 23:55:39.938831 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:39.938794    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ed50a99b-7856-44b3-bb1a-12f8b25546b9-metrics-certs\") pod \"network-metrics-daemon-g45vp\" (UID: \"ed50a99b-7856-44b3-bb1a-12f8b25546b9\") " pod="openshift-multus/network-metrics-daemon-g45vp"
Jul 06 23:55:39.939016 ip-10-0-129-23 kubenswrapper[2578]: E0706 23:55:39.938961    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 23:55:39.939081 ip-10-0-129-23 kubenswrapper[2578]: E0706 23:55:39.939028    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ed50a99b-7856-44b3-bb1a-12f8b25546b9-metrics-certs podName:ed50a99b-7856-44b3-bb1a-12f8b25546b9 nodeName:}" failed. No retries permitted until 2026-07-06 23:55:43.939007336 +0000 UTC m=+10.050081133 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ed50a99b-7856-44b3-bb1a-12f8b25546b9-metrics-certs") pod "network-metrics-daemon-g45vp" (UID: "ed50a99b-7856-44b3-bb1a-12f8b25546b9") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 23:55:40.039459 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:40.039417    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f6ae72be-9753-46d1-a665-c2124741a26a-original-pull-secret\") pod \"global-pull-secret-syncer-cm65t\" (UID: \"f6ae72be-9753-46d1-a665-c2124741a26a\") " pod="kube-system/global-pull-secret-syncer-cm65t"
Jul 06 23:55:40.039633 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:40.039475    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wm5xx\" (UniqueName: \"kubernetes.io/projected/7db1fb04-9b13-425c-abb1-05f4274fe959-kube-api-access-wm5xx\") pod \"network-check-target-sqcsc\" (UID: \"7db1fb04-9b13-425c-abb1-05f4274fe959\") " pod="openshift-network-diagnostics/network-check-target-sqcsc"
Jul 06 23:55:40.039696 ip-10-0-129-23 kubenswrapper[2578]: E0706 23:55:40.039666    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 23:55:40.039696 ip-10-0-129-23 kubenswrapper[2578]: E0706 23:55:40.039685    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 23:55:40.039794 ip-10-0-129-23 kubenswrapper[2578]: E0706 23:55:40.039699    2578 projected.go:196] Error preparing data for projected volume kube-api-access-wm5xx for pod openshift-network-diagnostics/network-check-target-sqcsc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 23:55:40.039794 ip-10-0-129-23 kubenswrapper[2578]: E0706 23:55:40.039760    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7db1fb04-9b13-425c-abb1-05f4274fe959-kube-api-access-wm5xx podName:7db1fb04-9b13-425c-abb1-05f4274fe959 nodeName:}" failed. No retries permitted until 2026-07-06 23:55:44.039740327 +0000 UTC m=+10.150814126 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-wm5xx" (UniqueName: "kubernetes.io/projected/7db1fb04-9b13-425c-abb1-05f4274fe959-kube-api-access-wm5xx") pod "network-check-target-sqcsc" (UID: "7db1fb04-9b13-425c-abb1-05f4274fe959") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 23:55:40.040193 ip-10-0-129-23 kubenswrapper[2578]: E0706 23:55:40.040168    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 23:55:40.040301 ip-10-0-129-23 kubenswrapper[2578]: E0706 23:55:40.040226    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f6ae72be-9753-46d1-a665-c2124741a26a-original-pull-secret podName:f6ae72be-9753-46d1-a665-c2124741a26a nodeName:}" failed. No retries permitted until 2026-07-06 23:55:44.040210878 +0000 UTC m=+10.151284675 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f6ae72be-9753-46d1-a665-c2124741a26a-original-pull-secret") pod "global-pull-secret-syncer-cm65t" (UID: "f6ae72be-9753-46d1-a665-c2124741a26a") : object "kube-system"/"original-pull-secret" not registered
Jul 06 23:55:40.385237 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:40.385143    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g45vp"
Jul 06 23:55:40.385656 ip-10-0-129-23 kubenswrapper[2578]: E0706 23:55:40.385305    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g45vp" podUID="ed50a99b-7856-44b3-bb1a-12f8b25546b9"
Jul 06 23:55:40.385656 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:40.385398    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cm65t"
Jul 06 23:55:40.385656 ip-10-0-129-23 kubenswrapper[2578]: E0706 23:55:40.385479    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cm65t" podUID="f6ae72be-9753-46d1-a665-c2124741a26a"
Jul 06 23:55:41.384860 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:41.384829    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sqcsc"
Jul 06 23:55:41.385032 ip-10-0-129-23 kubenswrapper[2578]: E0706 23:55:41.384950    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sqcsc" podUID="7db1fb04-9b13-425c-abb1-05f4274fe959"
Jul 06 23:55:42.388375 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:42.388345    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g45vp"
Jul 06 23:55:42.388794 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:42.388356    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cm65t"
Jul 06 23:55:42.393451 ip-10-0-129-23 kubenswrapper[2578]: E0706 23:55:42.388843    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g45vp" podUID="ed50a99b-7856-44b3-bb1a-12f8b25546b9"
Jul 06 23:55:42.393590 ip-10-0-129-23 kubenswrapper[2578]: E0706 23:55:42.393486    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cm65t" podUID="f6ae72be-9753-46d1-a665-c2124741a26a"
Jul 06 23:55:43.384843 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:43.384768    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sqcsc"
Jul 06 23:55:43.385006 ip-10-0-129-23 kubenswrapper[2578]: E0706 23:55:43.384893    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sqcsc" podUID="7db1fb04-9b13-425c-abb1-05f4274fe959"
Jul 06 23:55:43.967720 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:43.967691    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ed50a99b-7856-44b3-bb1a-12f8b25546b9-metrics-certs\") pod \"network-metrics-daemon-g45vp\" (UID: \"ed50a99b-7856-44b3-bb1a-12f8b25546b9\") " pod="openshift-multus/network-metrics-daemon-g45vp"
Jul 06 23:55:43.968173 ip-10-0-129-23 kubenswrapper[2578]: E0706 23:55:43.967834    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 23:55:43.968173 ip-10-0-129-23 kubenswrapper[2578]: E0706 23:55:43.967892    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ed50a99b-7856-44b3-bb1a-12f8b25546b9-metrics-certs podName:ed50a99b-7856-44b3-bb1a-12f8b25546b9 nodeName:}" failed. No retries permitted until 2026-07-06 23:55:51.967873335 +0000 UTC m=+18.078947126 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ed50a99b-7856-44b3-bb1a-12f8b25546b9-metrics-certs") pod "network-metrics-daemon-g45vp" (UID: "ed50a99b-7856-44b3-bb1a-12f8b25546b9") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 23:55:44.068489 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:44.068455    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f6ae72be-9753-46d1-a665-c2124741a26a-original-pull-secret\") pod \"global-pull-secret-syncer-cm65t\" (UID: \"f6ae72be-9753-46d1-a665-c2124741a26a\") " pod="kube-system/global-pull-secret-syncer-cm65t"
Jul 06 23:55:44.068653 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:44.068498    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wm5xx\" (UniqueName: \"kubernetes.io/projected/7db1fb04-9b13-425c-abb1-05f4274fe959-kube-api-access-wm5xx\") pod \"network-check-target-sqcsc\" (UID: \"7db1fb04-9b13-425c-abb1-05f4274fe959\") " pod="openshift-network-diagnostics/network-check-target-sqcsc"
Jul 06 23:55:44.068717 ip-10-0-129-23 kubenswrapper[2578]: E0706 23:55:44.068655    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 23:55:44.068717 ip-10-0-129-23 kubenswrapper[2578]: E0706 23:55:44.068675    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 23:55:44.068717 ip-10-0-129-23 kubenswrapper[2578]: E0706 23:55:44.068685    2578 projected.go:196] Error preparing data for projected volume kube-api-access-wm5xx for pod openshift-network-diagnostics/network-check-target-sqcsc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 23:55:44.068857 ip-10-0-129-23 kubenswrapper[2578]: E0706 23:55:44.068728    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7db1fb04-9b13-425c-abb1-05f4274fe959-kube-api-access-wm5xx podName:7db1fb04-9b13-425c-abb1-05f4274fe959 nodeName:}" failed. No retries permitted until 2026-07-06 23:55:52.068715677 +0000 UTC m=+18.179789459 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-wm5xx" (UniqueName: "kubernetes.io/projected/7db1fb04-9b13-425c-abb1-05f4274fe959-kube-api-access-wm5xx") pod "network-check-target-sqcsc" (UID: "7db1fb04-9b13-425c-abb1-05f4274fe959") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 23:55:44.069097 ip-10-0-129-23 kubenswrapper[2578]: E0706 23:55:44.069080    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 23:55:44.069154 ip-10-0-129-23 kubenswrapper[2578]: E0706 23:55:44.069130    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f6ae72be-9753-46d1-a665-c2124741a26a-original-pull-secret podName:f6ae72be-9753-46d1-a665-c2124741a26a nodeName:}" failed. No retries permitted until 2026-07-06 23:55:52.069115585 +0000 UTC m=+18.180189380 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f6ae72be-9753-46d1-a665-c2124741a26a-original-pull-secret") pod "global-pull-secret-syncer-cm65t" (UID: "f6ae72be-9753-46d1-a665-c2124741a26a") : object "kube-system"/"original-pull-secret" not registered
Jul 06 23:55:44.386000 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:44.385921    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cm65t"
Jul 06 23:55:44.386156 ip-10-0-129-23 kubenswrapper[2578]: E0706 23:55:44.386015    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cm65t" podUID="f6ae72be-9753-46d1-a665-c2124741a26a"
Jul 06 23:55:44.386156 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:44.386108    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g45vp"
Jul 06 23:55:44.386269 ip-10-0-129-23 kubenswrapper[2578]: E0706 23:55:44.386187    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g45vp" podUID="ed50a99b-7856-44b3-bb1a-12f8b25546b9"
Jul 06 23:55:45.385140 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:45.385109    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sqcsc"
Jul 06 23:55:45.385628 ip-10-0-129-23 kubenswrapper[2578]: E0706 23:55:45.385232    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sqcsc" podUID="7db1fb04-9b13-425c-abb1-05f4274fe959"
Jul 06 23:55:46.384882 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:46.384852    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cm65t"
Jul 06 23:55:46.385062 ip-10-0-129-23 kubenswrapper[2578]: E0706 23:55:46.384954    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cm65t" podUID="f6ae72be-9753-46d1-a665-c2124741a26a"
Jul 06 23:55:46.385331 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:46.385311    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g45vp"
Jul 06 23:55:46.385671 ip-10-0-129-23 kubenswrapper[2578]: E0706 23:55:46.385417    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g45vp" podUID="ed50a99b-7856-44b3-bb1a-12f8b25546b9"
Jul 06 23:55:47.384705 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:47.384262    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sqcsc"
Jul 06 23:55:47.384705 ip-10-0-129-23 kubenswrapper[2578]: E0706 23:55:47.384403    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sqcsc" podUID="7db1fb04-9b13-425c-abb1-05f4274fe959"
Jul 06 23:55:48.385114 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:48.385005    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cm65t"
Jul 06 23:55:48.385487 ip-10-0-129-23 kubenswrapper[2578]: E0706 23:55:48.385119    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cm65t" podUID="f6ae72be-9753-46d1-a665-c2124741a26a"
Jul 06 23:55:48.385487 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:48.385182    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g45vp"
Jul 06 23:55:48.385487 ip-10-0-129-23 kubenswrapper[2578]: E0706 23:55:48.385259    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g45vp" podUID="ed50a99b-7856-44b3-bb1a-12f8b25546b9"
Jul 06 23:55:48.584723 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:48.584200    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-7f4mc" event={"ID":"c9a06bd6-5b2c-4d39-8401-06cd95486de7","Type":"ContainerStarted","Data":"6621839941c2fb343d4bae5d6388a9be74c367299cd510c77cdb3c2169f58920"}
Jul 06 23:55:48.587418 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:48.587395    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-dfsn2" event={"ID":"9a5fa453-505c-4742-86da-db343c8d36af","Type":"ContainerStarted","Data":"be3335dfdd013ac595f6d14035f7fb4e6f72a3c11e771e78332e7e52aee49457"}
Jul 06 23:55:48.595475 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:48.595388    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4hfmp" event={"ID":"4e757f80-3ca9-43c3-9e22-224374be02d8","Type":"ContainerStarted","Data":"0fa1fedd3656d276b16f442c412e743c7d9474fe6021dca3a8395e9d51ccad94"}
Jul 06 23:55:48.606306 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:48.605460    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-7f4mc" podStartSLOduration=2.749304253 podStartE2EDuration="13.605442499s" totalImagesPullingTime="10.856138246s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 23:55:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:55:48.604832387 +0000 UTC m=+14.715906185" watchObservedRunningTime="2026-07-06 23:55:48.605442499 +0000 UTC m=+14.716516301"
Jul 06 23:55:48.606306 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:48.606047    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-23.ec2.internal" podStartSLOduration=13.606035512 podStartE2EDuration="13.606035512s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 23:55:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:55:39.573532451 +0000 UTC m=+5.684606259" watchObservedRunningTime="2026-07-06 23:55:48.606035512 +0000 UTC m=+14.717109317"
Jul 06 23:55:49.384748 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:49.384721    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sqcsc"
Jul 06 23:55:49.384888 ip-10-0-129-23 kubenswrapper[2578]: E0706 23:55:49.384813    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sqcsc" podUID="7db1fb04-9b13-425c-abb1-05f4274fe959"
Jul 06 23:55:49.405927 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:49.405900    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-dfsn2"
Jul 06 23:55:49.406661 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:49.406457    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-dfsn2"
Jul 06 23:55:49.422655 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:49.422601    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-dfsn2" podStartSLOduration=4.852566854 podStartE2EDuration="15.422583414s" totalImagesPullingTime="10.57001656s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:55:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:55:48.619363489 +0000 UTC m=+14.730437291" watchObservedRunningTime="2026-07-06 23:55:49.422583414 +0000 UTC m=+15.533657216"
Jul 06 23:55:49.598803 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:49.598764    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-2h2rk" event={"ID":"66f64c88-7770-4613-81c2-97f105d345e5","Type":"ContainerStarted","Data":"0320717efaa1f1c47afcf1290069972663c4e4b298c3dbe05da647cef5638cf7"}
Jul 06 23:55:49.600477 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:49.600453    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-qndzw" event={"ID":"df4215f7-4f0d-4ba1-b66d-b8902a323531","Type":"ContainerStarted","Data":"31e27ddf3029f0af94eb3a6fd4619186223d650e96f3a21c487a45ec68c972d6"}
Jul 06 23:55:49.602048 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:49.602024    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kmhhp" event={"ID":"b9a2aa01-bfc8-40f8-b4d7-962428e95667","Type":"ContainerStarted","Data":"8735eccb6fa2aca81d1cb0ff2073dbbd3b1d2a445752056741f2a561bc4b1b9e"}
Jul 06 23:55:49.602549 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:49.602520    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-dfsn2"
Jul 06 23:55:49.602904 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:49.602889    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-dfsn2"
Jul 06 23:55:49.614781 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:49.614736    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-2h2rk" podStartSLOduration=5.014580907 podStartE2EDuration="15.614723696s" totalImagesPullingTime="10.600142789s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 23:55:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:55:49.614524555 +0000 UTC m=+15.725598357" watchObservedRunningTime="2026-07-06 23:55:49.614723696 +0000 UTC m=+15.725797499"
Jul 06 23:55:50.387640 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:50.387614    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g45vp"
Jul 06 23:55:50.387640 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:50.387630    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cm65t"
Jul 06 23:55:50.387832 ip-10-0-129-23 kubenswrapper[2578]: E0706 23:55:50.387721    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cm65t" podUID="f6ae72be-9753-46d1-a665-c2124741a26a"
Jul 06 23:55:50.387832 ip-10-0-129-23 kubenswrapper[2578]: E0706 23:55:50.387815    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g45vp" podUID="ed50a99b-7856-44b3-bb1a-12f8b25546b9"
Jul 06 23:55:50.606298 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:50.606248    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-sg4kc" event={"ID":"f1501e51-2268-4e04-800c-72e6af073f5e","Type":"ContainerStarted","Data":"e2cf1fbfeef5b3299c54b497eff59313b19cdc98808be08e1428453e7f5fdcd0"}
Jul 06 23:55:50.624008 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:50.623967    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-qndzw" podStartSLOduration=5.02254602 podStartE2EDuration="15.623953526s" totalImagesPullingTime="10.601407506s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 23:55:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:55:49.671199085 +0000 UTC m=+15.782272901" watchObservedRunningTime="2026-07-06 23:55:50.623953526 +0000 UTC m=+16.735027364"
Jul 06 23:55:50.624149 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:50.624112    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-sg4kc" podStartSLOduration=6.014228638 podStartE2EDuration="16.624106384s" totalImagesPullingTime="10.609877746s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 23:55:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:55:50.623633004 +0000 UTC m=+16.734706807" watchObservedRunningTime="2026-07-06 23:55:50.624106384 +0000 UTC m=+16.735180186"
Jul 06 23:55:51.384489 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:51.384453    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sqcsc"
Jul 06 23:55:51.384706 ip-10-0-129-23 kubenswrapper[2578]: E0706 23:55:51.384594    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sqcsc" podUID="7db1fb04-9b13-425c-abb1-05f4274fe959"
Jul 06 23:55:52.036390 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:52.036360    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ed50a99b-7856-44b3-bb1a-12f8b25546b9-metrics-certs\") pod \"network-metrics-daemon-g45vp\" (UID: \"ed50a99b-7856-44b3-bb1a-12f8b25546b9\") " pod="openshift-multus/network-metrics-daemon-g45vp"
Jul 06 23:55:52.036787 ip-10-0-129-23 kubenswrapper[2578]: E0706 23:55:52.036478    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 23:55:52.036787 ip-10-0-129-23 kubenswrapper[2578]: E0706 23:55:52.036540    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ed50a99b-7856-44b3-bb1a-12f8b25546b9-metrics-certs podName:ed50a99b-7856-44b3-bb1a-12f8b25546b9 nodeName:}" failed. No retries permitted until 2026-07-06 23:56:08.036520001 +0000 UTC m=+34.147593784 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ed50a99b-7856-44b3-bb1a-12f8b25546b9-metrics-certs") pod "network-metrics-daemon-g45vp" (UID: "ed50a99b-7856-44b3-bb1a-12f8b25546b9") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 23:55:52.136864 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:52.136831    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f6ae72be-9753-46d1-a665-c2124741a26a-original-pull-secret\") pod \"global-pull-secret-syncer-cm65t\" (UID: \"f6ae72be-9753-46d1-a665-c2124741a26a\") " pod="kube-system/global-pull-secret-syncer-cm65t"
Jul 06 23:55:52.136999 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:52.136874    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wm5xx\" (UniqueName: \"kubernetes.io/projected/7db1fb04-9b13-425c-abb1-05f4274fe959-kube-api-access-wm5xx\") pod \"network-check-target-sqcsc\" (UID: \"7db1fb04-9b13-425c-abb1-05f4274fe959\") " pod="openshift-network-diagnostics/network-check-target-sqcsc"
Jul 06 23:55:52.136999 ip-10-0-129-23 kubenswrapper[2578]: E0706 23:55:52.136979    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 23:55:52.137077 ip-10-0-129-23 kubenswrapper[2578]: E0706 23:55:52.137031    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 23:55:52.137077 ip-10-0-129-23 kubenswrapper[2578]: E0706 23:55:52.137036    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f6ae72be-9753-46d1-a665-c2124741a26a-original-pull-secret podName:f6ae72be-9753-46d1-a665-c2124741a26a nodeName:}" failed. No retries permitted until 2026-07-06 23:56:08.137019066 +0000 UTC m=+34.248092847 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f6ae72be-9753-46d1-a665-c2124741a26a-original-pull-secret") pod "global-pull-secret-syncer-cm65t" (UID: "f6ae72be-9753-46d1-a665-c2124741a26a") : object "kube-system"/"original-pull-secret" not registered
Jul 06 23:55:52.137077 ip-10-0-129-23 kubenswrapper[2578]: E0706 23:55:52.137050    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 23:55:52.137077 ip-10-0-129-23 kubenswrapper[2578]: E0706 23:55:52.137063    2578 projected.go:196] Error preparing data for projected volume kube-api-access-wm5xx for pod openshift-network-diagnostics/network-check-target-sqcsc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 23:55:52.137243 ip-10-0-129-23 kubenswrapper[2578]: E0706 23:55:52.137106    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7db1fb04-9b13-425c-abb1-05f4274fe959-kube-api-access-wm5xx podName:7db1fb04-9b13-425c-abb1-05f4274fe959 nodeName:}" failed. No retries permitted until 2026-07-06 23:56:08.137092105 +0000 UTC m=+34.248165901 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-wm5xx" (UniqueName: "kubernetes.io/projected/7db1fb04-9b13-425c-abb1-05f4274fe959-kube-api-access-wm5xx") pod "network-check-target-sqcsc" (UID: "7db1fb04-9b13-425c-abb1-05f4274fe959") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 23:55:52.387775 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:52.387627    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g45vp"
Jul 06 23:55:52.387934 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:52.387669    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cm65t"
Jul 06 23:55:52.387934 ip-10-0-129-23 kubenswrapper[2578]: E0706 23:55:52.387882    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g45vp" podUID="ed50a99b-7856-44b3-bb1a-12f8b25546b9"
Jul 06 23:55:52.388041 ip-10-0-129-23 kubenswrapper[2578]: E0706 23:55:52.387956    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cm65t" podUID="f6ae72be-9753-46d1-a665-c2124741a26a"
Jul 06 23:55:52.610983 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:52.610875    2578 generic.go:356] "Generic (PLEG): container finished" podID="b9a2aa01-bfc8-40f8-b4d7-962428e95667" containerID="8735eccb6fa2aca81d1cb0ff2073dbbd3b1d2a445752056741f2a561bc4b1b9e" exitCode=0
Jul 06 23:55:52.610983 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:52.610932    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kmhhp" event={"ID":"b9a2aa01-bfc8-40f8-b4d7-962428e95667","Type":"ContainerDied","Data":"8735eccb6fa2aca81d1cb0ff2073dbbd3b1d2a445752056741f2a561bc4b1b9e"}
Jul 06 23:55:53.384937 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:53.384910    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sqcsc"
Jul 06 23:55:53.385450 ip-10-0-129-23 kubenswrapper[2578]: E0706 23:55:53.385032    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sqcsc" podUID="7db1fb04-9b13-425c-abb1-05f4274fe959"
Jul 06 23:55:54.385094 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:54.385057    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cm65t"
Jul 06 23:55:54.385488 ip-10-0-129-23 kubenswrapper[2578]: E0706 23:55:54.385159    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cm65t" podUID="f6ae72be-9753-46d1-a665-c2124741a26a"
Jul 06 23:55:54.385488 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:54.385193    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g45vp"
Jul 06 23:55:54.385488 ip-10-0-129-23 kubenswrapper[2578]: E0706 23:55:54.385304    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g45vp" podUID="ed50a99b-7856-44b3-bb1a-12f8b25546b9"
Jul 06 23:55:55.385092 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:55.385054    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sqcsc"
Jul 06 23:55:55.385501 ip-10-0-129-23 kubenswrapper[2578]: E0706 23:55:55.385177    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sqcsc" podUID="7db1fb04-9b13-425c-abb1-05f4274fe959"
Jul 06 23:55:56.384355 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:56.384331    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g45vp"
Jul 06 23:55:56.384562 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:56.384331    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cm65t"
Jul 06 23:55:56.384562 ip-10-0-129-23 kubenswrapper[2578]: E0706 23:55:56.384434    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g45vp" podUID="ed50a99b-7856-44b3-bb1a-12f8b25546b9"
Jul 06 23:55:56.384562 ip-10-0-129-23 kubenswrapper[2578]: E0706 23:55:56.384509    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cm65t" podUID="f6ae72be-9753-46d1-a665-c2124741a26a"
Jul 06 23:55:56.792254 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:56.792229    2578 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 06 23:55:57.354898 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:57.354567    2578 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-06T23:55:56.792250037Z","UUID":"6c407777-9ac1-4155-89b9-c3540a871449","Handler":null,"Name":"","Endpoint":""}
Jul 06 23:55:57.356109 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:57.356090    2578 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 06 23:55:57.356216 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:57.356120    2578 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 06 23:55:57.384499 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:57.384472    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sqcsc"
Jul 06 23:55:57.384597 ip-10-0-129-23 kubenswrapper[2578]: E0706 23:55:57.384562    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sqcsc" podUID="7db1fb04-9b13-425c-abb1-05f4274fe959"
Jul 06 23:55:57.625173 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:57.625095    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4hfmp" event={"ID":"4e757f80-3ca9-43c3-9e22-224374be02d8","Type":"ContainerStarted","Data":"b5bf92470faca2c13decfbf75893f4b1b193f22c4f0a8cbde6de3e63710e2b5a"}
Jul 06 23:55:57.626955 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:57.626924    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-gk9q8" event={"ID":"3afd5761-b4ad-4002-b9e7-d646b63d53f0","Type":"ContainerStarted","Data":"d613e2477b21131f434e0afdff0535b6bb434a17f0d83b702abcf9668192c922"}
Jul 06 23:55:57.630462 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:57.630438    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jfngf_aba6ad45-845e-4916-8cf1-b8c76da93308/ovn-acl-logging/0.log"
Jul 06 23:55:57.630874 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:57.630848    2578 generic.go:356] "Generic (PLEG): container finished" podID="aba6ad45-845e-4916-8cf1-b8c76da93308" containerID="1c8f73d63f20929eb944ac0748e09e926c7cd67016fe15cbf7d738d6d14d80c1" exitCode=1
Jul 06 23:55:57.630976 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:57.630904    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jfngf" event={"ID":"aba6ad45-845e-4916-8cf1-b8c76da93308","Type":"ContainerStarted","Data":"66255bba2ab620545ebfb4a9df35ee20466202e5f2f6768e0a05913978fc20a9"}
Jul 06 23:55:57.630976 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:57.630970    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jfngf" event={"ID":"aba6ad45-845e-4916-8cf1-b8c76da93308","Type":"ContainerStarted","Data":"3cf7cda94a56840071605da721c8ad4b259e44dab82e45686d90602e51efe608"}
Jul 06 23:55:57.631052 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:57.631014    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jfngf" event={"ID":"aba6ad45-845e-4916-8cf1-b8c76da93308","Type":"ContainerStarted","Data":"8d06b569c8571a88ec7fd7bb467f180d69d003947f4c6f8121eabbc6cc13260b"}
Jul 06 23:55:57.631052 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:57.631042    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jfngf" event={"ID":"aba6ad45-845e-4916-8cf1-b8c76da93308","Type":"ContainerStarted","Data":"0e3a40d42b98e432ff4d952b405beeabed08cc8acf26411a31d2ce660eb32220"}
Jul 06 23:55:57.631150 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:57.631087    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jfngf" event={"ID":"aba6ad45-845e-4916-8cf1-b8c76da93308","Type":"ContainerDied","Data":"1c8f73d63f20929eb944ac0748e09e926c7cd67016fe15cbf7d738d6d14d80c1"}
Jul 06 23:55:57.631150 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:57.631120    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jfngf" event={"ID":"aba6ad45-845e-4916-8cf1-b8c76da93308","Type":"ContainerStarted","Data":"8c20109486ec07aa949880964abf06422a6da11edc2281365ef92c82f639185b"}
Jul 06 23:55:57.645922 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:57.645879    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-gk9q8" podStartSLOduration=4.600214954 podStartE2EDuration="23.645868467s" totalImagesPullingTime="19.045653513s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 23:55:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:55:57.645577805 +0000 UTC m=+23.756651608" watchObservedRunningTime="2026-07-06 23:55:57.645868467 +0000 UTC m=+23.756942269"
Jul 06 23:55:58.384827 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:58.384797    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cm65t"
Jul 06 23:55:58.385627 ip-10-0-129-23 kubenswrapper[2578]: E0706 23:55:58.384886    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cm65t" podUID="f6ae72be-9753-46d1-a665-c2124741a26a"
Jul 06 23:55:58.385627 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:58.384932    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g45vp"
Jul 06 23:55:58.385627 ip-10-0-129-23 kubenswrapper[2578]: E0706 23:55:58.384985    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g45vp" podUID="ed50a99b-7856-44b3-bb1a-12f8b25546b9"
Jul 06 23:55:58.634876 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:58.634793    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4hfmp" event={"ID":"4e757f80-3ca9-43c3-9e22-224374be02d8","Type":"ContainerStarted","Data":"13d15f2f4b229188575c018e5454134013d829ab87d5ff09fff4402ad173b7c0"}
Jul 06 23:55:59.384881 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:59.384854    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sqcsc"
Jul 06 23:55:59.385213 ip-10-0-129-23 kubenswrapper[2578]: E0706 23:55:59.384944    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sqcsc" podUID="7db1fb04-9b13-425c-abb1-05f4274fe959"
Jul 06 23:55:59.639847 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:59.639786    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jfngf_aba6ad45-845e-4916-8cf1-b8c76da93308/ovn-acl-logging/0.log"
Jul 06 23:55:59.640197 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:55:59.640171    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jfngf" event={"ID":"aba6ad45-845e-4916-8cf1-b8c76da93308","Type":"ContainerStarted","Data":"25838f0c78c6e577062aa76ea05a065f4fa7e560577265515452d2eb4b7a0845"}
Jul 06 23:56:00.388505 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:00.388476    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g45vp"
Jul 06 23:56:00.388891 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:00.388514    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cm65t"
Jul 06 23:56:00.388891 ip-10-0-129-23 kubenswrapper[2578]: E0706 23:56:00.388585    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g45vp" podUID="ed50a99b-7856-44b3-bb1a-12f8b25546b9"
Jul 06 23:56:00.388891 ip-10-0-129-23 kubenswrapper[2578]: E0706 23:56:00.388719    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cm65t" podUID="f6ae72be-9753-46d1-a665-c2124741a26a"
Jul 06 23:56:01.384271 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:01.384241    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sqcsc"
Jul 06 23:56:01.384449 ip-10-0-129-23 kubenswrapper[2578]: E0706 23:56:01.384368    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sqcsc" podUID="7db1fb04-9b13-425c-abb1-05f4274fe959"
Jul 06 23:56:02.387873 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:02.387754    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g45vp"
Jul 06 23:56:02.388136 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:02.387762    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cm65t"
Jul 06 23:56:02.388136 ip-10-0-129-23 kubenswrapper[2578]: E0706 23:56:02.387948    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g45vp" podUID="ed50a99b-7856-44b3-bb1a-12f8b25546b9"
Jul 06 23:56:02.388136 ip-10-0-129-23 kubenswrapper[2578]: E0706 23:56:02.388029    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cm65t" podUID="f6ae72be-9753-46d1-a665-c2124741a26a"
Jul 06 23:56:02.649766 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:02.649748    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jfngf_aba6ad45-845e-4916-8cf1-b8c76da93308/ovn-acl-logging/0.log"
Jul 06 23:56:02.651148 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:02.650153    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jfngf" event={"ID":"aba6ad45-845e-4916-8cf1-b8c76da93308","Type":"ContainerStarted","Data":"296e92e15889321d37d6e93b3efaa6f44d50c1e1906a583fcee1c43d3f7031e3"}
Jul 06 23:56:02.651148 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:02.650675    2578 scope.go:117] "RemoveContainer" containerID="1c8f73d63f20929eb944ac0748e09e926c7cd67016fe15cbf7d738d6d14d80c1"
Jul 06 23:56:02.654195 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:02.651640    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-jfngf"
Jul 06 23:56:02.654195 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:02.651874    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-jfngf"
Jul 06 23:56:02.654195 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:02.651944    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-jfngf"
Jul 06 23:56:02.675665 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:02.675589    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-jfngf"
Jul 06 23:56:02.675996 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:02.675976    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-jfngf"
Jul 06 23:56:02.687485 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:02.687445    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4hfmp" podStartSLOduration=8.604403396 podStartE2EDuration="28.6874282s" totalImagesPullingTime="20.083024804s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 23:55:34 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:55:58.651451378 +0000 UTC m=+24.762525181" watchObservedRunningTime="2026-07-06 23:56:02.6874282 +0000 UTC m=+28.798502004"
Jul 06 23:56:03.384473 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:03.384451    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sqcsc"
Jul 06 23:56:03.384622 ip-10-0-129-23 kubenswrapper[2578]: E0706 23:56:03.384531    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sqcsc" podUID="7db1fb04-9b13-425c-abb1-05f4274fe959"
Jul 06 23:56:03.657034 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:03.657010    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jfngf_aba6ad45-845e-4916-8cf1-b8c76da93308/ovn-acl-logging/0.log"
Jul 06 23:56:03.657613 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:03.657472    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jfngf" event={"ID":"aba6ad45-845e-4916-8cf1-b8c76da93308","Type":"ContainerStarted","Data":"ad8aa240fe7874ec5f1e17e870805c24581d31902ddb4478b5b76778e45559e0"}
Jul 06 23:56:03.660313 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:03.660268    2578 generic.go:356] "Generic (PLEG): container finished" podID="b9a2aa01-bfc8-40f8-b4d7-962428e95667" containerID="b82de8877a7aa6cfaef9c86002b3f5053069cbe62162f319a2dd2e574afb2a6f" exitCode=0
Jul 06 23:56:03.660433 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:03.660335    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kmhhp" event={"ID":"b9a2aa01-bfc8-40f8-b4d7-962428e95667","Type":"ContainerDied","Data":"b82de8877a7aa6cfaef9c86002b3f5053069cbe62162f319a2dd2e574afb2a6f"}
Jul 06 23:56:03.696561 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:03.696519    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-jfngf" podStartSLOduration=10.613512107 podStartE2EDuration="29.696506286s" totalImagesPullingTime="19.082994179s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 23:55:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:56:03.694718144 +0000 UTC m=+29.805791946" watchObservedRunningTime="2026-07-06 23:56:03.696506286 +0000 UTC m=+29.807580088"
Jul 06 23:56:04.318674 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:04.318643    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-sqcsc"]
Jul 06 23:56:04.318856 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:04.318795    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sqcsc"
Jul 06 23:56:04.318923 ip-10-0-129-23 kubenswrapper[2578]: E0706 23:56:04.318891    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sqcsc" podUID="7db1fb04-9b13-425c-abb1-05f4274fe959"
Jul 06 23:56:04.322893 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:04.322867    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-cm65t"]
Jul 06 23:56:04.323018 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:04.322976    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cm65t"
Jul 06 23:56:04.323102 ip-10-0-129-23 kubenswrapper[2578]: E0706 23:56:04.323082    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cm65t" podUID="f6ae72be-9753-46d1-a665-c2124741a26a"
Jul 06 23:56:04.323776 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:04.323752    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-g45vp"]
Jul 06 23:56:04.323882 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:04.323870    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g45vp"
Jul 06 23:56:04.324321 ip-10-0-129-23 kubenswrapper[2578]: E0706 23:56:04.323998    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g45vp" podUID="ed50a99b-7856-44b3-bb1a-12f8b25546b9"
Jul 06 23:56:05.385181 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:05.384986    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cm65t"
Jul 06 23:56:05.385521 ip-10-0-129-23 kubenswrapper[2578]: E0706 23:56:05.385221    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cm65t" podUID="f6ae72be-9753-46d1-a665-c2124741a26a"
Jul 06 23:56:05.666514 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:05.666489    2578 generic.go:356] "Generic (PLEG): container finished" podID="b9a2aa01-bfc8-40f8-b4d7-962428e95667" containerID="1c5ededfd2cb0a09474fa03abcba0b8adc41819b174323e3eff478f31759d165" exitCode=0
Jul 06 23:56:05.666633 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:05.666536    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kmhhp" event={"ID":"b9a2aa01-bfc8-40f8-b4d7-962428e95667","Type":"ContainerDied","Data":"1c5ededfd2cb0a09474fa03abcba0b8adc41819b174323e3eff478f31759d165"}
Jul 06 23:56:06.385138 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:06.385069    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g45vp"
Jul 06 23:56:06.385268 ip-10-0-129-23 kubenswrapper[2578]: E0706 23:56:06.385180    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g45vp" podUID="ed50a99b-7856-44b3-bb1a-12f8b25546b9"
Jul 06 23:56:06.385268 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:06.385222    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sqcsc"
Jul 06 23:56:06.385850 ip-10-0-129-23 kubenswrapper[2578]: E0706 23:56:06.385313    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sqcsc" podUID="7db1fb04-9b13-425c-abb1-05f4274fe959"
Jul 06 23:56:07.384885 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:07.384860    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cm65t"
Jul 06 23:56:07.384989 ip-10-0-129-23 kubenswrapper[2578]: E0706 23:56:07.384944    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cm65t" podUID="f6ae72be-9753-46d1-a665-c2124741a26a"
Jul 06 23:56:07.673667 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:07.673644    2578 generic.go:356] "Generic (PLEG): container finished" podID="b9a2aa01-bfc8-40f8-b4d7-962428e95667" containerID="e7fc6c4c7f6c47272f9558d503c9d74136659bf55459bc133a462229f488a25c" exitCode=0
Jul 06 23:56:07.674019 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:07.673683    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kmhhp" event={"ID":"b9a2aa01-bfc8-40f8-b4d7-962428e95667","Type":"ContainerDied","Data":"e7fc6c4c7f6c47272f9558d503c9d74136659bf55459bc133a462229f488a25c"}
Jul 06 23:56:08.062804 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:08.062752    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ed50a99b-7856-44b3-bb1a-12f8b25546b9-metrics-certs\") pod \"network-metrics-daemon-g45vp\" (UID: \"ed50a99b-7856-44b3-bb1a-12f8b25546b9\") " pod="openshift-multus/network-metrics-daemon-g45vp"
Jul 06 23:56:08.062897 ip-10-0-129-23 kubenswrapper[2578]: E0706 23:56:08.062846    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 23:56:08.062897 ip-10-0-129-23 kubenswrapper[2578]: E0706 23:56:08.062886    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ed50a99b-7856-44b3-bb1a-12f8b25546b9-metrics-certs podName:ed50a99b-7856-44b3-bb1a-12f8b25546b9 nodeName:}" failed. No retries permitted until 2026-07-06 23:56:40.062874351 +0000 UTC m=+66.173948132 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ed50a99b-7856-44b3-bb1a-12f8b25546b9-metrics-certs") pod "network-metrics-daemon-g45vp" (UID: "ed50a99b-7856-44b3-bb1a-12f8b25546b9") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 23:56:08.163515 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:08.163490    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wm5xx\" (UniqueName: \"kubernetes.io/projected/7db1fb04-9b13-425c-abb1-05f4274fe959-kube-api-access-wm5xx\") pod \"network-check-target-sqcsc\" (UID: \"7db1fb04-9b13-425c-abb1-05f4274fe959\") " pod="openshift-network-diagnostics/network-check-target-sqcsc"
Jul 06 23:56:08.163599 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:08.163542    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f6ae72be-9753-46d1-a665-c2124741a26a-original-pull-secret\") pod \"global-pull-secret-syncer-cm65t\" (UID: \"f6ae72be-9753-46d1-a665-c2124741a26a\") " pod="kube-system/global-pull-secret-syncer-cm65t"
Jul 06 23:56:08.163646 ip-10-0-129-23 kubenswrapper[2578]: E0706 23:56:08.163607    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 23:56:08.163646 ip-10-0-129-23 kubenswrapper[2578]: E0706 23:56:08.163626    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 23:56:08.163646 ip-10-0-129-23 kubenswrapper[2578]: E0706 23:56:08.163643    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 23:56:08.163741 ip-10-0-129-23 kubenswrapper[2578]: E0706 23:56:08.163649    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f6ae72be-9753-46d1-a665-c2124741a26a-original-pull-secret podName:f6ae72be-9753-46d1-a665-c2124741a26a nodeName:}" failed. No retries permitted until 2026-07-06 23:56:40.163635017 +0000 UTC m=+66.274708798 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f6ae72be-9753-46d1-a665-c2124741a26a-original-pull-secret") pod "global-pull-secret-syncer-cm65t" (UID: "f6ae72be-9753-46d1-a665-c2124741a26a") : object "kube-system"/"original-pull-secret" not registered
Jul 06 23:56:08.163741 ip-10-0-129-23 kubenswrapper[2578]: E0706 23:56:08.163651    2578 projected.go:196] Error preparing data for projected volume kube-api-access-wm5xx for pod openshift-network-diagnostics/network-check-target-sqcsc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 23:56:08.163741 ip-10-0-129-23 kubenswrapper[2578]: E0706 23:56:08.163696    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7db1fb04-9b13-425c-abb1-05f4274fe959-kube-api-access-wm5xx podName:7db1fb04-9b13-425c-abb1-05f4274fe959 nodeName:}" failed. No retries permitted until 2026-07-06 23:56:40.16368582 +0000 UTC m=+66.274759605 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-wm5xx" (UniqueName: "kubernetes.io/projected/7db1fb04-9b13-425c-abb1-05f4274fe959-kube-api-access-wm5xx") pod "network-check-target-sqcsc" (UID: "7db1fb04-9b13-425c-abb1-05f4274fe959") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 23:56:08.384405 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:08.384266    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g45vp"
Jul 06 23:56:08.384523 ip-10-0-129-23 kubenswrapper[2578]: E0706 23:56:08.384416    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g45vp" podUID="ed50a99b-7856-44b3-bb1a-12f8b25546b9"
Jul 06 23:56:08.384611 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:08.384268    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sqcsc"
Jul 06 23:56:08.384815 ip-10-0-129-23 kubenswrapper[2578]: E0706 23:56:08.384786    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sqcsc" podUID="7db1fb04-9b13-425c-abb1-05f4274fe959"
Jul 06 23:56:09.239920 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:09.239862    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-23.ec2.internal" event="NodeReady"
Jul 06 23:56:09.240222 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:09.239952    2578 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 06 23:56:09.275425 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:09.275404    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-rzrpw"]
Jul 06 23:56:09.278495 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:09.278476    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-rzrpw"
Jul 06 23:56:09.280551 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:09.279701    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6d5ddc46dd-hpvrn"]
Jul 06 23:56:09.284431 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:09.284409    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 06 23:56:09.285121 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:09.284689    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 06 23:56:09.285205 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:09.285137    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-7t4mh\""
Jul 06 23:56:09.285588 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:09.285571    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Jul 06 23:56:09.286083 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:09.286064    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Jul 06 23:56:09.286667 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:09.286653    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-d5dmf"]
Jul 06 23:56:09.286785 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:09.286771    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6d5ddc46dd-hpvrn"
Jul 06 23:56:09.290431 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:09.290414    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-g68bw\""
Jul 06 23:56:09.290523 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:09.290450    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-ff7bb96c-8p6lk"]
Jul 06 23:56:09.290589 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:09.290555    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-d5dmf"
Jul 06 23:56:09.290924 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:09.290908    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 06 23:56:09.291005 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:09.290965    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 06 23:56:09.291077 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:09.291010    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 06 23:56:09.293062 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:09.293048    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Jul 06 23:56:09.293259 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:09.293243    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-cl7lm\""
Jul 06 23:56:09.293866 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:09.293847    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Jul 06 23:56:09.293949 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:09.293847    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Jul 06 23:56:09.293949 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:09.293916    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-k2rvp"]
Jul 06 23:56:09.294103 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:09.294084    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-ff7bb96c-8p6lk"
Jul 06 23:56:09.297089 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:09.297074    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-jvf67"]
Jul 06 23:56:09.297194 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:09.297182    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-k2rvp"
Jul 06 23:56:09.300579 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:09.300559    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-rx7w7"]
Jul 06 23:56:09.300753 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:09.300737    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5c847dcfc4-jvf67"
Jul 06 23:56:09.301784 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:09.301768    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-kmjrl\""
Jul 06 23:56:09.301878 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:09.301766    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Jul 06 23:56:09.303331 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:09.302074    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Jul 06 23:56:09.303331 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:09.302150    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Jul 06 23:56:09.303331 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:09.302075    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 06 23:56:09.303331 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:09.302081    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 06 23:56:09.303331 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:09.302465    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Jul 06 23:56:09.303331 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:09.302679    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Jul 06 23:56:09.303331 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:09.302786    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-dhcck\""
Jul 06 23:56:09.303331 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:09.302853    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Jul 06 23:56:09.305012 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:09.304995    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 06 23:56:09.306371 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:09.305418    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-fzzq2"]
Jul 06 23:56:09.306371 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:09.305524    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Jul 06 23:56:09.306371 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:09.306020    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-rx7w7"
Jul 06 23:56:09.307103 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:09.306905    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Jul 06 23:56:09.307103 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:09.307001    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-n9xfm\""
Jul 06 23:56:09.307103 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:09.306913    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 06 23:56:09.308613 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:09.308593    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 06 23:56:09.309048 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:09.309032    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-7gjwb"]
Jul 06 23:56:09.309218 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:09.309200    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-fzzq2"
Jul 06 23:56:09.311982 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:09.311960    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Jul 06 23:56:09.312063 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:09.312006    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Jul 06 23:56:09.312397 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:09.312379    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-bkm29\""
Jul 06 23:56:09.314480 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:09.314463    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Jul 06 23:56:09.315323 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:09.312453    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Jul 06 23:56:09.315412 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:09.314075    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Jul 06 23:56:09.315552 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:09.312373    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Jul 06 23:56:09.315624 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:09.314532    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Jul 06 23:56:09.315624 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:09.314614    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Jul 06 23:56:09.315714 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:09.314656    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-8t877\""
Jul 06 23:56:09.315758 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:09.314725    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Jul 06 23:56:09.315803 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:09.315195    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-rzrpw"]
Jul 06 23:56:09.315853 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:09.315829    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-d5dmf"]
Jul 06 23:56:09.315901 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:09.315859    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-tp5dt"]
Jul 06 23:56:09.315901 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:09.315252    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-68b757fb67-7gjwb"
Jul 06 23:56:09.319408 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:09.319387    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-jvf67"]
Jul 06 23:56:09.319594 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:09.319482    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-tp5dt"
Jul 06 23:56:09.319594 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:09.319485    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Jul 06 23:56:09.319927 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:09.319885    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Jul 06 23:56:09.320159 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:09.320145    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Jul 06 23:56:09.321682 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:09.321663    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Jul 06 23:56:09.322562 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:09.322526    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-f2xzn"]
Jul 06 23:56:09.323349 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:09.323012    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 06 23:56:09.323426 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:09.323389    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 06 23:56:09.324430 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:09.324412    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-7t8p8\""
Jul 06 23:56:09.324760 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:09.324743    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-v7r6x\""
Jul 06 23:56:09.331135 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:09.331114    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-k2rvp"]
Jul 06 23:56:09.331218 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:09.331148    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-fzzq2"]
Jul 06 23:56:09.331218 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:09.331169    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6d5ddc46dd-hpvrn"]
Jul 06 23:56:09.331218 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:09.331189    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-g7n6m"]
Jul 06 23:56:09.331559 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:09.331544    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-f2xzn"
Jul 06 23:56:09.335262 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:09.335246    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Jul 06 23:56:09.335594 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:09.335550    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-km2h9\""
Jul 06 23:56:09.335969 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:09.335954    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Jul 06 23:56:09.336404 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:09.336383    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-ff7bb96c-8p6lk"]
Jul 06 23:56:09.336471 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:09.336412    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-tp5dt"]
Jul 06 23:56:09.336471 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:09.336429    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-d7x6n"]
Jul 06 23:56:09.336471 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:09.336455    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Jul 06 23:56:09.336771 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:09.336753    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-g7n6m"
Jul 06 23:56:09.338759 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:09.338740    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 06 23:56:09.339336 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:09.339321    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-lhsfz\""
Jul 06 23:56:09.339465 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:09.339412    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 06 23:56:09.339616 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:09.339593    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-7gjwb"]
Jul 06 23:56:09.339712 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:09.339689    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-d7x6n"
Jul 06 23:56:09.342260 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:09.342242    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 06 23:56:09.342526 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:09.342508    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 06 23:56:09.342641 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:09.342586    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-wljwx\""
Jul 06 23:56:09.342820 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:09.342793    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 06 23:56:09.345747 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:09.345723    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-d7x6n"]
Jul 06 23:56:09.348186 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:09.348167    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-rx7w7"]
Jul 06 23:56:09.348837 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:09.348818    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-f2xzn"]
Jul 06 23:56:09.349408 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:09.349394    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-g7n6m"]
Jul 06 23:56:09.374213 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:09.374186    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/2a199158-37fe-4467-ae56-2268721f790e-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-rzrpw\" (UID: \"2a199158-37fe-4467-ae56-2268721f790e\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-rzrpw"
Jul 06 23:56:09.374319 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:09.374248    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/2a199158-37fe-4467-ae56-2268721f790e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-rzrpw\" (UID: \"2a199158-37fe-4467-ae56-2268721f790e\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-rzrpw"
Jul 06 23:56:09.374391 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:09.374328    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bn87v\" (UniqueName: \"kubernetes.io/projected/2a199158-37fe-4467-ae56-2268721f790e-kube-api-access-bn87v\") pod \"cluster-monitoring-operator-64786d9cbb-rzrpw\" (UID: \"2a199158-37fe-4467-ae56-2268721f790e\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-rzrpw"
Jul 06 23:56:09.384231 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:09.384215    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cm65t"
Jul 06 23:56:09.386881 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:09.386865    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 06 23:56:09.474647 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:09.474622    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e2139ac9-3d13-4d35-8344-b94be920985a-installation-pull-secrets\") pod \"image-registry-6d5ddc46dd-hpvrn\" (UID: \"e2139ac9-3d13-4d35-8344-b94be920985a\") " pod="openshift-image-registry/image-registry-6d5ddc46dd-hpvrn"
Jul 06 23:56:09.474747 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:09.474650    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rnw8n\" (UniqueName: \"kubernetes.io/projected/38b01eb6-03b7-4fe6-803c-e7cfb4d355a9-kube-api-access-rnw8n\") pod \"insights-operator-5c847dcfc4-jvf67\" (UID: \"38b01eb6-03b7-4fe6-803c-e7cfb4d355a9\") " pod="openshift-insights/insights-operator-5c847dcfc4-jvf67"
Jul 06 23:56:09.474747 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:09.474672    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5cx6k\" (UniqueName: \"kubernetes.io/projected/e2139ac9-3d13-4d35-8344-b94be920985a-kube-api-access-5cx6k\") pod \"image-registry-6d5ddc46dd-hpvrn\" (UID: \"e2139ac9-3d13-4d35-8344-b94be920985a\") " pod="openshift-image-registry/image-registry-6d5ddc46dd-hpvrn"
Jul 06 23:56:09.474747 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:09.474698    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/38b01eb6-03b7-4fe6-803c-e7cfb4d355a9-tmp\") pod \"insights-operator-5c847dcfc4-jvf67\" (UID: \"38b01eb6-03b7-4fe6-803c-e7cfb4d355a9\") " pod="openshift-insights/insights-operator-5c847dcfc4-jvf67"
Jul 06 23:56:09.474747 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:09.474719    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xknk5\" (UniqueName: \"kubernetes.io/projected/2e2aa079-1812-4f96-a29d-3926a0fb14e5-kube-api-access-xknk5\") pod \"network-check-source-989f8b8dc-tp5dt\" (UID: \"2e2aa079-1812-4f96-a29d-3926a0fb14e5\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-tp5dt"
Jul 06 23:56:09.474747 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:09.474734    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e2139ac9-3d13-4d35-8344-b94be920985a-trusted-ca\") pod \"image-registry-6d5ddc46dd-hpvrn\" (UID: \"e2139ac9-3d13-4d35-8344-b94be920985a\") " pod="openshift-image-registry/image-registry-6d5ddc46dd-hpvrn"
Jul 06 23:56:09.474924 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:09.474752    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0aaa04d0-1e6e-42c1-887b-bb6b96c8ea4a-service-ca-bundle\") pod \"router-default-ff7bb96c-8p6lk\" (UID: \"0aaa04d0-1e6e-42c1-887b-bb6b96c8ea4a\") " pod="openshift-ingress/router-default-ff7bb96c-8p6lk"
Jul 06 23:56:09.474924 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:09.474799    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/38b01eb6-03b7-4fe6-803c-e7cfb4d355a9-snapshots\") pod \"insights-operator-5c847dcfc4-jvf67\" (UID: \"38b01eb6-03b7-4fe6-803c-e7cfb4d355a9\") " pod="openshift-insights/insights-operator-5c847dcfc4-jvf67"
Jul 06 23:56:09.474924 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:09.474825    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1116f765-1ebd-4c12-9ebb-ed7b7760391c-config\") pod \"console-operator-68b757fb67-7gjwb\" (UID: \"1116f765-1ebd-4c12-9ebb-ed7b7760391c\") " pod="openshift-console-operator/console-operator-68b757fb67-7gjwb"
Jul 06 23:56:09.474924 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:09.474839    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1116f765-1ebd-4c12-9ebb-ed7b7760391c-serving-cert\") pod \"console-operator-68b757fb67-7gjwb\" (UID: \"1116f765-1ebd-4c12-9ebb-ed7b7760391c\") " pod="openshift-console-operator/console-operator-68b757fb67-7gjwb"
Jul 06 23:56:09.474924 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:09.474862    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/38b01eb6-03b7-4fe6-803c-e7cfb4d355a9-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-jvf67\" (UID: \"38b01eb6-03b7-4fe6-803c-e7cfb4d355a9\") " pod="openshift-insights/insights-operator-5c847dcfc4-jvf67"
Jul 06 23:56:09.475118 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:09.474920    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f5691201-8c3c-4bd5-8fbb-41e8ddd87e4e-cert\") pod \"ingress-canary-d7x6n\" (UID: \"f5691201-8c3c-4bd5-8fbb-41e8ddd87e4e\") " pod="openshift-ingress-canary/ingress-canary-d7x6n"
Jul 06 23:56:09.475118 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:09.474964    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/2a199158-37fe-4467-ae56-2268721f790e-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-rzrpw\" (UID: \"2a199158-37fe-4467-ae56-2268721f790e\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-rzrpw"
Jul 06 23:56:09.475118 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:09.474993    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/0aaa04d0-1e6e-42c1-887b-bb6b96c8ea4a-stats-auth\") pod \"router-default-ff7bb96c-8p6lk\" (UID: \"0aaa04d0-1e6e-42c1-887b-bb6b96c8ea4a\") " pod="openshift-ingress/router-default-ff7bb96c-8p6lk"
Jul 06 23:56:09.475118 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:09.475021    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5dbm9\" (UniqueName: \"kubernetes.io/projected/f5691201-8c3c-4bd5-8fbb-41e8ddd87e4e-kube-api-access-5dbm9\") pod \"ingress-canary-d7x6n\" (UID: \"f5691201-8c3c-4bd5-8fbb-41e8ddd87e4e\") " pod="openshift-ingress-canary/ingress-canary-d7x6n"
Jul 06 23:56:09.475118 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:09.475053    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qfhmk\" (UniqueName: \"kubernetes.io/projected/4e16f8f2-9fde-4234-9392-e1465eebb6e0-kube-api-access-qfhmk\") pod \"cluster-samples-operator-56fcf86bf-d5dmf\" (UID: \"4e16f8f2-9fde-4234-9392-e1465eebb6e0\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-d5dmf"
Jul 06 23:56:09.475118 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:09.475078    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d99nh\" (UniqueName: \"kubernetes.io/projected/0aaa04d0-1e6e-42c1-887b-bb6b96c8ea4a-kube-api-access-d99nh\") pod \"router-default-ff7bb96c-8p6lk\" (UID: \"0aaa04d0-1e6e-42c1-887b-bb6b96c8ea4a\") " pod="openshift-ingress/router-default-ff7bb96c-8p6lk"
Jul 06 23:56:09.475118 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:09.475106    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/dff531e0-34c6-4281-8705-149154c350e7-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-fzzq2\" (UID: \"dff531e0-34c6-4281-8705-149154c350e7\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-fzzq2"
Jul 06 23:56:09.475369 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:09.475129    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ggtsh\" (UniqueName: \"kubernetes.io/projected/eef5edeb-c57a-4632-8215-ced4738392a8-kube-api-access-ggtsh\") pod \"volume-data-source-validator-5d456fdbcd-k2rvp\" (UID: \"eef5edeb-c57a-4632-8215-ced4738392a8\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-k2rvp"
Jul 06 23:56:09.475369 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:09.475170    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7631f141-62e9-410a-ba79-c1bdcad24e4e-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-f2xzn\" (UID: \"7631f141-62e9-410a-ba79-c1bdcad24e4e\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-f2xzn"
Jul 06 23:56:09.475369 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:09.475199    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dd5b072f-a02f-482e-abd1-5dd590d0a93c-metrics-tls\") pod \"dns-default-g7n6m\" (UID: \"dd5b072f-a02f-482e-abd1-5dd590d0a93c\") " pod="openshift-dns/dns-default-g7n6m"
Jul 06 23:56:09.475369 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:09.475224    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e2139ac9-3d13-4d35-8344-b94be920985a-image-registry-private-configuration\") pod \"image-registry-6d5ddc46dd-hpvrn\" (UID: \"e2139ac9-3d13-4d35-8344-b94be920985a\") " pod="openshift-image-registry/image-registry-6d5ddc46dd-hpvrn"
Jul 06 23:56:09.475369 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:09.475273    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/7631f141-62e9-410a-ba79-c1bdcad24e4e-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-f2xzn\" (UID: \"7631f141-62e9-410a-ba79-c1bdcad24e4e\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-f2xzn"
Jul 06 23:56:09.475369 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:09.475314    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/0aaa04d0-1e6e-42c1-887b-bb6b96c8ea4a-default-certificate\") pod \"router-default-ff7bb96c-8p6lk\" (UID: \"0aaa04d0-1e6e-42c1-887b-bb6b96c8ea4a\") " pod="openshift-ingress/router-default-ff7bb96c-8p6lk"
Jul 06 23:56:09.475369 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:09.475342    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/67c209fe-6215-4191-adfb-81d0bcc8e4bd-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-rx7w7\" (UID: \"67c209fe-6215-4191-adfb-81d0bcc8e4bd\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-rx7w7"
Jul 06 23:56:09.475369 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:09.475365    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0aaa04d0-1e6e-42c1-887b-bb6b96c8ea4a-metrics-certs\") pod \"router-default-ff7bb96c-8p6lk\" (UID: \"0aaa04d0-1e6e-42c1-887b-bb6b96c8ea4a\") " pod="openshift-ingress/router-default-ff7bb96c-8p6lk"
Jul 06 23:56:09.475628 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:09.475387    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/38b01eb6-03b7-4fe6-803c-e7cfb4d355a9-serving-cert\") pod \"insights-operator-5c847dcfc4-jvf67\" (UID: \"38b01eb6-03b7-4fe6-803c-e7cfb4d355a9\") " pod="openshift-insights/insights-operator-5c847dcfc4-jvf67"
Jul 06 23:56:09.475628 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:09.475460    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/67c209fe-6215-4191-adfb-81d0bcc8e4bd-config\") pod \"service-ca-operator-5d46d9ffd4-rx7w7\" (UID: \"67c209fe-6215-4191-adfb-81d0bcc8e4bd\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-rx7w7"
Jul 06 23:56:09.475628 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:09.475490    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h2dq5\" (UniqueName: \"kubernetes.io/projected/1116f765-1ebd-4c12-9ebb-ed7b7760391c-kube-api-access-h2dq5\") pod \"console-operator-68b757fb67-7gjwb\" (UID: \"1116f765-1ebd-4c12-9ebb-ed7b7760391c\") " pod="openshift-console-operator/console-operator-68b757fb67-7gjwb"
Jul 06 23:56:09.475628 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:09.475513    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e2139ac9-3d13-4d35-8344-b94be920985a-bound-sa-token\") pod \"image-registry-6d5ddc46dd-hpvrn\" (UID: \"e2139ac9-3d13-4d35-8344-b94be920985a\") " pod="openshift-image-registry/image-registry-6d5ddc46dd-hpvrn"
Jul 06 23:56:09.475628 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:09.475537    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vnnq8\" (UniqueName: \"kubernetes.io/projected/dff531e0-34c6-4281-8705-149154c350e7-kube-api-access-vnnq8\") pod \"kube-storage-version-migrator-operator-846bf668f7-fzzq2\" (UID: \"dff531e0-34c6-4281-8705-149154c350e7\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-fzzq2"
Jul 06 23:56:09.475628 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:09.475560    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/dd5b072f-a02f-482e-abd1-5dd590d0a93c-config-volume\") pod \"dns-default-g7n6m\" (UID: \"dd5b072f-a02f-482e-abd1-5dd590d0a93c\") " pod="openshift-dns/dns-default-g7n6m"
Jul 06 23:56:09.475628 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:09.475596    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dd5b072f-a02f-482e-abd1-5dd590d0a93c-tmp-dir\") pod \"dns-default-g7n6m\" (UID: \"dd5b072f-a02f-482e-abd1-5dd590d0a93c\") " pod="openshift-dns/dns-default-g7n6m"
Jul 06 23:56:09.475909 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:09.475636    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e2139ac9-3d13-4d35-8344-b94be920985a-registry-certificates\") pod \"image-registry-6d5ddc46dd-hpvrn\" (UID: \"e2139ac9-3d13-4d35-8344-b94be920985a\") " pod="openshift-image-registry/image-registry-6d5ddc46dd-hpvrn"
Jul 06 23:56:09.475909 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:09.475670    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6nh47\" (UniqueName: \"kubernetes.io/projected/67c209fe-6215-4191-adfb-81d0bcc8e4bd-kube-api-access-6nh47\") pod \"service-ca-operator-5d46d9ffd4-rx7w7\" (UID: \"67c209fe-6215-4191-adfb-81d0bcc8e4bd\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-rx7w7"
Jul 06 23:56:09.475909 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:09.475692    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e2139ac9-3d13-4d35-8344-b94be920985a-registry-tls\") pod \"image-registry-6d5ddc46dd-hpvrn\" (UID: \"e2139ac9-3d13-4d35-8344-b94be920985a\") " pod="openshift-image-registry/image-registry-6d5ddc46dd-hpvrn"
Jul 06 23:56:09.475909 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:09.475718    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/dff531e0-34c6-4281-8705-149154c350e7-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-fzzq2\" (UID: \"dff531e0-34c6-4281-8705-149154c350e7\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-fzzq2"
Jul 06 23:56:09.475909 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:09.475741    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/38b01eb6-03b7-4fe6-803c-e7cfb4d355a9-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-jvf67\" (UID: \"38b01eb6-03b7-4fe6-803c-e7cfb4d355a9\") " pod="openshift-insights/insights-operator-5c847dcfc4-jvf67"
Jul 06 23:56:09.475909 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:09.475758    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/2a199158-37fe-4467-ae56-2268721f790e-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-rzrpw\" (UID: \"2a199158-37fe-4467-ae56-2268721f790e\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-rzrpw"
Jul 06 23:56:09.475909 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:09.475780    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/2a199158-37fe-4467-ae56-2268721f790e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-rzrpw\" (UID: \"2a199158-37fe-4467-ae56-2268721f790e\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-rzrpw"
Jul 06 23:56:09.475909 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:09.475815    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rhmcx\" (UniqueName: \"kubernetes.io/projected/dd5b072f-a02f-482e-abd1-5dd590d0a93c-kube-api-access-rhmcx\") pod \"dns-default-g7n6m\" (UID: \"dd5b072f-a02f-482e-abd1-5dd590d0a93c\") " pod="openshift-dns/dns-default-g7n6m"
Jul 06 23:56:09.475909 ip-10-0-129-23 kubenswrapper[2578]: E0706 23:56:09.475841    2578 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 06 23:56:09.475909 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:09.475861    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bn87v\" (UniqueName: \"kubernetes.io/projected/2a199158-37fe-4467-ae56-2268721f790e-kube-api-access-bn87v\") pod \"cluster-monitoring-operator-64786d9cbb-rzrpw\" (UID: \"2a199158-37fe-4467-ae56-2268721f790e\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-rzrpw"
Jul 06 23:56:09.475909 ip-10-0-129-23 kubenswrapper[2578]: E0706 23:56:09.475879    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2a199158-37fe-4467-ae56-2268721f790e-cluster-monitoring-operator-tls podName:2a199158-37fe-4467-ae56-2268721f790e nodeName:}" failed. No retries permitted until 2026-07-06 23:56:09.975868007 +0000 UTC m=+36.086941788 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/2a199158-37fe-4467-ae56-2268721f790e-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-rzrpw" (UID: "2a199158-37fe-4467-ae56-2268721f790e") : secret "cluster-monitoring-operator-tls" not found
Jul 06 23:56:09.475909 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:09.475894    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e2139ac9-3d13-4d35-8344-b94be920985a-ca-trust-extracted\") pod \"image-registry-6d5ddc46dd-hpvrn\" (UID: \"e2139ac9-3d13-4d35-8344-b94be920985a\") " pod="openshift-image-registry/image-registry-6d5ddc46dd-hpvrn"
Jul 06 23:56:09.475909 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:09.475913    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/4e16f8f2-9fde-4234-9392-e1465eebb6e0-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-d5dmf\" (UID: \"4e16f8f2-9fde-4234-9392-e1465eebb6e0\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-d5dmf"
Jul 06 23:56:09.476369 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:09.475937    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1116f765-1ebd-4c12-9ebb-ed7b7760391c-trusted-ca\") pod \"console-operator-68b757fb67-7gjwb\" (UID: \"1116f765-1ebd-4c12-9ebb-ed7b7760391c\") " pod="openshift-console-operator/console-operator-68b757fb67-7gjwb"
Jul 06 23:56:09.487336 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:09.487316    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bn87v\" (UniqueName: \"kubernetes.io/projected/2a199158-37fe-4467-ae56-2268721f790e-kube-api-access-bn87v\") pod \"cluster-monitoring-operator-64786d9cbb-rzrpw\" (UID: \"2a199158-37fe-4467-ae56-2268721f790e\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-rzrpw"
Jul 06 23:56:09.576660 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:09.576479    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/38b01eb6-03b7-4fe6-803c-e7cfb4d355a9-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-jvf67\" (UID: \"38b01eb6-03b7-4fe6-803c-e7cfb4d355a9\") " pod="openshift-insights/insights-operator-5c847dcfc4-jvf67"
Jul 06 23:56:09.576660 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:09.576653    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rhmcx\" (UniqueName: \"kubernetes.io/projected/dd5b072f-a02f-482e-abd1-5dd590d0a93c-kube-api-access-rhmcx\") pod \"dns-default-g7n6m\" (UID: \"dd5b072f-a02f-482e-abd1-5dd590d0a93c\") " pod="openshift-dns/dns-default-g7n6m"
Jul 06 23:56:09.576808 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:09.576676    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e2139ac9-3d13-4d35-8344-b94be920985a-ca-trust-extracted\") pod \"image-registry-6d5ddc46dd-hpvrn\" (UID: \"e2139ac9-3d13-4d35-8344-b94be920985a\") " pod="openshift-image-registry/image-registry-6d5ddc46dd-hpvrn"
Jul 06 23:56:09.576808 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:09.576697    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/4e16f8f2-9fde-4234-9392-e1465eebb6e0-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-d5dmf\" (UID: \"4e16f8f2-9fde-4234-9392-e1465eebb6e0\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-d5dmf"
Jul 06 23:56:09.576808 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:09.576721    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1116f765-1ebd-4c12-9ebb-ed7b7760391c-trusted-ca\") pod \"console-operator-68b757fb67-7gjwb\" (UID: \"1116f765-1ebd-4c12-9ebb-ed7b7760391c\") " pod="openshift-console-operator/console-operator-68b757fb67-7gjwb"
Jul 06 23:56:09.576808 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:09.576738    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e2139ac9-3d13-4d35-8344-b94be920985a-installation-pull-secrets\") pod \"image-registry-6d5ddc46dd-hpvrn\" (UID: \"e2139ac9-3d13-4d35-8344-b94be920985a\") " pod="openshift-image-registry/image-registry-6d5ddc46dd-hpvrn"
Jul 06 23:56:09.576808 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:09.576754    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rnw8n\" (UniqueName: \"kubernetes.io/projected/38b01eb6-03b7-4fe6-803c-e7cfb4d355a9-kube-api-access-rnw8n\") pod \"insights-operator-5c847dcfc4-jvf67\" (UID: \"38b01eb6-03b7-4fe6-803c-e7cfb4d355a9\") " pod="openshift-insights/insights-operator-5c847dcfc4-jvf67"
Jul 06 23:56:09.576808 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:09.576771    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5cx6k\" (UniqueName: \"kubernetes.io/projected/e2139ac9-3d13-4d35-8344-b94be920985a-kube-api-access-5cx6k\") pod \"image-registry-6d5ddc46dd-hpvrn\" (UID: \"e2139ac9-3d13-4d35-8344-b94be920985a\") " pod="openshift-image-registry/image-registry-6d5ddc46dd-hpvrn"
Jul 06 23:56:09.576808 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:09.576806    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/38b01eb6-03b7-4fe6-803c-e7cfb4d355a9-tmp\") pod \"insights-operator-5c847dcfc4-jvf67\" (UID: \"38b01eb6-03b7-4fe6-803c-e7cfb4d355a9\") " pod="openshift-insights/insights-operator-5c847dcfc4-jvf67"
Jul 06 23:56:09.577114 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:09.576834    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xknk5\" (UniqueName: \"kubernetes.io/projected/2e2aa079-1812-4f96-a29d-3926a0fb14e5-kube-api-access-xknk5\") pod \"network-check-source-989f8b8dc-tp5dt\" (UID: \"2e2aa079-1812-4f96-a29d-3926a0fb14e5\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-tp5dt"
Jul 06 23:56:09.577114 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:09.576857    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e2139ac9-3d13-4d35-8344-b94be920985a-trusted-ca\") pod \"image-registry-6d5ddc46dd-hpvrn\" (UID: \"e2139ac9-3d13-4d35-8344-b94be920985a\") " pod="openshift-image-registry/image-registry-6d5ddc46dd-hpvrn"
Jul 06 23:56:09.577114 ip-10-0-129-23 kubenswrapper[2578]: E0706 23:56:09.576906    2578 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 06 23:56:09.577114 ip-10-0-129-23 kubenswrapper[2578]: E0706 23:56:09.576986    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e16f8f2-9fde-4234-9392-e1465eebb6e0-samples-operator-tls podName:4e16f8f2-9fde-4234-9392-e1465eebb6e0 nodeName:}" failed. No retries permitted until 2026-07-06 23:56:10.076967941 +0000 UTC m=+36.188041726 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/4e16f8f2-9fde-4234-9392-e1465eebb6e0-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-d5dmf" (UID: "4e16f8f2-9fde-4234-9392-e1465eebb6e0") : secret "samples-operator-tls" not found
Jul 06 23:56:09.577114 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:09.576985    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e2139ac9-3d13-4d35-8344-b94be920985a-ca-trust-extracted\") pod \"image-registry-6d5ddc46dd-hpvrn\" (UID: \"e2139ac9-3d13-4d35-8344-b94be920985a\") " pod="openshift-image-registry/image-registry-6d5ddc46dd-hpvrn"
Jul 06 23:56:09.577114 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:09.577033    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0aaa04d0-1e6e-42c1-887b-bb6b96c8ea4a-service-ca-bundle\") pod \"router-default-ff7bb96c-8p6lk\" (UID: \"0aaa04d0-1e6e-42c1-887b-bb6b96c8ea4a\") " pod="openshift-ingress/router-default-ff7bb96c-8p6lk"
Jul 06 23:56:09.577114 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:09.577065    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/38b01eb6-03b7-4fe6-803c-e7cfb4d355a9-snapshots\") pod \"insights-operator-5c847dcfc4-jvf67\" (UID: \"38b01eb6-03b7-4fe6-803c-e7cfb4d355a9\") " pod="openshift-insights/insights-operator-5c847dcfc4-jvf67"
Jul 06 23:56:09.577114 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:09.577091    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1116f765-1ebd-4c12-9ebb-ed7b7760391c-config\") pod \"console-operator-68b757fb67-7gjwb\" (UID: \"1116f765-1ebd-4c12-9ebb-ed7b7760391c\") " pod="openshift-console-operator/console-operator-68b757fb67-7gjwb"
Jul 06 23:56:09.577114 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:09.577117    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1116f765-1ebd-4c12-9ebb-ed7b7760391c-serving-cert\") pod \"console-operator-68b757fb67-7gjwb\" (UID: \"1116f765-1ebd-4c12-9ebb-ed7b7760391c\") " pod="openshift-console-operator/console-operator-68b757fb67-7gjwb"
Jul 06 23:56:09.577551 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:09.577142    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/38b01eb6-03b7-4fe6-803c-e7cfb4d355a9-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-jvf67\" (UID: \"38b01eb6-03b7-4fe6-803c-e7cfb4d355a9\") " pod="openshift-insights/insights-operator-5c847dcfc4-jvf67"
Jul 06 23:56:09.577551 ip-10-0-129-23 kubenswrapper[2578]: E0706 23:56:09.577156    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0aaa04d0-1e6e-42c1-887b-bb6b96c8ea4a-service-ca-bundle podName:0aaa04d0-1e6e-42c1-887b-bb6b96c8ea4a nodeName:}" failed. No retries permitted until 2026-07-06 23:56:10.077136658 +0000 UTC m=+36.188210461 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/0aaa04d0-1e6e-42c1-887b-bb6b96c8ea4a-service-ca-bundle") pod "router-default-ff7bb96c-8p6lk" (UID: "0aaa04d0-1e6e-42c1-887b-bb6b96c8ea4a") : configmap references non-existent config key: service-ca.crt
Jul 06 23:56:09.577551 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:09.577197    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f5691201-8c3c-4bd5-8fbb-41e8ddd87e4e-cert\") pod \"ingress-canary-d7x6n\" (UID: \"f5691201-8c3c-4bd5-8fbb-41e8ddd87e4e\") " pod="openshift-ingress-canary/ingress-canary-d7x6n"
Jul 06 23:56:09.577551 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:09.577236    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/0aaa04d0-1e6e-42c1-887b-bb6b96c8ea4a-stats-auth\") pod \"router-default-ff7bb96c-8p6lk\" (UID: \"0aaa04d0-1e6e-42c1-887b-bb6b96c8ea4a\") " pod="openshift-ingress/router-default-ff7bb96c-8p6lk"
Jul 06 23:56:09.577551 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:09.577266    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5dbm9\" (UniqueName: \"kubernetes.io/projected/f5691201-8c3c-4bd5-8fbb-41e8ddd87e4e-kube-api-access-5dbm9\") pod \"ingress-canary-d7x6n\" (UID: \"f5691201-8c3c-4bd5-8fbb-41e8ddd87e4e\") " pod="openshift-ingress-canary/ingress-canary-d7x6n"
Jul 06 23:56:09.577551 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:09.577319    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qfhmk\" (UniqueName: \"kubernetes.io/projected/4e16f8f2-9fde-4234-9392-e1465eebb6e0-kube-api-access-qfhmk\") pod \"cluster-samples-operator-56fcf86bf-d5dmf\" (UID: \"4e16f8f2-9fde-4234-9392-e1465eebb6e0\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-d5dmf"
Jul 06 23:56:09.577551 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:09.577345    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d99nh\" (UniqueName: \"kubernetes.io/projected/0aaa04d0-1e6e-42c1-887b-bb6b96c8ea4a-kube-api-access-d99nh\") pod \"router-default-ff7bb96c-8p6lk\" (UID: \"0aaa04d0-1e6e-42c1-887b-bb6b96c8ea4a\") " pod="openshift-ingress/router-default-ff7bb96c-8p6lk"
Jul 06 23:56:09.577551 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:09.577392    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/38b01eb6-03b7-4fe6-803c-e7cfb4d355a9-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-jvf67\" (UID: \"38b01eb6-03b7-4fe6-803c-e7cfb4d355a9\") " pod="openshift-insights/insights-operator-5c847dcfc4-jvf67"
Jul 06 23:56:09.577551 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:09.577442    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/38b01eb6-03b7-4fe6-803c-e7cfb4d355a9-tmp\") pod \"insights-operator-5c847dcfc4-jvf67\" (UID: \"38b01eb6-03b7-4fe6-803c-e7cfb4d355a9\") " pod="openshift-insights/insights-operator-5c847dcfc4-jvf67"
Jul 06 23:56:09.577961 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:09.577748    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/38b01eb6-03b7-4fe6-803c-e7cfb4d355a9-snapshots\") pod \"insights-operator-5c847dcfc4-jvf67\" (UID: \"38b01eb6-03b7-4fe6-803c-e7cfb4d355a9\") " pod="openshift-insights/insights-operator-5c847dcfc4-jvf67"
Jul 06 23:56:09.577961 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:09.577780    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/38b01eb6-03b7-4fe6-803c-e7cfb4d355a9-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-jvf67\" (UID: \"38b01eb6-03b7-4fe6-803c-e7cfb4d355a9\") " pod="openshift-insights/insights-operator-5c847dcfc4-jvf67"
Jul 06 23:56:09.577961 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:09.577828    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/dff531e0-34c6-4281-8705-149154c350e7-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-fzzq2\" (UID: \"dff531e0-34c6-4281-8705-149154c350e7\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-fzzq2"
Jul 06 23:56:09.577961 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:09.577856    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ggtsh\" (UniqueName: \"kubernetes.io/projected/eef5edeb-c57a-4632-8215-ced4738392a8-kube-api-access-ggtsh\") pod \"volume-data-source-validator-5d456fdbcd-k2rvp\" (UID: \"eef5edeb-c57a-4632-8215-ced4738392a8\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-k2rvp"
Jul 06 23:56:09.577961 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:09.577882    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7631f141-62e9-410a-ba79-c1bdcad24e4e-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-f2xzn\" (UID: \"7631f141-62e9-410a-ba79-c1bdcad24e4e\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-f2xzn"
Jul 06 23:56:09.577961 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:09.577912    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dd5b072f-a02f-482e-abd1-5dd590d0a93c-metrics-tls\") pod \"dns-default-g7n6m\" (UID: \"dd5b072f-a02f-482e-abd1-5dd590d0a93c\") " pod="openshift-dns/dns-default-g7n6m"
Jul 06 23:56:09.577961 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:09.577939    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e2139ac9-3d13-4d35-8344-b94be920985a-image-registry-private-configuration\") pod \"image-registry-6d5ddc46dd-hpvrn\" (UID: \"e2139ac9-3d13-4d35-8344-b94be920985a\") " pod="openshift-image-registry/image-registry-6d5ddc46dd-hpvrn"
Jul 06 23:56:09.578304 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:09.577979    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/7631f141-62e9-410a-ba79-c1bdcad24e4e-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-f2xzn\" (UID: \"7631f141-62e9-410a-ba79-c1bdcad24e4e\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-f2xzn"
Jul 06 23:56:09.578304 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:09.578000    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/0aaa04d0-1e6e-42c1-887b-bb6b96c8ea4a-default-certificate\") pod \"router-default-ff7bb96c-8p6lk\" (UID: \"0aaa04d0-1e6e-42c1-887b-bb6b96c8ea4a\") " pod="openshift-ingress/router-default-ff7bb96c-8p6lk"
Jul 06 23:56:09.578304 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:09.578025    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/67c209fe-6215-4191-adfb-81d0bcc8e4bd-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-rx7w7\" (UID: \"67c209fe-6215-4191-adfb-81d0bcc8e4bd\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-rx7w7"
Jul 06 23:56:09.578304 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:09.578049    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0aaa04d0-1e6e-42c1-887b-bb6b96c8ea4a-metrics-certs\") pod \"router-default-ff7bb96c-8p6lk\" (UID: \"0aaa04d0-1e6e-42c1-887b-bb6b96c8ea4a\") " pod="openshift-ingress/router-default-ff7bb96c-8p6lk"
Jul 06 23:56:09.578304 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:09.578070    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/38b01eb6-03b7-4fe6-803c-e7cfb4d355a9-serving-cert\") pod \"insights-operator-5c847dcfc4-jvf67\" (UID: \"38b01eb6-03b7-4fe6-803c-e7cfb4d355a9\") " pod="openshift-insights/insights-operator-5c847dcfc4-jvf67"
Jul 06 23:56:09.578304 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:09.578104    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/67c209fe-6215-4191-adfb-81d0bcc8e4bd-config\") pod \"service-ca-operator-5d46d9ffd4-rx7w7\" (UID: \"67c209fe-6215-4191-adfb-81d0bcc8e4bd\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-rx7w7"
Jul 06 23:56:09.578304 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:09.578135    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h2dq5\" (UniqueName: \"kubernetes.io/projected/1116f765-1ebd-4c12-9ebb-ed7b7760391c-kube-api-access-h2dq5\") pod \"console-operator-68b757fb67-7gjwb\" (UID: \"1116f765-1ebd-4c12-9ebb-ed7b7760391c\") " pod="openshift-console-operator/console-operator-68b757fb67-7gjwb"
Jul 06 23:56:09.578304 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:09.578158    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e2139ac9-3d13-4d35-8344-b94be920985a-bound-sa-token\") pod \"image-registry-6d5ddc46dd-hpvrn\" (UID: \"e2139ac9-3d13-4d35-8344-b94be920985a\") " pod="openshift-image-registry/image-registry-6d5ddc46dd-hpvrn"
Jul 06 23:56:09.578304 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:09.578184    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vnnq8\" (UniqueName: \"kubernetes.io/projected/dff531e0-34c6-4281-8705-149154c350e7-kube-api-access-vnnq8\") pod \"kube-storage-version-migrator-operator-846bf668f7-fzzq2\" (UID: \"dff531e0-34c6-4281-8705-149154c350e7\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-fzzq2"
Jul 06 23:56:09.578304 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:09.578206    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/dd5b072f-a02f-482e-abd1-5dd590d0a93c-config-volume\") pod \"dns-default-g7n6m\" (UID: \"dd5b072f-a02f-482e-abd1-5dd590d0a93c\") " pod="openshift-dns/dns-default-g7n6m"
Jul 06 23:56:09.578304 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:09.578227    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dd5b072f-a02f-482e-abd1-5dd590d0a93c-tmp-dir\") pod \"dns-default-g7n6m\" (UID: \"dd5b072f-a02f-482e-abd1-5dd590d0a93c\") " pod="openshift-dns/dns-default-g7n6m"
Jul 06 23:56:09.578304 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:09.578252    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e2139ac9-3d13-4d35-8344-b94be920985a-registry-certificates\") pod \"image-registry-6d5ddc46dd-hpvrn\" (UID: \"e2139ac9-3d13-4d35-8344-b94be920985a\") " pod="openshift-image-registry/image-registry-6d5ddc46dd-hpvrn"
Jul 06 23:56:09.578304 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:09.578301    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6nh47\" (UniqueName: \"kubernetes.io/projected/67c209fe-6215-4191-adfb-81d0bcc8e4bd-kube-api-access-6nh47\") pod \"service-ca-operator-5d46d9ffd4-rx7w7\" (UID: \"67c209fe-6215-4191-adfb-81d0bcc8e4bd\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-rx7w7"
Jul 06 23:56:09.578304 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:09.578304    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1116f765-1ebd-4c12-9ebb-ed7b7760391c-config\") pod \"console-operator-68b757fb67-7gjwb\" (UID: \"1116f765-1ebd-4c12-9ebb-ed7b7760391c\") " pod="openshift-console-operator/console-operator-68b757fb67-7gjwb"
Jul 06 23:56:09.579108 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:09.578327    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e2139ac9-3d13-4d35-8344-b94be920985a-registry-tls\") pod \"image-registry-6d5ddc46dd-hpvrn\" (UID: \"e2139ac9-3d13-4d35-8344-b94be920985a\") " pod="openshift-image-registry/image-registry-6d5ddc46dd-hpvrn"
Jul 06 23:56:09.579108 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:09.578355    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/dff531e0-34c6-4281-8705-149154c350e7-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-fzzq2\" (UID: \"dff531e0-34c6-4281-8705-149154c350e7\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-fzzq2"
Jul 06 23:56:09.579108 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:09.578103    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e2139ac9-3d13-4d35-8344-b94be920985a-trusted-ca\") pod \"image-registry-6d5ddc46dd-hpvrn\" (UID: \"e2139ac9-3d13-4d35-8344-b94be920985a\") " pod="openshift-image-registry/image-registry-6d5ddc46dd-hpvrn"
Jul 06 23:56:09.579108 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:09.578750    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1116f765-1ebd-4c12-9ebb-ed7b7760391c-trusted-ca\") pod \"console-operator-68b757fb67-7gjwb\" (UID: \"1116f765-1ebd-4c12-9ebb-ed7b7760391c\") " pod="openshift-console-operator/console-operator-68b757fb67-7gjwb"
Jul 06 23:56:09.579108 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:09.578764    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/7631f141-62e9-410a-ba79-c1bdcad24e4e-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-f2xzn\" (UID: \"7631f141-62e9-410a-ba79-c1bdcad24e4e\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-f2xzn"
Jul 06 23:56:09.579108 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:09.578866    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/dff531e0-34c6-4281-8705-149154c350e7-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-fzzq2\" (UID: \"dff531e0-34c6-4281-8705-149154c350e7\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-fzzq2"
Jul 06 23:56:09.579108 ip-10-0-129-23 kubenswrapper[2578]: E0706 23:56:09.579067    2578 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 06 23:56:09.579512 ip-10-0-129-23 kubenswrapper[2578]: E0706 23:56:09.579120    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7631f141-62e9-410a-ba79-c1bdcad24e4e-networking-console-plugin-cert podName:7631f141-62e9-410a-ba79-c1bdcad24e4e nodeName:}" failed. No retries permitted until 2026-07-06 23:56:10.079106534 +0000 UTC m=+36.190180337 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/7631f141-62e9-410a-ba79-c1bdcad24e4e-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-f2xzn" (UID: "7631f141-62e9-410a-ba79-c1bdcad24e4e") : secret "networking-console-plugin-cert" not found
Jul 06 23:56:09.579512 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:09.579127    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dd5b072f-a02f-482e-abd1-5dd590d0a93c-tmp-dir\") pod \"dns-default-g7n6m\" (UID: \"dd5b072f-a02f-482e-abd1-5dd590d0a93c\") " pod="openshift-dns/dns-default-g7n6m"
Jul 06 23:56:09.579512 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:09.579313    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/dd5b072f-a02f-482e-abd1-5dd590d0a93c-config-volume\") pod \"dns-default-g7n6m\" (UID: \"dd5b072f-a02f-482e-abd1-5dd590d0a93c\") " pod="openshift-dns/dns-default-g7n6m"
Jul 06 23:56:09.579665 ip-10-0-129-23 kubenswrapper[2578]: E0706 23:56:09.579568    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 23:56:09.579665 ip-10-0-129-23 kubenswrapper[2578]: E0706 23:56:09.579608    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dd5b072f-a02f-482e-abd1-5dd590d0a93c-metrics-tls podName:dd5b072f-a02f-482e-abd1-5dd590d0a93c nodeName:}" failed. No retries permitted until 2026-07-06 23:56:10.07959505 +0000 UTC m=+36.190668850 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/dd5b072f-a02f-482e-abd1-5dd590d0a93c-metrics-tls") pod "dns-default-g7n6m" (UID: "dd5b072f-a02f-482e-abd1-5dd590d0a93c") : secret "dns-default-metrics-tls" not found
Jul 06 23:56:09.579821 ip-10-0-129-23 kubenswrapper[2578]: E0706 23:56:09.579801    2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 06 23:56:09.579877 ip-10-0-129-23 kubenswrapper[2578]: E0706 23:56:09.579825    2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6d5ddc46dd-hpvrn: secret "image-registry-tls" not found
Jul 06 23:56:09.579927 ip-10-0-129-23 kubenswrapper[2578]: E0706 23:56:09.579878    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e2139ac9-3d13-4d35-8344-b94be920985a-registry-tls podName:e2139ac9-3d13-4d35-8344-b94be920985a nodeName:}" failed. No retries permitted until 2026-07-06 23:56:10.079864777 +0000 UTC m=+36.190938589 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e2139ac9-3d13-4d35-8344-b94be920985a-registry-tls") pod "image-registry-6d5ddc46dd-hpvrn" (UID: "e2139ac9-3d13-4d35-8344-b94be920985a") : secret "image-registry-tls" not found
Jul 06 23:56:09.579981 ip-10-0-129-23 kubenswrapper[2578]: E0706 23:56:09.579950    2578 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 06 23:56:09.580038 ip-10-0-129-23 kubenswrapper[2578]: E0706 23:56:09.579984    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0aaa04d0-1e6e-42c1-887b-bb6b96c8ea4a-metrics-certs podName:0aaa04d0-1e6e-42c1-887b-bb6b96c8ea4a nodeName:}" failed. No retries permitted until 2026-07-06 23:56:10.079972146 +0000 UTC m=+36.191045956 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0aaa04d0-1e6e-42c1-887b-bb6b96c8ea4a-metrics-certs") pod "router-default-ff7bb96c-8p6lk" (UID: "0aaa04d0-1e6e-42c1-887b-bb6b96c8ea4a") : secret "router-metrics-certs-default" not found
Jul 06 23:56:09.580705 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:09.579567    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e2139ac9-3d13-4d35-8344-b94be920985a-registry-certificates\") pod \"image-registry-6d5ddc46dd-hpvrn\" (UID: \"e2139ac9-3d13-4d35-8344-b94be920985a\") " pod="openshift-image-registry/image-registry-6d5ddc46dd-hpvrn"
Jul 06 23:56:09.580921 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:09.580899    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/67c209fe-6215-4191-adfb-81d0bcc8e4bd-config\") pod \"service-ca-operator-5d46d9ffd4-rx7w7\" (UID: \"67c209fe-6215-4191-adfb-81d0bcc8e4bd\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-rx7w7"
Jul 06 23:56:09.581133 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:09.581107    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e2139ac9-3d13-4d35-8344-b94be920985a-installation-pull-secrets\") pod \"image-registry-6d5ddc46dd-hpvrn\" (UID: \"e2139ac9-3d13-4d35-8344-b94be920985a\") " pod="openshift-image-registry/image-registry-6d5ddc46dd-hpvrn"
Jul 06 23:56:09.581253 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:09.581232    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/0aaa04d0-1e6e-42c1-887b-bb6b96c8ea4a-stats-auth\") pod \"router-default-ff7bb96c-8p6lk\" (UID: \"0aaa04d0-1e6e-42c1-887b-bb6b96c8ea4a\") " pod="openshift-ingress/router-default-ff7bb96c-8p6lk"
Jul 06 23:56:09.581353 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:09.581312    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/0aaa04d0-1e6e-42c1-887b-bb6b96c8ea4a-default-certificate\") pod \"router-default-ff7bb96c-8p6lk\" (UID: \"0aaa04d0-1e6e-42c1-887b-bb6b96c8ea4a\") " pod="openshift-ingress/router-default-ff7bb96c-8p6lk"
Jul 06 23:56:09.581838 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:09.581816    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1116f765-1ebd-4c12-9ebb-ed7b7760391c-serving-cert\") pod \"console-operator-68b757fb67-7gjwb\" (UID: \"1116f765-1ebd-4c12-9ebb-ed7b7760391c\") " pod="openshift-console-operator/console-operator-68b757fb67-7gjwb"
Jul 06 23:56:09.582112 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:09.582090    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e2139ac9-3d13-4d35-8344-b94be920985a-image-registry-private-configuration\") pod \"image-registry-6d5ddc46dd-hpvrn\" (UID: \"e2139ac9-3d13-4d35-8344-b94be920985a\") " pod="openshift-image-registry/image-registry-6d5ddc46dd-hpvrn"
Jul 06 23:56:09.582472 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:09.582445    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/67c209fe-6215-4191-adfb-81d0bcc8e4bd-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-rx7w7\" (UID: \"67c209fe-6215-4191-adfb-81d0bcc8e4bd\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-rx7w7"
Jul 06 23:56:09.582699 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:09.582682    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/dff531e0-34c6-4281-8705-149154c350e7-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-fzzq2\" (UID: \"dff531e0-34c6-4281-8705-149154c350e7\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-fzzq2"
Jul 06 23:56:09.582832 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:09.582813    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/38b01eb6-03b7-4fe6-803c-e7cfb4d355a9-serving-cert\") pod \"insights-operator-5c847dcfc4-jvf67\" (UID: \"38b01eb6-03b7-4fe6-803c-e7cfb4d355a9\") " pod="openshift-insights/insights-operator-5c847dcfc4-jvf67"
Jul 06 23:56:09.583051 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:09.583028    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f5691201-8c3c-4bd5-8fbb-41e8ddd87e4e-cert\") pod \"ingress-canary-d7x6n\" (UID: \"f5691201-8c3c-4bd5-8fbb-41e8ddd87e4e\") " pod="openshift-ingress-canary/ingress-canary-d7x6n"
Jul 06 23:56:09.587536 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:09.587514    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rhmcx\" (UniqueName: \"kubernetes.io/projected/dd5b072f-a02f-482e-abd1-5dd590d0a93c-kube-api-access-rhmcx\") pod \"dns-default-g7n6m\" (UID: \"dd5b072f-a02f-482e-abd1-5dd590d0a93c\") " pod="openshift-dns/dns-default-g7n6m"
Jul 06 23:56:09.588237 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:09.588195    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rnw8n\" (UniqueName: \"kubernetes.io/projected/38b01eb6-03b7-4fe6-803c-e7cfb4d355a9-kube-api-access-rnw8n\") pod \"insights-operator-5c847dcfc4-jvf67\" (UID: \"38b01eb6-03b7-4fe6-803c-e7cfb4d355a9\") " pod="openshift-insights/insights-operator-5c847dcfc4-jvf67"
Jul 06 23:56:09.589648 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:09.589607    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d99nh\" (UniqueName: \"kubernetes.io/projected/0aaa04d0-1e6e-42c1-887b-bb6b96c8ea4a-kube-api-access-d99nh\") pod \"router-default-ff7bb96c-8p6lk\" (UID: \"0aaa04d0-1e6e-42c1-887b-bb6b96c8ea4a\") " pod="openshift-ingress/router-default-ff7bb96c-8p6lk"
Jul 06 23:56:09.589822 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:09.589797    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qfhmk\" (UniqueName: \"kubernetes.io/projected/4e16f8f2-9fde-4234-9392-e1465eebb6e0-kube-api-access-qfhmk\") pod \"cluster-samples-operator-56fcf86bf-d5dmf\" (UID: \"4e16f8f2-9fde-4234-9392-e1465eebb6e0\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-d5dmf"
Jul 06 23:56:09.590744 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:09.590674    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ggtsh\" (UniqueName: \"kubernetes.io/projected/eef5edeb-c57a-4632-8215-ced4738392a8-kube-api-access-ggtsh\") pod \"volume-data-source-validator-5d456fdbcd-k2rvp\" (UID: \"eef5edeb-c57a-4632-8215-ced4738392a8\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-k2rvp"
Jul 06 23:56:09.591157 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:09.591128    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vnnq8\" (UniqueName: \"kubernetes.io/projected/dff531e0-34c6-4281-8705-149154c350e7-kube-api-access-vnnq8\") pod \"kube-storage-version-migrator-operator-846bf668f7-fzzq2\" (UID: \"dff531e0-34c6-4281-8705-149154c350e7\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-fzzq2"
Jul 06 23:56:09.592188 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:09.592047    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h2dq5\" (UniqueName: \"kubernetes.io/projected/1116f765-1ebd-4c12-9ebb-ed7b7760391c-kube-api-access-h2dq5\") pod \"console-operator-68b757fb67-7gjwb\" (UID: \"1116f765-1ebd-4c12-9ebb-ed7b7760391c\") " pod="openshift-console-operator/console-operator-68b757fb67-7gjwb"
Jul 06 23:56:09.592343 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:09.592316    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e2139ac9-3d13-4d35-8344-b94be920985a-bound-sa-token\") pod \"image-registry-6d5ddc46dd-hpvrn\" (UID: \"e2139ac9-3d13-4d35-8344-b94be920985a\") " pod="openshift-image-registry/image-registry-6d5ddc46dd-hpvrn"
Jul 06 23:56:09.592399 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:09.592326    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5dbm9\" (UniqueName: \"kubernetes.io/projected/f5691201-8c3c-4bd5-8fbb-41e8ddd87e4e-kube-api-access-5dbm9\") pod \"ingress-canary-d7x6n\" (UID: \"f5691201-8c3c-4bd5-8fbb-41e8ddd87e4e\") " pod="openshift-ingress-canary/ingress-canary-d7x6n"
Jul 06 23:56:09.592656 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:09.592640    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6nh47\" (UniqueName: \"kubernetes.io/projected/67c209fe-6215-4191-adfb-81d0bcc8e4bd-kube-api-access-6nh47\") pod \"service-ca-operator-5d46d9ffd4-rx7w7\" (UID: \"67c209fe-6215-4191-adfb-81d0bcc8e4bd\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-rx7w7"
Jul 06 23:56:09.592687 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:09.592668    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5cx6k\" (UniqueName: \"kubernetes.io/projected/e2139ac9-3d13-4d35-8344-b94be920985a-kube-api-access-5cx6k\") pod \"image-registry-6d5ddc46dd-hpvrn\" (UID: \"e2139ac9-3d13-4d35-8344-b94be920985a\") " pod="openshift-image-registry/image-registry-6d5ddc46dd-hpvrn"
Jul 06 23:56:09.592771 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:09.592757    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xknk5\" (UniqueName: \"kubernetes.io/projected/2e2aa079-1812-4f96-a29d-3926a0fb14e5-kube-api-access-xknk5\") pod \"network-check-source-989f8b8dc-tp5dt\" (UID: \"2e2aa079-1812-4f96-a29d-3926a0fb14e5\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-tp5dt"
Jul 06 23:56:09.623104 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:09.623084    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-k2rvp"
Jul 06 23:56:09.638072 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:09.638050    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5c847dcfc4-jvf67"
Jul 06 23:56:09.645191 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:09.645171    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-rx7w7"
Jul 06 23:56:09.654654 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:09.654633    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-fzzq2"
Jul 06 23:56:09.660966 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:09.660925    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-68b757fb67-7gjwb"
Jul 06 23:56:09.669376 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:09.669356    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-tp5dt"
Jul 06 23:56:09.689212 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:09.688707    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-d7x6n"
Jul 06 23:56:09.895179 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:09.893798    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-k2rvp"]
Jul 06 23:56:09.905668 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:09.904447    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-jvf67"]
Jul 06 23:56:09.911544 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:09.911521    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-tp5dt"]
Jul 06 23:56:09.913890 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:09.913861    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-rx7w7"]
Jul 06 23:56:09.916119 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:56:09.916098    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e2aa079_1812_4f96_a29d_3926a0fb14e5.slice/crio-a4ab2819500568c46922414a4f184ebf5d5efe63ddb194c2a362b80403629d53 WatchSource:0}: Error finding container a4ab2819500568c46922414a4f184ebf5d5efe63ddb194c2a362b80403629d53: Status 404 returned error can't find the container with id a4ab2819500568c46922414a4f184ebf5d5efe63ddb194c2a362b80403629d53
Jul 06 23:56:09.918391 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:56:09.918359    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67c209fe_6215_4191_adfb_81d0bcc8e4bd.slice/crio-c31d7bde4c95ff0076ca0a821d9013f8b5dba8a9c0abec312cfc8d2063bf469d WatchSource:0}: Error finding container c31d7bde4c95ff0076ca0a821d9013f8b5dba8a9c0abec312cfc8d2063bf469d: Status 404 returned error can't find the container with id c31d7bde4c95ff0076ca0a821d9013f8b5dba8a9c0abec312cfc8d2063bf469d
Jul 06 23:56:09.926759 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:09.926731    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-fzzq2"]
Jul 06 23:56:09.931047 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:09.931022    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-7gjwb"]
Jul 06 23:56:09.933395 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:56:09.933370    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddff531e0_34c6_4281_8705_149154c350e7.slice/crio-118839b8a22a0a254474aed61f829a43f48b834daa2c72a7b08906c87fe3c46e WatchSource:0}: Error finding container 118839b8a22a0a254474aed61f829a43f48b834daa2c72a7b08906c87fe3c46e: Status 404 returned error can't find the container with id 118839b8a22a0a254474aed61f829a43f48b834daa2c72a7b08906c87fe3c46e
Jul 06 23:56:09.933752 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:56:09.933727    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1116f765_1ebd_4c12_9ebb_ed7b7760391c.slice/crio-4b67dfc03b48caa61b2f694ae083c62ee2220de75a94a18ff8c46da0be2a44be WatchSource:0}: Error finding container 4b67dfc03b48caa61b2f694ae083c62ee2220de75a94a18ff8c46da0be2a44be: Status 404 returned error can't find the container with id 4b67dfc03b48caa61b2f694ae083c62ee2220de75a94a18ff8c46da0be2a44be
Jul 06 23:56:09.947501 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:09.947482    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-d7x6n"]
Jul 06 23:56:09.950339 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:56:09.950319    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf5691201_8c3c_4bd5_8fbb_41e8ddd87e4e.slice/crio-758b0e2d492fb1b46bf4e8f261d8a598cd722576c4edb32593d280997a58df11 WatchSource:0}: Error finding container 758b0e2d492fb1b46bf4e8f261d8a598cd722576c4edb32593d280997a58df11: Status 404 returned error can't find the container with id 758b0e2d492fb1b46bf4e8f261d8a598cd722576c4edb32593d280997a58df11
Jul 06 23:56:09.983028 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:09.983002    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/2a199158-37fe-4467-ae56-2268721f790e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-rzrpw\" (UID: \"2a199158-37fe-4467-ae56-2268721f790e\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-rzrpw"
Jul 06 23:56:09.983126 ip-10-0-129-23 kubenswrapper[2578]: E0706 23:56:09.983114    2578 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 06 23:56:09.983177 ip-10-0-129-23 kubenswrapper[2578]: E0706 23:56:09.983167    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2a199158-37fe-4467-ae56-2268721f790e-cluster-monitoring-operator-tls podName:2a199158-37fe-4467-ae56-2268721f790e nodeName:}" failed. No retries permitted until 2026-07-06 23:56:10.983152169 +0000 UTC m=+37.094225950 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/2a199158-37fe-4467-ae56-2268721f790e-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-rzrpw" (UID: "2a199158-37fe-4467-ae56-2268721f790e") : secret "cluster-monitoring-operator-tls" not found
Jul 06 23:56:10.083967 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:10.083912    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/4e16f8f2-9fde-4234-9392-e1465eebb6e0-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-d5dmf\" (UID: \"4e16f8f2-9fde-4234-9392-e1465eebb6e0\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-d5dmf"
Jul 06 23:56:10.083967 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:10.083955    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0aaa04d0-1e6e-42c1-887b-bb6b96c8ea4a-service-ca-bundle\") pod \"router-default-ff7bb96c-8p6lk\" (UID: \"0aaa04d0-1e6e-42c1-887b-bb6b96c8ea4a\") " pod="openshift-ingress/router-default-ff7bb96c-8p6lk"
Jul 06 23:56:10.084084 ip-10-0-129-23 kubenswrapper[2578]: E0706 23:56:10.084051    2578 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 06 23:56:10.084130 ip-10-0-129-23 kubenswrapper[2578]: E0706 23:56:10.084058    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0aaa04d0-1e6e-42c1-887b-bb6b96c8ea4a-service-ca-bundle podName:0aaa04d0-1e6e-42c1-887b-bb6b96c8ea4a nodeName:}" failed. No retries permitted until 2026-07-06 23:56:11.084046307 +0000 UTC m=+37.195120088 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/0aaa04d0-1e6e-42c1-887b-bb6b96c8ea4a-service-ca-bundle") pod "router-default-ff7bb96c-8p6lk" (UID: "0aaa04d0-1e6e-42c1-887b-bb6b96c8ea4a") : configmap references non-existent config key: service-ca.crt
Jul 06 23:56:10.084190 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:10.084125    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7631f141-62e9-410a-ba79-c1bdcad24e4e-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-f2xzn\" (UID: \"7631f141-62e9-410a-ba79-c1bdcad24e4e\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-f2xzn"
Jul 06 23:56:10.084190 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:10.084165    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dd5b072f-a02f-482e-abd1-5dd590d0a93c-metrics-tls\") pod \"dns-default-g7n6m\" (UID: \"dd5b072f-a02f-482e-abd1-5dd590d0a93c\") " pod="openshift-dns/dns-default-g7n6m"
Jul 06 23:56:10.084190 ip-10-0-129-23 kubenswrapper[2578]: E0706 23:56:10.084179    2578 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 06 23:56:10.084339 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:10.084211    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0aaa04d0-1e6e-42c1-887b-bb6b96c8ea4a-metrics-certs\") pod \"router-default-ff7bb96c-8p6lk\" (UID: \"0aaa04d0-1e6e-42c1-887b-bb6b96c8ea4a\") " pod="openshift-ingress/router-default-ff7bb96c-8p6lk"
Jul 06 23:56:10.084339 ip-10-0-129-23 kubenswrapper[2578]: E0706 23:56:10.084217    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7631f141-62e9-410a-ba79-c1bdcad24e4e-networking-console-plugin-cert podName:7631f141-62e9-410a-ba79-c1bdcad24e4e nodeName:}" failed. No retries permitted until 2026-07-06 23:56:11.084205196 +0000 UTC m=+37.195278977 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/7631f141-62e9-410a-ba79-c1bdcad24e4e-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-f2xzn" (UID: "7631f141-62e9-410a-ba79-c1bdcad24e4e") : secret "networking-console-plugin-cert" not found
Jul 06 23:56:10.084339 ip-10-0-129-23 kubenswrapper[2578]: E0706 23:56:10.084244    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e16f8f2-9fde-4234-9392-e1465eebb6e0-samples-operator-tls podName:4e16f8f2-9fde-4234-9392-e1465eebb6e0 nodeName:}" failed. No retries permitted until 2026-07-06 23:56:11.084230079 +0000 UTC m=+37.195303874 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/4e16f8f2-9fde-4234-9392-e1465eebb6e0-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-d5dmf" (UID: "4e16f8f2-9fde-4234-9392-e1465eebb6e0") : secret "samples-operator-tls" not found
Jul 06 23:56:10.084339 ip-10-0-129-23 kubenswrapper[2578]: E0706 23:56:10.084254    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 23:56:10.084339 ip-10-0-129-23 kubenswrapper[2578]: E0706 23:56:10.084255    2578 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 06 23:56:10.084339 ip-10-0-129-23 kubenswrapper[2578]: E0706 23:56:10.084304    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0aaa04d0-1e6e-42c1-887b-bb6b96c8ea4a-metrics-certs podName:0aaa04d0-1e6e-42c1-887b-bb6b96c8ea4a nodeName:}" failed. No retries permitted until 2026-07-06 23:56:11.084276052 +0000 UTC m=+37.195349833 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0aaa04d0-1e6e-42c1-887b-bb6b96c8ea4a-metrics-certs") pod "router-default-ff7bb96c-8p6lk" (UID: "0aaa04d0-1e6e-42c1-887b-bb6b96c8ea4a") : secret "router-metrics-certs-default" not found
Jul 06 23:56:10.084339 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:10.084307    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e2139ac9-3d13-4d35-8344-b94be920985a-registry-tls\") pod \"image-registry-6d5ddc46dd-hpvrn\" (UID: \"e2139ac9-3d13-4d35-8344-b94be920985a\") " pod="openshift-image-registry/image-registry-6d5ddc46dd-hpvrn"
Jul 06 23:56:10.084581 ip-10-0-129-23 kubenswrapper[2578]: E0706 23:56:10.084351    2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 06 23:56:10.084581 ip-10-0-129-23 kubenswrapper[2578]: E0706 23:56:10.084365    2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6d5ddc46dd-hpvrn: secret "image-registry-tls" not found
Jul 06 23:56:10.084581 ip-10-0-129-23 kubenswrapper[2578]: E0706 23:56:10.084384    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dd5b072f-a02f-482e-abd1-5dd590d0a93c-metrics-tls podName:dd5b072f-a02f-482e-abd1-5dd590d0a93c nodeName:}" failed. No retries permitted until 2026-07-06 23:56:11.084368721 +0000 UTC m=+37.195442507 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/dd5b072f-a02f-482e-abd1-5dd590d0a93c-metrics-tls") pod "dns-default-g7n6m" (UID: "dd5b072f-a02f-482e-abd1-5dd590d0a93c") : secret "dns-default-metrics-tls" not found
Jul 06 23:56:10.084581 ip-10-0-129-23 kubenswrapper[2578]: E0706 23:56:10.084405    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e2139ac9-3d13-4d35-8344-b94be920985a-registry-tls podName:e2139ac9-3d13-4d35-8344-b94be920985a nodeName:}" failed. No retries permitted until 2026-07-06 23:56:11.084395041 +0000 UTC m=+37.195468838 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e2139ac9-3d13-4d35-8344-b94be920985a-registry-tls") pod "image-registry-6d5ddc46dd-hpvrn" (UID: "e2139ac9-3d13-4d35-8344-b94be920985a") : secret "image-registry-tls" not found
Jul 06 23:56:10.389107 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:10.389022    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sqcsc"
Jul 06 23:56:10.389633 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:10.389191    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g45vp"
Jul 06 23:56:10.392162 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:10.392138    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-dplr9\""
Jul 06 23:56:10.393087 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:10.393062    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-czj4k\""
Jul 06 23:56:10.393192 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:10.393076    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 06 23:56:10.691606 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:10.691562    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-d7x6n" event={"ID":"f5691201-8c3c-4bd5-8fbb-41e8ddd87e4e","Type":"ContainerStarted","Data":"758b0e2d492fb1b46bf4e8f261d8a598cd722576c4edb32593d280997a58df11"}
Jul 06 23:56:10.694694 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:10.694663    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-jvf67" event={"ID":"38b01eb6-03b7-4fe6-803c-e7cfb4d355a9","Type":"ContainerStarted","Data":"a1230a62905cec81aa3a93ca9f2a781670d70da1b289c52d581765439d59d397"}
Jul 06 23:56:10.697375 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:10.697269    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-7gjwb" event={"ID":"1116f765-1ebd-4c12-9ebb-ed7b7760391c","Type":"ContainerStarted","Data":"4b67dfc03b48caa61b2f694ae083c62ee2220de75a94a18ff8c46da0be2a44be"}
Jul 06 23:56:10.700117 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:10.700010    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-fzzq2" event={"ID":"dff531e0-34c6-4281-8705-149154c350e7","Type":"ContainerStarted","Data":"118839b8a22a0a254474aed61f829a43f48b834daa2c72a7b08906c87fe3c46e"}
Jul 06 23:56:10.704203 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:10.704177    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-rx7w7" event={"ID":"67c209fe-6215-4191-adfb-81d0bcc8e4bd","Type":"ContainerStarted","Data":"c31d7bde4c95ff0076ca0a821d9013f8b5dba8a9c0abec312cfc8d2063bf469d"}
Jul 06 23:56:10.707621 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:10.707584    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-k2rvp" event={"ID":"eef5edeb-c57a-4632-8215-ced4738392a8","Type":"ContainerStarted","Data":"a116b490cdaeb6152b2c6ba6880bed71c0d5092be83997bbc39c74f021814ed4"}
Jul 06 23:56:10.713666 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:10.713641    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-tp5dt" event={"ID":"2e2aa079-1812-4f96-a29d-3926a0fb14e5","Type":"ContainerStarted","Data":"a4ab2819500568c46922414a4f184ebf5d5efe63ddb194c2a362b80403629d53"}
Jul 06 23:56:10.997315 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:10.997221    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/2a199158-37fe-4467-ae56-2268721f790e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-rzrpw\" (UID: \"2a199158-37fe-4467-ae56-2268721f790e\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-rzrpw"
Jul 06 23:56:10.997464 ip-10-0-129-23 kubenswrapper[2578]: E0706 23:56:10.997448    2578 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 06 23:56:10.997537 ip-10-0-129-23 kubenswrapper[2578]: E0706 23:56:10.997507    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2a199158-37fe-4467-ae56-2268721f790e-cluster-monitoring-operator-tls podName:2a199158-37fe-4467-ae56-2268721f790e nodeName:}" failed. No retries permitted until 2026-07-06 23:56:12.997489977 +0000 UTC m=+39.108563777 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/2a199158-37fe-4467-ae56-2268721f790e-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-rzrpw" (UID: "2a199158-37fe-4467-ae56-2268721f790e") : secret "cluster-monitoring-operator-tls" not found
Jul 06 23:56:11.099868 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:11.098582    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/4e16f8f2-9fde-4234-9392-e1465eebb6e0-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-d5dmf\" (UID: \"4e16f8f2-9fde-4234-9392-e1465eebb6e0\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-d5dmf"
Jul 06 23:56:11.099868 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:11.098655    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0aaa04d0-1e6e-42c1-887b-bb6b96c8ea4a-service-ca-bundle\") pod \"router-default-ff7bb96c-8p6lk\" (UID: \"0aaa04d0-1e6e-42c1-887b-bb6b96c8ea4a\") " pod="openshift-ingress/router-default-ff7bb96c-8p6lk"
Jul 06 23:56:11.099868 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:11.098731    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7631f141-62e9-410a-ba79-c1bdcad24e4e-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-f2xzn\" (UID: \"7631f141-62e9-410a-ba79-c1bdcad24e4e\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-f2xzn"
Jul 06 23:56:11.099868 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:11.098760    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dd5b072f-a02f-482e-abd1-5dd590d0a93c-metrics-tls\") pod \"dns-default-g7n6m\" (UID: \"dd5b072f-a02f-482e-abd1-5dd590d0a93c\") " pod="openshift-dns/dns-default-g7n6m"
Jul 06 23:56:11.099868 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:11.098798    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0aaa04d0-1e6e-42c1-887b-bb6b96c8ea4a-metrics-certs\") pod \"router-default-ff7bb96c-8p6lk\" (UID: \"0aaa04d0-1e6e-42c1-887b-bb6b96c8ea4a\") " pod="openshift-ingress/router-default-ff7bb96c-8p6lk"
Jul 06 23:56:11.099868 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:11.098836    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e2139ac9-3d13-4d35-8344-b94be920985a-registry-tls\") pod \"image-registry-6d5ddc46dd-hpvrn\" (UID: \"e2139ac9-3d13-4d35-8344-b94be920985a\") " pod="openshift-image-registry/image-registry-6d5ddc46dd-hpvrn"
Jul 06 23:56:11.099868 ip-10-0-129-23 kubenswrapper[2578]: E0706 23:56:11.098993    2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 06 23:56:11.099868 ip-10-0-129-23 kubenswrapper[2578]: E0706 23:56:11.099007    2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6d5ddc46dd-hpvrn: secret "image-registry-tls" not found
Jul 06 23:56:11.099868 ip-10-0-129-23 kubenswrapper[2578]: E0706 23:56:11.099074    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e2139ac9-3d13-4d35-8344-b94be920985a-registry-tls podName:e2139ac9-3d13-4d35-8344-b94be920985a nodeName:}" failed. No retries permitted until 2026-07-06 23:56:13.099054449 +0000 UTC m=+39.210128236 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e2139ac9-3d13-4d35-8344-b94be920985a-registry-tls") pod "image-registry-6d5ddc46dd-hpvrn" (UID: "e2139ac9-3d13-4d35-8344-b94be920985a") : secret "image-registry-tls" not found
Jul 06 23:56:11.099868 ip-10-0-129-23 kubenswrapper[2578]: E0706 23:56:11.099476    2578 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 06 23:56:11.099868 ip-10-0-129-23 kubenswrapper[2578]: E0706 23:56:11.099526    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e16f8f2-9fde-4234-9392-e1465eebb6e0-samples-operator-tls podName:4e16f8f2-9fde-4234-9392-e1465eebb6e0 nodeName:}" failed. No retries permitted until 2026-07-06 23:56:13.099511521 +0000 UTC m=+39.210585305 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/4e16f8f2-9fde-4234-9392-e1465eebb6e0-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-d5dmf" (UID: "4e16f8f2-9fde-4234-9392-e1465eebb6e0") : secret "samples-operator-tls" not found
Jul 06 23:56:11.099868 ip-10-0-129-23 kubenswrapper[2578]: E0706 23:56:11.099590    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0aaa04d0-1e6e-42c1-887b-bb6b96c8ea4a-service-ca-bundle podName:0aaa04d0-1e6e-42c1-887b-bb6b96c8ea4a nodeName:}" failed. No retries permitted until 2026-07-06 23:56:13.099580233 +0000 UTC m=+39.210654018 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/0aaa04d0-1e6e-42c1-887b-bb6b96c8ea4a-service-ca-bundle") pod "router-default-ff7bb96c-8p6lk" (UID: "0aaa04d0-1e6e-42c1-887b-bb6b96c8ea4a") : configmap references non-existent config key: service-ca.crt
Jul 06 23:56:11.099868 ip-10-0-129-23 kubenswrapper[2578]: E0706 23:56:11.099643    2578 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 06 23:56:11.099868 ip-10-0-129-23 kubenswrapper[2578]: E0706 23:56:11.099671    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7631f141-62e9-410a-ba79-c1bdcad24e4e-networking-console-plugin-cert podName:7631f141-62e9-410a-ba79-c1bdcad24e4e nodeName:}" failed. No retries permitted until 2026-07-06 23:56:13.09966147 +0000 UTC m=+39.210735256 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/7631f141-62e9-410a-ba79-c1bdcad24e4e-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-f2xzn" (UID: "7631f141-62e9-410a-ba79-c1bdcad24e4e") : secret "networking-console-plugin-cert" not found
Jul 06 23:56:11.099868 ip-10-0-129-23 kubenswrapper[2578]: E0706 23:56:11.099724    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 23:56:11.100755 ip-10-0-129-23 kubenswrapper[2578]: E0706 23:56:11.099749    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dd5b072f-a02f-482e-abd1-5dd590d0a93c-metrics-tls podName:dd5b072f-a02f-482e-abd1-5dd590d0a93c nodeName:}" failed. No retries permitted until 2026-07-06 23:56:13.099740304 +0000 UTC m=+39.210814089 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/dd5b072f-a02f-482e-abd1-5dd590d0a93c-metrics-tls") pod "dns-default-g7n6m" (UID: "dd5b072f-a02f-482e-abd1-5dd590d0a93c") : secret "dns-default-metrics-tls" not found
Jul 06 23:56:11.100755 ip-10-0-129-23 kubenswrapper[2578]: E0706 23:56:11.099811    2578 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 06 23:56:11.100755 ip-10-0-129-23 kubenswrapper[2578]: E0706 23:56:11.099837    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0aaa04d0-1e6e-42c1-887b-bb6b96c8ea4a-metrics-certs podName:0aaa04d0-1e6e-42c1-887b-bb6b96c8ea4a nodeName:}" failed. No retries permitted until 2026-07-06 23:56:13.099827326 +0000 UTC m=+39.210901110 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0aaa04d0-1e6e-42c1-887b-bb6b96c8ea4a-metrics-certs") pod "router-default-ff7bb96c-8p6lk" (UID: "0aaa04d0-1e6e-42c1-887b-bb6b96c8ea4a") : secret "router-metrics-certs-default" not found
Jul 06 23:56:12.333538 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:12.333238    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsn2_9a5fa453-505c-4742-86da-db343c8d36af/konnectivity-agent/0.log" limit=1024
Jul 06 23:56:12.415176 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:12.415010    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsn2_9a5fa453-505c-4742-86da-db343c8d36af/konnectivity-agent/0.log" limit=1024
Jul 06 23:56:12.470060 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:12.470028    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsn2_9a5fa453-505c-4742-86da-db343c8d36af/konnectivity-agent/0.log" limit=1024
Jul 06 23:56:12.722928 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:12.722885    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-k2rvp" event={"ID":"eef5edeb-c57a-4632-8215-ced4738392a8","Type":"ContainerStarted","Data":"cfa584965414ed589565994ff24cde227d526fa69d4402d58b6bf52284c61059"}
Jul 06 23:56:12.836952 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:12.836873    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsn2_9a5fa453-505c-4742-86da-db343c8d36af/konnectivity-agent/0.log" limit=1024
Jul 06 23:56:13.018817 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:13.018739    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/2a199158-37fe-4467-ae56-2268721f790e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-rzrpw\" (UID: \"2a199158-37fe-4467-ae56-2268721f790e\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-rzrpw"
Jul 06 23:56:13.018959 ip-10-0-129-23 kubenswrapper[2578]: E0706 23:56:13.018893    2578 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 06 23:56:13.019000 ip-10-0-129-23 kubenswrapper[2578]: E0706 23:56:13.018974    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2a199158-37fe-4467-ae56-2268721f790e-cluster-monitoring-operator-tls podName:2a199158-37fe-4467-ae56-2268721f790e nodeName:}" failed. No retries permitted until 2026-07-06 23:56:17.018952419 +0000 UTC m=+43.130026236 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/2a199158-37fe-4467-ae56-2268721f790e-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-rzrpw" (UID: "2a199158-37fe-4467-ae56-2268721f790e") : secret "cluster-monitoring-operator-tls" not found
Jul 06 23:56:13.119841 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:13.119808    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/4e16f8f2-9fde-4234-9392-e1465eebb6e0-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-d5dmf\" (UID: \"4e16f8f2-9fde-4234-9392-e1465eebb6e0\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-d5dmf"
Jul 06 23:56:13.120001 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:13.119880    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0aaa04d0-1e6e-42c1-887b-bb6b96c8ea4a-service-ca-bundle\") pod \"router-default-ff7bb96c-8p6lk\" (UID: \"0aaa04d0-1e6e-42c1-887b-bb6b96c8ea4a\") " pod="openshift-ingress/router-default-ff7bb96c-8p6lk"
Jul 06 23:56:13.120001 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:13.119931    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7631f141-62e9-410a-ba79-c1bdcad24e4e-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-f2xzn\" (UID: \"7631f141-62e9-410a-ba79-c1bdcad24e4e\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-f2xzn"
Jul 06 23:56:13.120001 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:13.119959    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dd5b072f-a02f-482e-abd1-5dd590d0a93c-metrics-tls\") pod \"dns-default-g7n6m\" (UID: \"dd5b072f-a02f-482e-abd1-5dd590d0a93c\") " pod="openshift-dns/dns-default-g7n6m"
Jul 06 23:56:13.120001 ip-10-0-129-23 kubenswrapper[2578]: E0706 23:56:13.119974    2578 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 06 23:56:13.120001 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:13.119996    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0aaa04d0-1e6e-42c1-887b-bb6b96c8ea4a-metrics-certs\") pod \"router-default-ff7bb96c-8p6lk\" (UID: \"0aaa04d0-1e6e-42c1-887b-bb6b96c8ea4a\") " pod="openshift-ingress/router-default-ff7bb96c-8p6lk"
Jul 06 23:56:13.120231 ip-10-0-129-23 kubenswrapper[2578]: E0706 23:56:13.120042    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e16f8f2-9fde-4234-9392-e1465eebb6e0-samples-operator-tls podName:4e16f8f2-9fde-4234-9392-e1465eebb6e0 nodeName:}" failed. No retries permitted until 2026-07-06 23:56:17.12002148 +0000 UTC m=+43.231095277 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/4e16f8f2-9fde-4234-9392-e1465eebb6e0-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-d5dmf" (UID: "4e16f8f2-9fde-4234-9392-e1465eebb6e0") : secret "samples-operator-tls" not found
Jul 06 23:56:13.120231 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:13.120067    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e2139ac9-3d13-4d35-8344-b94be920985a-registry-tls\") pod \"image-registry-6d5ddc46dd-hpvrn\" (UID: \"e2139ac9-3d13-4d35-8344-b94be920985a\") " pod="openshift-image-registry/image-registry-6d5ddc46dd-hpvrn"
Jul 06 23:56:13.120231 ip-10-0-129-23 kubenswrapper[2578]: E0706 23:56:13.120086    2578 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 06 23:56:13.120231 ip-10-0-129-23 kubenswrapper[2578]: E0706 23:56:13.120128    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7631f141-62e9-410a-ba79-c1bdcad24e4e-networking-console-plugin-cert podName:7631f141-62e9-410a-ba79-c1bdcad24e4e nodeName:}" failed. No retries permitted until 2026-07-06 23:56:17.1201137 +0000 UTC m=+43.231187486 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/7631f141-62e9-410a-ba79-c1bdcad24e4e-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-f2xzn" (UID: "7631f141-62e9-410a-ba79-c1bdcad24e4e") : secret "networking-console-plugin-cert" not found
Jul 06 23:56:13.120231 ip-10-0-129-23 kubenswrapper[2578]: E0706 23:56:13.120136    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 23:56:13.120231 ip-10-0-129-23 kubenswrapper[2578]: E0706 23:56:13.120145    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0aaa04d0-1e6e-42c1-887b-bb6b96c8ea4a-service-ca-bundle podName:0aaa04d0-1e6e-42c1-887b-bb6b96c8ea4a nodeName:}" failed. No retries permitted until 2026-07-06 23:56:17.120135875 +0000 UTC m=+43.231209659 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/0aaa04d0-1e6e-42c1-887b-bb6b96c8ea4a-service-ca-bundle") pod "router-default-ff7bb96c-8p6lk" (UID: "0aaa04d0-1e6e-42c1-887b-bb6b96c8ea4a") : configmap references non-existent config key: service-ca.crt
Jul 06 23:56:13.120231 ip-10-0-129-23 kubenswrapper[2578]: E0706 23:56:13.120086    2578 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 06 23:56:13.120231 ip-10-0-129-23 kubenswrapper[2578]: E0706 23:56:13.120168    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dd5b072f-a02f-482e-abd1-5dd590d0a93c-metrics-tls podName:dd5b072f-a02f-482e-abd1-5dd590d0a93c nodeName:}" failed. No retries permitted until 2026-07-06 23:56:17.120158205 +0000 UTC m=+43.231232012 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/dd5b072f-a02f-482e-abd1-5dd590d0a93c-metrics-tls") pod "dns-default-g7n6m" (UID: "dd5b072f-a02f-482e-abd1-5dd590d0a93c") : secret "dns-default-metrics-tls" not found
Jul 06 23:56:13.120231 ip-10-0-129-23 kubenswrapper[2578]: E0706 23:56:13.120183    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0aaa04d0-1e6e-42c1-887b-bb6b96c8ea4a-metrics-certs podName:0aaa04d0-1e6e-42c1-887b-bb6b96c8ea4a nodeName:}" failed. No retries permitted until 2026-07-06 23:56:17.120174139 +0000 UTC m=+43.231247921 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0aaa04d0-1e6e-42c1-887b-bb6b96c8ea4a-metrics-certs") pod "router-default-ff7bb96c-8p6lk" (UID: "0aaa04d0-1e6e-42c1-887b-bb6b96c8ea4a") : secret "router-metrics-certs-default" not found
Jul 06 23:56:13.120231 ip-10-0-129-23 kubenswrapper[2578]: E0706 23:56:13.120220    2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 06 23:56:13.120231 ip-10-0-129-23 kubenswrapper[2578]: E0706 23:56:13.120231    2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6d5ddc46dd-hpvrn: secret "image-registry-tls" not found
Jul 06 23:56:13.120719 ip-10-0-129-23 kubenswrapper[2578]: E0706 23:56:13.120252    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e2139ac9-3d13-4d35-8344-b94be920985a-registry-tls podName:e2139ac9-3d13-4d35-8344-b94be920985a nodeName:}" failed. No retries permitted until 2026-07-06 23:56:17.120245949 +0000 UTC m=+43.231319730 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e2139ac9-3d13-4d35-8344-b94be920985a-registry-tls") pod "image-registry-6d5ddc46dd-hpvrn" (UID: "e2139ac9-3d13-4d35-8344-b94be920985a") : secret "image-registry-tls" not found
Jul 06 23:56:17.053694 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:17.053659    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/2a199158-37fe-4467-ae56-2268721f790e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-rzrpw\" (UID: \"2a199158-37fe-4467-ae56-2268721f790e\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-rzrpw"
Jul 06 23:56:17.054149 ip-10-0-129-23 kubenswrapper[2578]: E0706 23:56:17.053814    2578 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 06 23:56:17.054149 ip-10-0-129-23 kubenswrapper[2578]: E0706 23:56:17.053897    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2a199158-37fe-4467-ae56-2268721f790e-cluster-monitoring-operator-tls podName:2a199158-37fe-4467-ae56-2268721f790e nodeName:}" failed. No retries permitted until 2026-07-06 23:56:25.053879594 +0000 UTC m=+51.164953376 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/2a199158-37fe-4467-ae56-2268721f790e-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-rzrpw" (UID: "2a199158-37fe-4467-ae56-2268721f790e") : secret "cluster-monitoring-operator-tls" not found
Jul 06 23:56:17.154548 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:17.154519    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/4e16f8f2-9fde-4234-9392-e1465eebb6e0-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-d5dmf\" (UID: \"4e16f8f2-9fde-4234-9392-e1465eebb6e0\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-d5dmf"
Jul 06 23:56:17.154688 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:17.154589    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0aaa04d0-1e6e-42c1-887b-bb6b96c8ea4a-service-ca-bundle\") pod \"router-default-ff7bb96c-8p6lk\" (UID: \"0aaa04d0-1e6e-42c1-887b-bb6b96c8ea4a\") " pod="openshift-ingress/router-default-ff7bb96c-8p6lk"
Jul 06 23:56:17.154688 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:17.154642    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7631f141-62e9-410a-ba79-c1bdcad24e4e-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-f2xzn\" (UID: \"7631f141-62e9-410a-ba79-c1bdcad24e4e\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-f2xzn"
Jul 06 23:56:17.154688 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:17.154665    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dd5b072f-a02f-482e-abd1-5dd590d0a93c-metrics-tls\") pod \"dns-default-g7n6m\" (UID: \"dd5b072f-a02f-482e-abd1-5dd590d0a93c\") " pod="openshift-dns/dns-default-g7n6m"
Jul 06 23:56:17.154907 ip-10-0-129-23 kubenswrapper[2578]: E0706 23:56:17.154687    2578 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 06 23:56:17.154907 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:17.154702    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0aaa04d0-1e6e-42c1-887b-bb6b96c8ea4a-metrics-certs\") pod \"router-default-ff7bb96c-8p6lk\" (UID: \"0aaa04d0-1e6e-42c1-887b-bb6b96c8ea4a\") " pod="openshift-ingress/router-default-ff7bb96c-8p6lk"
Jul 06 23:56:17.154907 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:17.154736    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e2139ac9-3d13-4d35-8344-b94be920985a-registry-tls\") pod \"image-registry-6d5ddc46dd-hpvrn\" (UID: \"e2139ac9-3d13-4d35-8344-b94be920985a\") " pod="openshift-image-registry/image-registry-6d5ddc46dd-hpvrn"
Jul 06 23:56:17.154907 ip-10-0-129-23 kubenswrapper[2578]: E0706 23:56:17.154767    2578 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 06 23:56:17.154907 ip-10-0-129-23 kubenswrapper[2578]: E0706 23:56:17.154805    2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 06 23:56:17.154907 ip-10-0-129-23 kubenswrapper[2578]: E0706 23:56:17.154810    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 23:56:17.154907 ip-10-0-129-23 kubenswrapper[2578]: E0706 23:56:17.154818    2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6d5ddc46dd-hpvrn: secret "image-registry-tls" not found
Jul 06 23:56:17.154907 ip-10-0-129-23 kubenswrapper[2578]: E0706 23:56:17.154865    2578 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 06 23:56:17.154907 ip-10-0-129-23 kubenswrapper[2578]: E0706 23:56:17.154770    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e16f8f2-9fde-4234-9392-e1465eebb6e0-samples-operator-tls podName:4e16f8f2-9fde-4234-9392-e1465eebb6e0 nodeName:}" failed. No retries permitted until 2026-07-06 23:56:25.154749081 +0000 UTC m=+51.265822880 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/4e16f8f2-9fde-4234-9392-e1465eebb6e0-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-d5dmf" (UID: "4e16f8f2-9fde-4234-9392-e1465eebb6e0") : secret "samples-operator-tls" not found
Jul 06 23:56:17.154907 ip-10-0-129-23 kubenswrapper[2578]: E0706 23:56:17.154898    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0aaa04d0-1e6e-42c1-887b-bb6b96c8ea4a-service-ca-bundle podName:0aaa04d0-1e6e-42c1-887b-bb6b96c8ea4a nodeName:}" failed. No retries permitted until 2026-07-06 23:56:25.154881736 +0000 UTC m=+51.265955525 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/0aaa04d0-1e6e-42c1-887b-bb6b96c8ea4a-service-ca-bundle") pod "router-default-ff7bb96c-8p6lk" (UID: "0aaa04d0-1e6e-42c1-887b-bb6b96c8ea4a") : configmap references non-existent config key: service-ca.crt
Jul 06 23:56:17.155270 ip-10-0-129-23 kubenswrapper[2578]: E0706 23:56:17.154947    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7631f141-62e9-410a-ba79-c1bdcad24e4e-networking-console-plugin-cert podName:7631f141-62e9-410a-ba79-c1bdcad24e4e nodeName:}" failed. No retries permitted until 2026-07-06 23:56:25.154932663 +0000 UTC m=+51.266006444 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/7631f141-62e9-410a-ba79-c1bdcad24e4e-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-f2xzn" (UID: "7631f141-62e9-410a-ba79-c1bdcad24e4e") : secret "networking-console-plugin-cert" not found
Jul 06 23:56:17.155270 ip-10-0-129-23 kubenswrapper[2578]: E0706 23:56:17.154961    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dd5b072f-a02f-482e-abd1-5dd590d0a93c-metrics-tls podName:dd5b072f-a02f-482e-abd1-5dd590d0a93c nodeName:}" failed. No retries permitted until 2026-07-06 23:56:25.154954654 +0000 UTC m=+51.266028435 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/dd5b072f-a02f-482e-abd1-5dd590d0a93c-metrics-tls") pod "dns-default-g7n6m" (UID: "dd5b072f-a02f-482e-abd1-5dd590d0a93c") : secret "dns-default-metrics-tls" not found
Jul 06 23:56:17.155270 ip-10-0-129-23 kubenswrapper[2578]: E0706 23:56:17.154971    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e2139ac9-3d13-4d35-8344-b94be920985a-registry-tls podName:e2139ac9-3d13-4d35-8344-b94be920985a nodeName:}" failed. No retries permitted until 2026-07-06 23:56:25.154966466 +0000 UTC m=+51.266040247 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e2139ac9-3d13-4d35-8344-b94be920985a-registry-tls") pod "image-registry-6d5ddc46dd-hpvrn" (UID: "e2139ac9-3d13-4d35-8344-b94be920985a") : secret "image-registry-tls" not found
Jul 06 23:56:17.155270 ip-10-0-129-23 kubenswrapper[2578]: E0706 23:56:17.154980    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0aaa04d0-1e6e-42c1-887b-bb6b96c8ea4a-metrics-certs podName:0aaa04d0-1e6e-42c1-887b-bb6b96c8ea4a nodeName:}" failed. No retries permitted until 2026-07-06 23:56:25.154976163 +0000 UTC m=+51.266049944 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0aaa04d0-1e6e-42c1-887b-bb6b96c8ea4a-metrics-certs") pod "router-default-ff7bb96c-8p6lk" (UID: "0aaa04d0-1e6e-42c1-887b-bb6b96c8ea4a") : secret "router-metrics-certs-default" not found
Jul 06 23:56:19.712017 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:19.711794    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsn2_9a5fa453-505c-4742-86da-db343c8d36af/konnectivity-agent/0.log" limit=1024
Jul 06 23:56:19.747752 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:19.747721    2578 generic.go:356] "Generic (PLEG): container finished" podID="b9a2aa01-bfc8-40f8-b4d7-962428e95667" containerID="0f60254a6f5fe384a8d6b5bf49dc97353527ad535029e0b90ea60767ffcabc5c" exitCode=0
Jul 06 23:56:19.747880 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:19.747799    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kmhhp" event={"ID":"b9a2aa01-bfc8-40f8-b4d7-962428e95667","Type":"ContainerDied","Data":"0f60254a6f5fe384a8d6b5bf49dc97353527ad535029e0b90ea60767ffcabc5c"}
Jul 06 23:56:19.749709 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:19.749692    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-7gjwb_1116f765-1ebd-4c12-9ebb-ed7b7760391c/console-operator/0.log"
Jul 06 23:56:19.749813 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:19.749719    2578 generic.go:356] "Generic (PLEG): container finished" podID="1116f765-1ebd-4c12-9ebb-ed7b7760391c" containerID="45832807eb718f50e80994efb315fc3675a60a8b891f545601136b618e3d8f17" exitCode=255
Jul 06 23:56:19.749964 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:19.749901    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-7gjwb" event={"ID":"1116f765-1ebd-4c12-9ebb-ed7b7760391c","Type":"ContainerDied","Data":"45832807eb718f50e80994efb315fc3675a60a8b891f545601136b618e3d8f17"}
Jul 06 23:56:19.750022 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:19.749999    2578 scope.go:117] "RemoveContainer" containerID="45832807eb718f50e80994efb315fc3675a60a8b891f545601136b618e3d8f17"
Jul 06 23:56:19.753002 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:19.752971    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-fzzq2" event={"ID":"dff531e0-34c6-4281-8705-149154c350e7","Type":"ContainerStarted","Data":"5f1e8a8a4ae72c300c5251551107eea19ea8a2fa6963cbc8b300b888bafa5d1b"}
Jul 06 23:56:19.754674 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:19.754618    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-rx7w7" event={"ID":"67c209fe-6215-4191-adfb-81d0bcc8e4bd","Type":"ContainerStarted","Data":"14c35cab03a5cbfecd1bd18bc6f65177b0e70c28428094e8a98ab4a7482b8fea"}
Jul 06 23:56:19.757594 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:19.757576    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-tp5dt" event={"ID":"2e2aa079-1812-4f96-a29d-3926a0fb14e5","Type":"ContainerStarted","Data":"eea0cc911ba8e9de3320b72b394f2a7a8f536187fe0a167b619906bc1e1ce8eb"}
Jul 06 23:56:19.759057 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:19.759025    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-d7x6n" event={"ID":"f5691201-8c3c-4bd5-8fbb-41e8ddd87e4e","Type":"ContainerStarted","Data":"c0ce0ce920270d0f19f6888d8dfd5d62d784e746d5b390c3d0e32c7f9ce127f5"}
Jul 06 23:56:19.760503 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:19.760484    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-jvf67" event={"ID":"38b01eb6-03b7-4fe6-803c-e7cfb4d355a9","Type":"ContainerStarted","Data":"2bf272a4d3554ab62be12a9fdd16ba5204693412c3e7e86523651c4d886bbc07"}
Jul 06 23:56:19.776449 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:19.775635    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-k2rvp" podStartSLOduration=25.878384172 podStartE2EDuration="27.775619795s" totalImagesPullingTime="1.897235623s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:55:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:56:12.743710809 +0000 UTC m=+38.854784623" watchObservedRunningTime="2026-07-06 23:56:19.775619795 +0000 UTC m=+45.886693600"
Jul 06 23:56:19.821399 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:19.821344    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-d7x6n" podStartSLOduration=1.567764245 podStartE2EDuration="10.821326469s" totalImagesPullingTime="9.253562224s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:56:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:56:19.820879758 +0000 UTC m=+45.931953566" watchObservedRunningTime="2026-07-06 23:56:19.821326469 +0000 UTC m=+45.932400271"
Jul 06 23:56:19.823430 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:19.823394    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-tp5dt" podStartSLOduration=11.524827032 podStartE2EDuration="20.82338423s" totalImagesPullingTime="9.298557198s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:55:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:56:19.804707402 +0000 UTC m=+45.915781197" watchObservedRunningTime="2026-07-06 23:56:19.82338423 +0000 UTC m=+45.934458031"
Jul 06 23:56:19.850720 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:19.850681    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5c847dcfc4-jvf67" podStartSLOduration=18.554355055 podStartE2EDuration="27.850667879s" totalImagesPullingTime="9.296312824s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:55:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:56:19.849950483 +0000 UTC m=+45.961024286" watchObservedRunningTime="2026-07-06 23:56:19.850667879 +0000 UTC m=+45.961741682"
Jul 06 23:56:19.874903 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:19.874214    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-rx7w7" podStartSLOduration=12.590376365000001 podStartE2EDuration="21.874194754s" totalImagesPullingTime="9.283818389s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:55:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:56:19.873111494 +0000 UTC m=+45.984185297" watchObservedRunningTime="2026-07-06 23:56:19.874194754 +0000 UTC m=+45.985268562"
Jul 06 23:56:19.902040 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:19.901993    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-fzzq2" podStartSLOduration=14.632679157 podStartE2EDuration="23.901973996s" totalImagesPullingTime="9.269294839s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:55:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:56:19.901202547 +0000 UTC m=+46.012276350" watchObservedRunningTime="2026-07-06 23:56:19.901973996 +0000 UTC m=+46.013047827"
Jul 06 23:56:20.346917 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:20.346884    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsn2_9a5fa453-505c-4742-86da-db343c8d36af/konnectivity-agent/0.log" limit=1024
Jul 06 23:56:20.429184 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:20.429154    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsn2_9a5fa453-505c-4742-86da-db343c8d36af/konnectivity-agent/0.log" limit=1024
Jul 06 23:56:20.506390 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:20.506332    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsn2_9a5fa453-505c-4742-86da-db343c8d36af/konnectivity-agent/0.log" limit=1024
Jul 06 23:56:20.596082 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:20.596051    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsn2_9a5fa453-505c-4742-86da-db343c8d36af/konnectivity-agent/0.log" limit=1024
Jul 06 23:56:20.675877 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:20.675832    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsn2_9a5fa453-505c-4742-86da-db343c8d36af/konnectivity-agent/0.log" limit=1024
Jul 06 23:56:20.767704 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:20.767626    2578 generic.go:356] "Generic (PLEG): container finished" podID="b9a2aa01-bfc8-40f8-b4d7-962428e95667" containerID="65f2d726c4e39043b7281cde827087ddab8964cc6b497dd78361ea25fddc50a2" exitCode=0
Jul 06 23:56:20.768057 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:20.767705    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kmhhp" event={"ID":"b9a2aa01-bfc8-40f8-b4d7-962428e95667","Type":"ContainerDied","Data":"65f2d726c4e39043b7281cde827087ddab8964cc6b497dd78361ea25fddc50a2"}
Jul 06 23:56:20.769412 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:20.769396    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-7gjwb_1116f765-1ebd-4c12-9ebb-ed7b7760391c/console-operator/1.log"
Jul 06 23:56:20.769930 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:20.769912    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-7gjwb_1116f765-1ebd-4c12-9ebb-ed7b7760391c/console-operator/0.log"
Jul 06 23:56:20.770022 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:20.769949    2578 generic.go:356] "Generic (PLEG): container finished" podID="1116f765-1ebd-4c12-9ebb-ed7b7760391c" containerID="5345368ce8a4c8931b7525390a97c6102ee5260ed59f86336220067dc0253465" exitCode=255
Jul 06 23:56:20.770073 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:20.770050    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-7gjwb" event={"ID":"1116f765-1ebd-4c12-9ebb-ed7b7760391c","Type":"ContainerDied","Data":"5345368ce8a4c8931b7525390a97c6102ee5260ed59f86336220067dc0253465"}
Jul 06 23:56:20.770111 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:20.770100    2578 scope.go:117] "RemoveContainer" containerID="45832807eb718f50e80994efb315fc3675a60a8b891f545601136b618e3d8f17"
Jul 06 23:56:20.770235 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:20.770220    2578 scope.go:117] "RemoveContainer" containerID="5345368ce8a4c8931b7525390a97c6102ee5260ed59f86336220067dc0253465"
Jul 06 23:56:20.770417 ip-10-0-129-23 kubenswrapper[2578]: E0706 23:56:20.770395    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-7gjwb_openshift-console-operator(1116f765-1ebd-4c12-9ebb-ed7b7760391c)\"" pod="openshift-console-operator/console-operator-68b757fb67-7gjwb" podUID="1116f765-1ebd-4c12-9ebb-ed7b7760391c"
Jul 06 23:56:20.775250 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:20.775230    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsn2_9a5fa453-505c-4742-86da-db343c8d36af/konnectivity-agent/0.log" limit=1024
Jul 06 23:56:20.840006 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:20.838534    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsn2_9a5fa453-505c-4742-86da-db343c8d36af/konnectivity-agent/0.log" limit=1024
Jul 06 23:56:21.106769 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:21.106676    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsn2_9a5fa453-505c-4742-86da-db343c8d36af/konnectivity-agent/0.log" limit=1024
Jul 06 23:56:21.168957 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:21.168927    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsn2_9a5fa453-505c-4742-86da-db343c8d36af/konnectivity-agent/0.log" limit=1024
Jul 06 23:56:21.276064 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:21.276040    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsn2_9a5fa453-505c-4742-86da-db343c8d36af/konnectivity-agent/0.log" limit=1024
Jul 06 23:56:21.292229 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:21.292202    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-j4xfg"]
Jul 06 23:56:21.313362 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:21.312775    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-j4xfg"
Jul 06 23:56:21.315932 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:21.315806    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-j4xfg"]
Jul 06 23:56:21.317680 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:21.317051    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-cbpw8"]
Jul 06 23:56:21.317680 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:21.317276    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Jul 06 23:56:21.317680 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:21.317549    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-cj8hq\""
Jul 06 23:56:21.317901 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:21.317888    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Jul 06 23:56:21.330628 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:21.330594    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-cbpw8"
Jul 06 23:56:21.335369 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:21.335340    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-274zg\""
Jul 06 23:56:21.335555 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:21.335540    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 06 23:56:21.335729 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:21.335556    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 06 23:56:21.336957 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:21.336934    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-cbpw8"]
Jul 06 23:56:21.373357 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:21.373251    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsn2_9a5fa453-505c-4742-86da-db343c8d36af/konnectivity-agent/0.log" limit=1024
Jul 06 23:56:21.397566 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:21.397541    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/79aa8feb-3527-409b-b097-35ce8c0ea0ef-crio-socket\") pod \"insights-runtime-extractor-cbpw8\" (UID: \"79aa8feb-3527-409b-b097-35ce8c0ea0ef\") " pod="openshift-insights/insights-runtime-extractor-cbpw8"
Jul 06 23:56:21.397649 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:21.397605    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9c875\" (UniqueName: \"kubernetes.io/projected/79aa8feb-3527-409b-b097-35ce8c0ea0ef-kube-api-access-9c875\") pod \"insights-runtime-extractor-cbpw8\" (UID: \"79aa8feb-3527-409b-b097-35ce8c0ea0ef\") " pod="openshift-insights/insights-runtime-extractor-cbpw8"
Jul 06 23:56:21.397649 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:21.397627    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/79aa8feb-3527-409b-b097-35ce8c0ea0ef-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cbpw8\" (UID: \"79aa8feb-3527-409b-b097-35ce8c0ea0ef\") " pod="openshift-insights/insights-runtime-extractor-cbpw8"
Jul 06 23:56:21.397744 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:21.397695    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/79aa8feb-3527-409b-b097-35ce8c0ea0ef-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cbpw8\" (UID: \"79aa8feb-3527-409b-b097-35ce8c0ea0ef\") " pod="openshift-insights/insights-runtime-extractor-cbpw8"
Jul 06 23:56:21.397791 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:21.397749    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/79aa8feb-3527-409b-b097-35ce8c0ea0ef-data-volume\") pod \"insights-runtime-extractor-cbpw8\" (UID: \"79aa8feb-3527-409b-b097-35ce8c0ea0ef\") " pod="openshift-insights/insights-runtime-extractor-cbpw8"
Jul 06 23:56:21.397791 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:21.397764    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qcfz9\" (UniqueName: \"kubernetes.io/projected/73d747b8-0e1f-42be-842a-bfd851b03297-kube-api-access-qcfz9\") pod \"migrator-d57d58cc9-j4xfg\" (UID: \"73d747b8-0e1f-42be-842a-bfd851b03297\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-j4xfg"
Jul 06 23:56:21.471412 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:21.471392    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsn2_9a5fa453-505c-4742-86da-db343c8d36af/konnectivity-agent/0.log" limit=1024
Jul 06 23:56:21.498540 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:21.498517    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/79aa8feb-3527-409b-b097-35ce8c0ea0ef-data-volume\") pod \"insights-runtime-extractor-cbpw8\" (UID: \"79aa8feb-3527-409b-b097-35ce8c0ea0ef\") " pod="openshift-insights/insights-runtime-extractor-cbpw8"
Jul 06 23:56:21.498626 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:21.498544    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qcfz9\" (UniqueName: \"kubernetes.io/projected/73d747b8-0e1f-42be-842a-bfd851b03297-kube-api-access-qcfz9\") pod \"migrator-d57d58cc9-j4xfg\" (UID: \"73d747b8-0e1f-42be-842a-bfd851b03297\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-j4xfg"
Jul 06 23:56:21.498626 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:21.498564    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/79aa8feb-3527-409b-b097-35ce8c0ea0ef-crio-socket\") pod \"insights-runtime-extractor-cbpw8\" (UID: \"79aa8feb-3527-409b-b097-35ce8c0ea0ef\") " pod="openshift-insights/insights-runtime-extractor-cbpw8"
Jul 06 23:56:21.498718 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:21.498647    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/79aa8feb-3527-409b-b097-35ce8c0ea0ef-crio-socket\") pod \"insights-runtime-extractor-cbpw8\" (UID: \"79aa8feb-3527-409b-b097-35ce8c0ea0ef\") " pod="openshift-insights/insights-runtime-extractor-cbpw8"
Jul 06 23:56:21.498772 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:21.498754    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9c875\" (UniqueName: \"kubernetes.io/projected/79aa8feb-3527-409b-b097-35ce8c0ea0ef-kube-api-access-9c875\") pod \"insights-runtime-extractor-cbpw8\" (UID: \"79aa8feb-3527-409b-b097-35ce8c0ea0ef\") " pod="openshift-insights/insights-runtime-extractor-cbpw8"
Jul 06 23:56:21.498831 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:21.498791    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/79aa8feb-3527-409b-b097-35ce8c0ea0ef-data-volume\") pod \"insights-runtime-extractor-cbpw8\" (UID: \"79aa8feb-3527-409b-b097-35ce8c0ea0ef\") " pod="openshift-insights/insights-runtime-extractor-cbpw8"
Jul 06 23:56:21.498875 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:21.498793    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/79aa8feb-3527-409b-b097-35ce8c0ea0ef-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cbpw8\" (UID: \"79aa8feb-3527-409b-b097-35ce8c0ea0ef\") " pod="openshift-insights/insights-runtime-extractor-cbpw8"
Jul 06 23:56:21.498927 ip-10-0-129-23 kubenswrapper[2578]: E0706 23:56:21.498877    2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 06 23:56:21.498978 ip-10-0-129-23 kubenswrapper[2578]: E0706 23:56:21.498936    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/79aa8feb-3527-409b-b097-35ce8c0ea0ef-insights-runtime-extractor-tls podName:79aa8feb-3527-409b-b097-35ce8c0ea0ef nodeName:}" failed. No retries permitted until 2026-07-06 23:56:21.998917616 +0000 UTC m=+48.109991411 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/79aa8feb-3527-409b-b097-35ce8c0ea0ef-insights-runtime-extractor-tls") pod "insights-runtime-extractor-cbpw8" (UID: "79aa8feb-3527-409b-b097-35ce8c0ea0ef") : secret "insights-runtime-extractor-tls" not found
Jul 06 23:56:21.498978 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:21.498958    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/79aa8feb-3527-409b-b097-35ce8c0ea0ef-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cbpw8\" (UID: \"79aa8feb-3527-409b-b097-35ce8c0ea0ef\") " pod="openshift-insights/insights-runtime-extractor-cbpw8"
Jul 06 23:56:21.499093 ip-10-0-129-23 kubenswrapper[2578]: E0706 23:56:21.499069    2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 06 23:56:21.499142 ip-10-0-129-23 kubenswrapper[2578]: E0706 23:56:21.499115    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/79aa8feb-3527-409b-b097-35ce8c0ea0ef-kube-rbac-proxy-cm podName:79aa8feb-3527-409b-b097-35ce8c0ea0ef nodeName:}" failed. No retries permitted until 2026-07-06 23:56:21.999100626 +0000 UTC m=+48.110174423 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/79aa8feb-3527-409b-b097-35ce8c0ea0ef-kube-rbac-proxy-cm") pod "insights-runtime-extractor-cbpw8" (UID: "79aa8feb-3527-409b-b097-35ce8c0ea0ef") : configmap "kube-rbac-proxy" not found
Jul 06 23:56:21.512223 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:21.512201    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qcfz9\" (UniqueName: \"kubernetes.io/projected/73d747b8-0e1f-42be-842a-bfd851b03297-kube-api-access-qcfz9\") pod \"migrator-d57d58cc9-j4xfg\" (UID: \"73d747b8-0e1f-42be-842a-bfd851b03297\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-j4xfg"
Jul 06 23:56:21.512341 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:21.512235    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9c875\" (UniqueName: \"kubernetes.io/projected/79aa8feb-3527-409b-b097-35ce8c0ea0ef-kube-api-access-9c875\") pod \"insights-runtime-extractor-cbpw8\" (UID: \"79aa8feb-3527-409b-b097-35ce8c0ea0ef\") " pod="openshift-insights/insights-runtime-extractor-cbpw8"
Jul 06 23:56:21.625994 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:21.625904    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-j4xfg"
Jul 06 23:56:21.764884 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:21.764727    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-j4xfg"]
Jul 06 23:56:21.767524 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:56:21.767477    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73d747b8_0e1f_42be_842a_bfd851b03297.slice/crio-252ca9dc7f5cdc331704e8a2e4b473fba8ce3e20d16277293145a649307c5d56 WatchSource:0}: Error finding container 252ca9dc7f5cdc331704e8a2e4b473fba8ce3e20d16277293145a649307c5d56: Status 404 returned error can't find the container with id 252ca9dc7f5cdc331704e8a2e4b473fba8ce3e20d16277293145a649307c5d56
Jul 06 23:56:21.767676 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:21.767619    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsn2_9a5fa453-505c-4742-86da-db343c8d36af/konnectivity-agent/0.log" limit=1024
Jul 06 23:56:21.775128 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:21.775106    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-j4xfg" event={"ID":"73d747b8-0e1f-42be-842a-bfd851b03297","Type":"ContainerStarted","Data":"252ca9dc7f5cdc331704e8a2e4b473fba8ce3e20d16277293145a649307c5d56"}
Jul 06 23:56:21.778450 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:21.778427    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kmhhp" event={"ID":"b9a2aa01-bfc8-40f8-b4d7-962428e95667","Type":"ContainerStarted","Data":"65f9ef189431ffcd1ed9f54d6f3df9c4262caa8fe43a749113e241bf4ca93d26"}
Jul 06 23:56:21.779934 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:21.779917    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-7gjwb_1116f765-1ebd-4c12-9ebb-ed7b7760391c/console-operator/1.log"
Jul 06 23:56:21.780182 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:21.780169    2578 scope.go:117] "RemoveContainer" containerID="5345368ce8a4c8931b7525390a97c6102ee5260ed59f86336220067dc0253465"
Jul 06 23:56:21.780330 ip-10-0-129-23 kubenswrapper[2578]: E0706 23:56:21.780314    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-7gjwb_openshift-console-operator(1116f765-1ebd-4c12-9ebb-ed7b7760391c)\"" pod="openshift-console-operator/console-operator-68b757fb67-7gjwb" podUID="1116f765-1ebd-4c12-9ebb-ed7b7760391c"
Jul 06 23:56:21.803269 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:21.803232    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-kmhhp" podStartSLOduration=13.119720054 podStartE2EDuration="47.803220337s" totalImagesPullingTime="34.683500283s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 23:55:34 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:56:21.801228947 +0000 UTC m=+47.912302749" watchObservedRunningTime="2026-07-06 23:56:21.803220337 +0000 UTC m=+47.914294139"
Jul 06 23:56:21.835878 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:21.835852    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsn2_9a5fa453-505c-4742-86da-db343c8d36af/konnectivity-agent/0.log" limit=1024
Jul 06 23:56:22.003341 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:22.003317    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/79aa8feb-3527-409b-b097-35ce8c0ea0ef-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cbpw8\" (UID: \"79aa8feb-3527-409b-b097-35ce8c0ea0ef\") " pod="openshift-insights/insights-runtime-extractor-cbpw8"
Jul 06 23:56:22.003432 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:22.003415    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/79aa8feb-3527-409b-b097-35ce8c0ea0ef-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cbpw8\" (UID: \"79aa8feb-3527-409b-b097-35ce8c0ea0ef\") " pod="openshift-insights/insights-runtime-extractor-cbpw8"
Jul 06 23:56:22.003478 ip-10-0-129-23 kubenswrapper[2578]: E0706 23:56:22.003437    2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 06 23:56:22.003508 ip-10-0-129-23 kubenswrapper[2578]: E0706 23:56:22.003487    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/79aa8feb-3527-409b-b097-35ce8c0ea0ef-insights-runtime-extractor-tls podName:79aa8feb-3527-409b-b097-35ce8c0ea0ef nodeName:}" failed. No retries permitted until 2026-07-06 23:56:23.00347106 +0000 UTC m=+49.114544858 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/79aa8feb-3527-409b-b097-35ce8c0ea0ef-insights-runtime-extractor-tls") pod "insights-runtime-extractor-cbpw8" (UID: "79aa8feb-3527-409b-b097-35ce8c0ea0ef") : secret "insights-runtime-extractor-tls" not found
Jul 06 23:56:22.003508 ip-10-0-129-23 kubenswrapper[2578]: E0706 23:56:22.003501    2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 06 23:56:22.003570 ip-10-0-129-23 kubenswrapper[2578]: E0706 23:56:22.003534    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/79aa8feb-3527-409b-b097-35ce8c0ea0ef-kube-rbac-proxy-cm podName:79aa8feb-3527-409b-b097-35ce8c0ea0ef nodeName:}" failed. No retries permitted until 2026-07-06 23:56:23.003522455 +0000 UTC m=+49.114596236 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/79aa8feb-3527-409b-b097-35ce8c0ea0ef-kube-rbac-proxy-cm") pod "insights-runtime-extractor-cbpw8" (UID: "79aa8feb-3527-409b-b097-35ce8c0ea0ef") : configmap "kube-rbac-proxy" not found
Jul 06 23:56:22.566961 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:22.566939    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsn2_9a5fa453-505c-4742-86da-db343c8d36af/konnectivity-agent/0.log" limit=1024
Jul 06 23:56:22.668125 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:22.668095    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsn2_9a5fa453-505c-4742-86da-db343c8d36af/konnectivity-agent/0.log" limit=1024
Jul 06 23:56:22.977329 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:22.977275    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsn2_9a5fa453-505c-4742-86da-db343c8d36af/konnectivity-agent/0.log" limit=1024
Jul 06 23:56:22.977725 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:22.977386    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-758f599c5-54x79"]
Jul 06 23:56:22.991560 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:22.991532    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-758f599c5-54x79"]
Jul 06 23:56:22.991666 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:22.991627    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-758f599c5-54x79"
Jul 06 23:56:22.994730 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:22.994710    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Jul 06 23:56:22.995451 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:22.995429    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Jul 06 23:56:22.995553 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:22.995468    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Jul 06 23:56:22.995616 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:22.995565    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-jjtmc\""
Jul 06 23:56:22.995711 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:22.995695    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Jul 06 23:56:23.013413 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:23.013393    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/79aa8feb-3527-409b-b097-35ce8c0ea0ef-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cbpw8\" (UID: \"79aa8feb-3527-409b-b097-35ce8c0ea0ef\") " pod="openshift-insights/insights-runtime-extractor-cbpw8"
Jul 06 23:56:23.013511 ip-10-0-129-23 kubenswrapper[2578]: E0706 23:56:23.013496    2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 06 23:56:23.013550 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:23.013505    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/79aa8feb-3527-409b-b097-35ce8c0ea0ef-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cbpw8\" (UID: \"79aa8feb-3527-409b-b097-35ce8c0ea0ef\") " pod="openshift-insights/insights-runtime-extractor-cbpw8"
Jul 06 23:56:23.013582 ip-10-0-129-23 kubenswrapper[2578]: E0706 23:56:23.013566    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/79aa8feb-3527-409b-b097-35ce8c0ea0ef-kube-rbac-proxy-cm podName:79aa8feb-3527-409b-b097-35ce8c0ea0ef nodeName:}" failed. No retries permitted until 2026-07-06 23:56:25.013552678 +0000 UTC m=+51.124626459 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/79aa8feb-3527-409b-b097-35ce8c0ea0ef-kube-rbac-proxy-cm") pod "insights-runtime-extractor-cbpw8" (UID: "79aa8feb-3527-409b-b097-35ce8c0ea0ef") : configmap "kube-rbac-proxy" not found
Jul 06 23:56:23.013618 ip-10-0-129-23 kubenswrapper[2578]: E0706 23:56:23.013597    2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 06 23:56:23.013659 ip-10-0-129-23 kubenswrapper[2578]: E0706 23:56:23.013649    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/79aa8feb-3527-409b-b097-35ce8c0ea0ef-insights-runtime-extractor-tls podName:79aa8feb-3527-409b-b097-35ce8c0ea0ef nodeName:}" failed. No retries permitted until 2026-07-06 23:56:25.013633921 +0000 UTC m=+51.124707718 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/79aa8feb-3527-409b-b097-35ce8c0ea0ef-insights-runtime-extractor-tls") pod "insights-runtime-extractor-cbpw8" (UID: "79aa8feb-3527-409b-b097-35ce8c0ea0ef") : secret "insights-runtime-extractor-tls" not found
Jul 06 23:56:23.036472 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:23.036446    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsn2_9a5fa453-505c-4742-86da-db343c8d36af/konnectivity-agent/0.log" limit=1024
Jul 06 23:56:23.114032 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:23.114012    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/45c703c1-57a5-45d9-afb2-a64aac726ec9-signing-cabundle\") pod \"service-ca-758f599c5-54x79\" (UID: \"45c703c1-57a5-45d9-afb2-a64aac726ec9\") " pod="openshift-service-ca/service-ca-758f599c5-54x79"
Jul 06 23:56:23.114110 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:23.114095    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/45c703c1-57a5-45d9-afb2-a64aac726ec9-signing-key\") pod \"service-ca-758f599c5-54x79\" (UID: \"45c703c1-57a5-45d9-afb2-a64aac726ec9\") " pod="openshift-service-ca/service-ca-758f599c5-54x79"
Jul 06 23:56:23.114173 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:23.114155    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s2w5g\" (UniqueName: \"kubernetes.io/projected/45c703c1-57a5-45d9-afb2-a64aac726ec9-kube-api-access-s2w5g\") pod \"service-ca-758f599c5-54x79\" (UID: \"45c703c1-57a5-45d9-afb2-a64aac726ec9\") " pod="openshift-service-ca/service-ca-758f599c5-54x79"
Jul 06 23:56:23.122263 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:23.122245    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-2h2rk_66f64c88-7770-4613-81c2-97f105d345e5/dns-node-resolver/0.log"
Jul 06 23:56:23.214745 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:23.214717    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/45c703c1-57a5-45d9-afb2-a64aac726ec9-signing-key\") pod \"service-ca-758f599c5-54x79\" (UID: \"45c703c1-57a5-45d9-afb2-a64aac726ec9\") " pod="openshift-service-ca/service-ca-758f599c5-54x79"
Jul 06 23:56:23.214830 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:23.214806    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s2w5g\" (UniqueName: \"kubernetes.io/projected/45c703c1-57a5-45d9-afb2-a64aac726ec9-kube-api-access-s2w5g\") pod \"service-ca-758f599c5-54x79\" (UID: \"45c703c1-57a5-45d9-afb2-a64aac726ec9\") " pod="openshift-service-ca/service-ca-758f599c5-54x79"
Jul 06 23:56:23.214925 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:23.214913    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/45c703c1-57a5-45d9-afb2-a64aac726ec9-signing-cabundle\") pod \"service-ca-758f599c5-54x79\" (UID: \"45c703c1-57a5-45d9-afb2-a64aac726ec9\") " pod="openshift-service-ca/service-ca-758f599c5-54x79"
Jul 06 23:56:23.215652 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:23.215631    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/45c703c1-57a5-45d9-afb2-a64aac726ec9-signing-cabundle\") pod \"service-ca-758f599c5-54x79\" (UID: \"45c703c1-57a5-45d9-afb2-a64aac726ec9\") " pod="openshift-service-ca/service-ca-758f599c5-54x79"
Jul 06 23:56:23.217962 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:23.217946    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/45c703c1-57a5-45d9-afb2-a64aac726ec9-signing-key\") pod \"service-ca-758f599c5-54x79\" (UID: \"45c703c1-57a5-45d9-afb2-a64aac726ec9\") " pod="openshift-service-ca/service-ca-758f599c5-54x79"
Jul 06 23:56:23.223981 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:23.223961    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s2w5g\" (UniqueName: \"kubernetes.io/projected/45c703c1-57a5-45d9-afb2-a64aac726ec9-kube-api-access-s2w5g\") pod \"service-ca-758f599c5-54x79\" (UID: \"45c703c1-57a5-45d9-afb2-a64aac726ec9\") " pod="openshift-service-ca/service-ca-758f599c5-54x79"
Jul 06 23:56:23.303397 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:23.303340    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-758f599c5-54x79"
Jul 06 23:56:23.592790 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:23.592758    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-758f599c5-54x79"]
Jul 06 23:56:23.705384 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:56:23.705357    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45c703c1_57a5_45d9_afb2_a64aac726ec9.slice/crio-88005dd1d7a8685f0a17473c7e607acd68e6c18108354a4c392f361fc2a41f90 WatchSource:0}: Error finding container 88005dd1d7a8685f0a17473c7e607acd68e6c18108354a4c392f361fc2a41f90: Status 404 returned error can't find the container with id 88005dd1d7a8685f0a17473c7e607acd68e6c18108354a4c392f361fc2a41f90
Jul 06 23:56:23.736402 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:23.736375    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsn2_9a5fa453-505c-4742-86da-db343c8d36af/konnectivity-agent/0.log" limit=1024
Jul 06 23:56:23.789978 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:23.789949    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-758f599c5-54x79" event={"ID":"45c703c1-57a5-45d9-afb2-a64aac726ec9","Type":"ContainerStarted","Data":"88005dd1d7a8685f0a17473c7e607acd68e6c18108354a4c392f361fc2a41f90"}
Jul 06 23:56:23.837015 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:23.836989    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsn2_9a5fa453-505c-4742-86da-db343c8d36af/konnectivity-agent/0.log" limit=1024
Jul 06 23:56:23.945506 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:23.945481    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsn2_9a5fa453-505c-4742-86da-db343c8d36af/konnectivity-agent/0.log" limit=1024
Jul 06 23:56:24.316597 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:24.316573    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-qndzw_df4215f7-4f0d-4ba1-b66d-b8902a323531/node-ca/0.log"
Jul 06 23:56:24.794692 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:24.794664    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-j4xfg" event={"ID":"73d747b8-0e1f-42be-842a-bfd851b03297","Type":"ContainerStarted","Data":"c5ded636a8094e6624025a791987969ce7c93f73312638e75548f0d7ba93e85b"}
Jul 06 23:56:24.794860 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:24.794714    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-j4xfg" event={"ID":"73d747b8-0e1f-42be-842a-bfd851b03297","Type":"ContainerStarted","Data":"f39463ad349114c39f1117bca38cb607a608feda4f368c76619e96aa7d053928"}
Jul 06 23:56:24.796208 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:24.796185    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-758f599c5-54x79" event={"ID":"45c703c1-57a5-45d9-afb2-a64aac726ec9","Type":"ContainerStarted","Data":"8b1627011cef2bf012b1d628d7835f4a986e1c8ed3eb538bf27d68859f9ff359"}
Jul 06 23:56:24.810881 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:24.810843    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-j4xfg" podStartSLOduration=1.8591240359999999 podStartE2EDuration="3.810831719s" totalImagesPullingTime="1.951707683s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:56:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:56:24.810397931 +0000 UTC m=+50.921471736" watchObservedRunningTime="2026-07-06 23:56:24.810831719 +0000 UTC m=+50.921905537"
Jul 06 23:56:24.826594 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:24.826555    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-758f599c5-54x79" podStartSLOduration=2.826542544 podStartE2EDuration="2.826542544s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:56:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:56:24.825628939 +0000 UTC m=+50.936702743" watchObservedRunningTime="2026-07-06 23:56:24.826542544 +0000 UTC m=+50.937616346"
Jul 06 23:56:24.920879 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:24.920851    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-d7x6n_f5691201-8c3c-4bd5-8fbb-41e8ddd87e4e/serve-healthcheck-canary/0.log"
Jul 06 23:56:25.029770 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:25.029751    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/79aa8feb-3527-409b-b097-35ce8c0ea0ef-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cbpw8\" (UID: \"79aa8feb-3527-409b-b097-35ce8c0ea0ef\") " pod="openshift-insights/insights-runtime-extractor-cbpw8"
Jul 06 23:56:25.029863 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:25.029826    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/79aa8feb-3527-409b-b097-35ce8c0ea0ef-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cbpw8\" (UID: \"79aa8feb-3527-409b-b097-35ce8c0ea0ef\") " pod="openshift-insights/insights-runtime-extractor-cbpw8"
Jul 06 23:56:25.029906 ip-10-0-129-23 kubenswrapper[2578]: E0706 23:56:25.029878    2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 06 23:56:25.029906 ip-10-0-129-23 kubenswrapper[2578]: E0706 23:56:25.029890    2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 06 23:56:25.029963 ip-10-0-129-23 kubenswrapper[2578]: E0706 23:56:25.029929    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/79aa8feb-3527-409b-b097-35ce8c0ea0ef-insights-runtime-extractor-tls podName:79aa8feb-3527-409b-b097-35ce8c0ea0ef nodeName:}" failed. No retries permitted until 2026-07-06 23:56:29.02991649 +0000 UTC m=+55.140990271 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/79aa8feb-3527-409b-b097-35ce8c0ea0ef-insights-runtime-extractor-tls") pod "insights-runtime-extractor-cbpw8" (UID: "79aa8feb-3527-409b-b097-35ce8c0ea0ef") : secret "insights-runtime-extractor-tls" not found
Jul 06 23:56:25.029963 ip-10-0-129-23 kubenswrapper[2578]: E0706 23:56:25.029943    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/79aa8feb-3527-409b-b097-35ce8c0ea0ef-kube-rbac-proxy-cm podName:79aa8feb-3527-409b-b097-35ce8c0ea0ef nodeName:}" failed. No retries permitted until 2026-07-06 23:56:29.029936975 +0000 UTC m=+55.141010756 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/79aa8feb-3527-409b-b097-35ce8c0ea0ef-kube-rbac-proxy-cm") pod "insights-runtime-extractor-cbpw8" (UID: "79aa8feb-3527-409b-b097-35ce8c0ea0ef") : configmap "kube-rbac-proxy" not found
Jul 06 23:56:25.118510 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:25.118457    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-j4xfg_73d747b8-0e1f-42be-842a-bfd851b03297/migrator/0.log"
Jul 06 23:56:25.131120 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:25.131093    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/2a199158-37fe-4467-ae56-2268721f790e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-rzrpw\" (UID: \"2a199158-37fe-4467-ae56-2268721f790e\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-rzrpw"
Jul 06 23:56:25.131256 ip-10-0-129-23 kubenswrapper[2578]: E0706 23:56:25.131240    2578 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 06 23:56:25.131320 ip-10-0-129-23 kubenswrapper[2578]: E0706 23:56:25.131309    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2a199158-37fe-4467-ae56-2268721f790e-cluster-monitoring-operator-tls podName:2a199158-37fe-4467-ae56-2268721f790e nodeName:}" failed. No retries permitted until 2026-07-06 23:56:41.131293828 +0000 UTC m=+67.242367623 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/2a199158-37fe-4467-ae56-2268721f790e-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-rzrpw" (UID: "2a199158-37fe-4467-ae56-2268721f790e") : secret "cluster-monitoring-operator-tls" not found
Jul 06 23:56:25.231572 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:25.231549    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e2139ac9-3d13-4d35-8344-b94be920985a-registry-tls\") pod \"image-registry-6d5ddc46dd-hpvrn\" (UID: \"e2139ac9-3d13-4d35-8344-b94be920985a\") " pod="openshift-image-registry/image-registry-6d5ddc46dd-hpvrn"
Jul 06 23:56:25.231642 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:25.231596    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/4e16f8f2-9fde-4234-9392-e1465eebb6e0-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-d5dmf\" (UID: \"4e16f8f2-9fde-4234-9392-e1465eebb6e0\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-d5dmf"
Jul 06 23:56:25.231686 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:25.231644    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0aaa04d0-1e6e-42c1-887b-bb6b96c8ea4a-service-ca-bundle\") pod \"router-default-ff7bb96c-8p6lk\" (UID: \"0aaa04d0-1e6e-42c1-887b-bb6b96c8ea4a\") " pod="openshift-ingress/router-default-ff7bb96c-8p6lk"
Jul 06 23:56:25.231686 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:25.231673    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7631f141-62e9-410a-ba79-c1bdcad24e4e-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-f2xzn\" (UID: \"7631f141-62e9-410a-ba79-c1bdcad24e4e\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-f2xzn"
Jul 06 23:56:25.231761 ip-10-0-129-23 kubenswrapper[2578]: E0706 23:56:25.231689    2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 06 23:56:25.231761 ip-10-0-129-23 kubenswrapper[2578]: E0706 23:56:25.231705    2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6d5ddc46dd-hpvrn: secret "image-registry-tls" not found
Jul 06 23:56:25.231761 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:25.231689    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dd5b072f-a02f-482e-abd1-5dd590d0a93c-metrics-tls\") pod \"dns-default-g7n6m\" (UID: \"dd5b072f-a02f-482e-abd1-5dd590d0a93c\") " pod="openshift-dns/dns-default-g7n6m"
Jul 06 23:56:25.231761 ip-10-0-129-23 kubenswrapper[2578]: E0706 23:56:25.231747    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e2139ac9-3d13-4d35-8344-b94be920985a-registry-tls podName:e2139ac9-3d13-4d35-8344-b94be920985a nodeName:}" failed. No retries permitted until 2026-07-06 23:56:41.231731446 +0000 UTC m=+67.342805240 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e2139ac9-3d13-4d35-8344-b94be920985a-registry-tls") pod "image-registry-6d5ddc46dd-hpvrn" (UID: "e2139ac9-3d13-4d35-8344-b94be920985a") : secret "image-registry-tls" not found
Jul 06 23:56:25.231761 ip-10-0-129-23 kubenswrapper[2578]: E0706 23:56:25.231759    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 23:56:25.231977 ip-10-0-129-23 kubenswrapper[2578]: E0706 23:56:25.231789    2578 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 06 23:56:25.231977 ip-10-0-129-23 kubenswrapper[2578]: E0706 23:56:25.231801    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0aaa04d0-1e6e-42c1-887b-bb6b96c8ea4a-service-ca-bundle podName:0aaa04d0-1e6e-42c1-887b-bb6b96c8ea4a nodeName:}" failed. No retries permitted until 2026-07-06 23:56:41.231764029 +0000 UTC m=+67.342837825 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/0aaa04d0-1e6e-42c1-887b-bb6b96c8ea4a-service-ca-bundle") pod "router-default-ff7bb96c-8p6lk" (UID: "0aaa04d0-1e6e-42c1-887b-bb6b96c8ea4a") : configmap references non-existent config key: service-ca.crt
Jul 06 23:56:25.231977 ip-10-0-129-23 kubenswrapper[2578]: E0706 23:56:25.231810    2578 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 06 23:56:25.231977 ip-10-0-129-23 kubenswrapper[2578]: E0706 23:56:25.231829    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dd5b072f-a02f-482e-abd1-5dd590d0a93c-metrics-tls podName:dd5b072f-a02f-482e-abd1-5dd590d0a93c nodeName:}" failed. No retries permitted until 2026-07-06 23:56:41.231816117 +0000 UTC m=+67.342889904 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/dd5b072f-a02f-482e-abd1-5dd590d0a93c-metrics-tls") pod "dns-default-g7n6m" (UID: "dd5b072f-a02f-482e-abd1-5dd590d0a93c") : secret "dns-default-metrics-tls" not found
Jul 06 23:56:25.231977 ip-10-0-129-23 kubenswrapper[2578]: E0706 23:56:25.231848    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e16f8f2-9fde-4234-9392-e1465eebb6e0-samples-operator-tls podName:4e16f8f2-9fde-4234-9392-e1465eebb6e0 nodeName:}" failed. No retries permitted until 2026-07-06 23:56:41.231839116 +0000 UTC m=+67.342912904 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/4e16f8f2-9fde-4234-9392-e1465eebb6e0-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-d5dmf" (UID: "4e16f8f2-9fde-4234-9392-e1465eebb6e0") : secret "samples-operator-tls" not found
Jul 06 23:56:25.231977 ip-10-0-129-23 kubenswrapper[2578]: E0706 23:56:25.231872    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7631f141-62e9-410a-ba79-c1bdcad24e4e-networking-console-plugin-cert podName:7631f141-62e9-410a-ba79-c1bdcad24e4e nodeName:}" failed. No retries permitted until 2026-07-06 23:56:41.231861298 +0000 UTC m=+67.342935079 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/7631f141-62e9-410a-ba79-c1bdcad24e4e-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-f2xzn" (UID: "7631f141-62e9-410a-ba79-c1bdcad24e4e") : secret "networking-console-plugin-cert" not found
Jul 06 23:56:25.231977 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:25.231901    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0aaa04d0-1e6e-42c1-887b-bb6b96c8ea4a-metrics-certs\") pod \"router-default-ff7bb96c-8p6lk\" (UID: \"0aaa04d0-1e6e-42c1-887b-bb6b96c8ea4a\") " pod="openshift-ingress/router-default-ff7bb96c-8p6lk"
Jul 06 23:56:25.231977 ip-10-0-129-23 kubenswrapper[2578]: E0706 23:56:25.231958    2578 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 06 23:56:25.232222 ip-10-0-129-23 kubenswrapper[2578]: E0706 23:56:25.231985    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0aaa04d0-1e6e-42c1-887b-bb6b96c8ea4a-metrics-certs podName:0aaa04d0-1e6e-42c1-887b-bb6b96c8ea4a nodeName:}" failed. No retries permitted until 2026-07-06 23:56:41.231977675 +0000 UTC m=+67.343051456 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0aaa04d0-1e6e-42c1-887b-bb6b96c8ea4a-metrics-certs") pod "router-default-ff7bb96c-8p6lk" (UID: "0aaa04d0-1e6e-42c1-887b-bb6b96c8ea4a") : secret "router-metrics-certs-default" not found
Jul 06 23:56:25.317760 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:25.317722    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-j4xfg_73d747b8-0e1f-42be-842a-bfd851b03297/graceful-termination/0.log"
Jul 06 23:56:25.454356 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:25.454266    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsn2_9a5fa453-505c-4742-86da-db343c8d36af/konnectivity-agent/0.log" limit=1024
Jul 06 23:56:25.518898 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:25.518874    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-846bf668f7-fzzq2_dff531e0-34c6-4281-8705-149154c350e7/kube-storage-version-migrator-operator/0.log"
Jul 06 23:56:25.690625 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:25.690598    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsn2_9a5fa453-505c-4742-86da-db343c8d36af/konnectivity-agent/0.log" limit=1024
Jul 06 23:56:25.787552 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:25.787444    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsn2_9a5fa453-505c-4742-86da-db343c8d36af/konnectivity-agent/0.log" limit=1024
Jul 06 23:56:25.904011 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:25.903973    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsn2_9a5fa453-505c-4742-86da-db343c8d36af/konnectivity-agent/0.log" limit=1024
Jul 06 23:56:29.064600 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:29.064571    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/79aa8feb-3527-409b-b097-35ce8c0ea0ef-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cbpw8\" (UID: \"79aa8feb-3527-409b-b097-35ce8c0ea0ef\") " pod="openshift-insights/insights-runtime-extractor-cbpw8"
Jul 06 23:56:29.065022 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:29.064642    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/79aa8feb-3527-409b-b097-35ce8c0ea0ef-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cbpw8\" (UID: \"79aa8feb-3527-409b-b097-35ce8c0ea0ef\") " pod="openshift-insights/insights-runtime-extractor-cbpw8"
Jul 06 23:56:29.065022 ip-10-0-129-23 kubenswrapper[2578]: E0706 23:56:29.064706    2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 06 23:56:29.065022 ip-10-0-129-23 kubenswrapper[2578]: E0706 23:56:29.064724    2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 06 23:56:29.065022 ip-10-0-129-23 kubenswrapper[2578]: E0706 23:56:29.064763    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/79aa8feb-3527-409b-b097-35ce8c0ea0ef-kube-rbac-proxy-cm podName:79aa8feb-3527-409b-b097-35ce8c0ea0ef nodeName:}" failed. No retries permitted until 2026-07-06 23:56:37.064748877 +0000 UTC m=+63.175822658 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/79aa8feb-3527-409b-b097-35ce8c0ea0ef-kube-rbac-proxy-cm") pod "insights-runtime-extractor-cbpw8" (UID: "79aa8feb-3527-409b-b097-35ce8c0ea0ef") : configmap "kube-rbac-proxy" not found
Jul 06 23:56:29.065022 ip-10-0-129-23 kubenswrapper[2578]: E0706 23:56:29.064776    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/79aa8feb-3527-409b-b097-35ce8c0ea0ef-insights-runtime-extractor-tls podName:79aa8feb-3527-409b-b097-35ce8c0ea0ef nodeName:}" failed. No retries permitted until 2026-07-06 23:56:37.064770409 +0000 UTC m=+63.175844191 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/79aa8feb-3527-409b-b097-35ce8c0ea0ef-insights-runtime-extractor-tls") pod "insights-runtime-extractor-cbpw8" (UID: "79aa8feb-3527-409b-b097-35ce8c0ea0ef") : secret "insights-runtime-extractor-tls" not found
Jul 06 23:56:29.661976 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:29.661949    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-7gjwb"
Jul 06 23:56:29.662107 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:29.661995    2578 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-68b757fb67-7gjwb"
Jul 06 23:56:29.662275 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:29.662264    2578 scope.go:117] "RemoveContainer" containerID="5345368ce8a4c8931b7525390a97c6102ee5260ed59f86336220067dc0253465"
Jul 06 23:56:29.662421 ip-10-0-129-23 kubenswrapper[2578]: E0706 23:56:29.662404    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-7gjwb_openshift-console-operator(1116f765-1ebd-4c12-9ebb-ed7b7760391c)\"" pod="openshift-console-operator/console-operator-68b757fb67-7gjwb" podUID="1116f765-1ebd-4c12-9ebb-ed7b7760391c"
Jul 06 23:56:34.672765 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:34.672742    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-jfngf"
Jul 06 23:56:37.136150 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:37.136115    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/79aa8feb-3527-409b-b097-35ce8c0ea0ef-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cbpw8\" (UID: \"79aa8feb-3527-409b-b097-35ce8c0ea0ef\") " pod="openshift-insights/insights-runtime-extractor-cbpw8"
Jul 06 23:56:37.136524 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:37.136197    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/79aa8feb-3527-409b-b097-35ce8c0ea0ef-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cbpw8\" (UID: \"79aa8feb-3527-409b-b097-35ce8c0ea0ef\") " pod="openshift-insights/insights-runtime-extractor-cbpw8"
Jul 06 23:56:37.136666 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:37.136650    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/79aa8feb-3527-409b-b097-35ce8c0ea0ef-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cbpw8\" (UID: \"79aa8feb-3527-409b-b097-35ce8c0ea0ef\") " pod="openshift-insights/insights-runtime-extractor-cbpw8"
Jul 06 23:56:37.138445 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:37.138426    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/79aa8feb-3527-409b-b097-35ce8c0ea0ef-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cbpw8\" (UID: \"79aa8feb-3527-409b-b097-35ce8c0ea0ef\") " pod="openshift-insights/insights-runtime-extractor-cbpw8"
Jul 06 23:56:37.243657 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:37.243636    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-274zg\""
Jul 06 23:56:37.251820 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:37.251804    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-cbpw8"
Jul 06 23:56:37.380025 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:37.379946    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-cbpw8"]
Jul 06 23:56:37.382419 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:56:37.382391    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79aa8feb_3527_409b_b097_35ce8c0ea0ef.slice/crio-c538981e0b69cb0df56efdd978c7448fedb4d862139131766adbafa21ab03931 WatchSource:0}: Error finding container c538981e0b69cb0df56efdd978c7448fedb4d862139131766adbafa21ab03931: Status 404 returned error can't find the container with id c538981e0b69cb0df56efdd978c7448fedb4d862139131766adbafa21ab03931
Jul 06 23:56:37.838919 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:37.838886    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-cbpw8" event={"ID":"79aa8feb-3527-409b-b097-35ce8c0ea0ef","Type":"ContainerStarted","Data":"c538981e0b69cb0df56efdd978c7448fedb4d862139131766adbafa21ab03931"}
Jul 06 23:56:40.064546 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:40.064406    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ed50a99b-7856-44b3-bb1a-12f8b25546b9-metrics-certs\") pod \"network-metrics-daemon-g45vp\" (UID: \"ed50a99b-7856-44b3-bb1a-12f8b25546b9\") " pod="openshift-multus/network-metrics-daemon-g45vp"
Jul 06 23:56:40.067092 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:40.067064    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 06 23:56:40.077484 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:40.077462    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ed50a99b-7856-44b3-bb1a-12f8b25546b9-metrics-certs\") pod \"network-metrics-daemon-g45vp\" (UID: \"ed50a99b-7856-44b3-bb1a-12f8b25546b9\") " pod="openshift-multus/network-metrics-daemon-g45vp"
Jul 06 23:56:40.108975 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:40.108955    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-dplr9\""
Jul 06 23:56:40.117077 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:40.117056    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g45vp"
Jul 06 23:56:40.165116 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:40.165088    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f6ae72be-9753-46d1-a665-c2124741a26a-original-pull-secret\") pod \"global-pull-secret-syncer-cm65t\" (UID: \"f6ae72be-9753-46d1-a665-c2124741a26a\") " pod="kube-system/global-pull-secret-syncer-cm65t"
Jul 06 23:56:40.165223 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:40.165139    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wm5xx\" (UniqueName: \"kubernetes.io/projected/7db1fb04-9b13-425c-abb1-05f4274fe959-kube-api-access-wm5xx\") pod \"network-check-target-sqcsc\" (UID: \"7db1fb04-9b13-425c-abb1-05f4274fe959\") " pod="openshift-network-diagnostics/network-check-target-sqcsc"
Jul 06 23:56:40.167901 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:40.167861    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wm5xx\" (UniqueName: \"kubernetes.io/projected/7db1fb04-9b13-425c-abb1-05f4274fe959-kube-api-access-wm5xx\") pod \"network-check-target-sqcsc\" (UID: \"7db1fb04-9b13-425c-abb1-05f4274fe959\") " pod="openshift-network-diagnostics/network-check-target-sqcsc"
Jul 06 23:56:40.168006 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:40.167991    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 06 23:56:40.177944 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:40.177917    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f6ae72be-9753-46d1-a665-c2124741a26a-original-pull-secret\") pod \"global-pull-secret-syncer-cm65t\" (UID: \"f6ae72be-9753-46d1-a665-c2124741a26a\") " pod="kube-system/global-pull-secret-syncer-cm65t"
Jul 06 23:56:40.297649 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:40.297609    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cm65t"
Jul 06 23:56:40.384815 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:40.384762    2578 scope.go:117] "RemoveContainer" containerID="5345368ce8a4c8931b7525390a97c6102ee5260ed59f86336220067dc0253465"
Jul 06 23:56:40.403462 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:40.403444    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-czj4k\""
Jul 06 23:56:40.411437 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:40.411421    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sqcsc"
Jul 06 23:56:41.025787 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:41.025763    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-sqcsc"]
Jul 06 23:56:41.027989 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:56:41.027936    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7db1fb04_9b13_425c_abb1_05f4274fe959.slice/crio-8ac92a4b2a2af8a46e6857e2b6791ac9ffd0293e72804a754408278bb8190e2f WatchSource:0}: Error finding container 8ac92a4b2a2af8a46e6857e2b6791ac9ffd0293e72804a754408278bb8190e2f: Status 404 returned error can't find the container with id 8ac92a4b2a2af8a46e6857e2b6791ac9ffd0293e72804a754408278bb8190e2f
Jul 06 23:56:41.173546 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:41.173522    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/2a199158-37fe-4467-ae56-2268721f790e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-rzrpw\" (UID: \"2a199158-37fe-4467-ae56-2268721f790e\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-rzrpw"
Jul 06 23:56:41.175777 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:41.175756    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/2a199158-37fe-4467-ae56-2268721f790e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-rzrpw\" (UID: \"2a199158-37fe-4467-ae56-2268721f790e\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-rzrpw"
Jul 06 23:56:41.243190 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:41.243166    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-cm65t"]
Jul 06 23:56:41.246638 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:41.246618    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-g45vp"]
Jul 06 23:56:41.246878 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:56:41.246858    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf6ae72be_9753_46d1_a665_c2124741a26a.slice/crio-693c3f1584f43a9182fe8fb1a6c421543d2f8f8dd4d3cf8aa336db751a4e98cf WatchSource:0}: Error finding container 693c3f1584f43a9182fe8fb1a6c421543d2f8f8dd4d3cf8aa336db751a4e98cf: Status 404 returned error can't find the container with id 693c3f1584f43a9182fe8fb1a6c421543d2f8f8dd4d3cf8aa336db751a4e98cf
Jul 06 23:56:41.248883 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:56:41.248565    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded50a99b_7856_44b3_bb1a_12f8b25546b9.slice/crio-711a0918437e5177a5db98dce61977676f72fa2167b3f806763399f4a053259f WatchSource:0}: Error finding container 711a0918437e5177a5db98dce61977676f72fa2167b3f806763399f4a053259f: Status 404 returned error can't find the container with id 711a0918437e5177a5db98dce61977676f72fa2167b3f806763399f4a053259f
Jul 06 23:56:41.274446 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:41.274425    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7631f141-62e9-410a-ba79-c1bdcad24e4e-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-f2xzn\" (UID: \"7631f141-62e9-410a-ba79-c1bdcad24e4e\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-f2xzn"
Jul 06 23:56:41.274527 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:41.274453    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dd5b072f-a02f-482e-abd1-5dd590d0a93c-metrics-tls\") pod \"dns-default-g7n6m\" (UID: \"dd5b072f-a02f-482e-abd1-5dd590d0a93c\") " pod="openshift-dns/dns-default-g7n6m"
Jul 06 23:56:41.274527 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:41.274477    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0aaa04d0-1e6e-42c1-887b-bb6b96c8ea4a-metrics-certs\") pod \"router-default-ff7bb96c-8p6lk\" (UID: \"0aaa04d0-1e6e-42c1-887b-bb6b96c8ea4a\") " pod="openshift-ingress/router-default-ff7bb96c-8p6lk"
Jul 06 23:56:41.274527 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:41.274499    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e2139ac9-3d13-4d35-8344-b94be920985a-registry-tls\") pod \"image-registry-6d5ddc46dd-hpvrn\" (UID: \"e2139ac9-3d13-4d35-8344-b94be920985a\") " pod="openshift-image-registry/image-registry-6d5ddc46dd-hpvrn"
Jul 06 23:56:41.274527 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:41.274523    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/4e16f8f2-9fde-4234-9392-e1465eebb6e0-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-d5dmf\" (UID: \"4e16f8f2-9fde-4234-9392-e1465eebb6e0\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-d5dmf"
Jul 06 23:56:41.274706 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:41.274562    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0aaa04d0-1e6e-42c1-887b-bb6b96c8ea4a-service-ca-bundle\") pod \"router-default-ff7bb96c-8p6lk\" (UID: \"0aaa04d0-1e6e-42c1-887b-bb6b96c8ea4a\") " pod="openshift-ingress/router-default-ff7bb96c-8p6lk"
Jul 06 23:56:41.275230 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:41.275167    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0aaa04d0-1e6e-42c1-887b-bb6b96c8ea4a-service-ca-bundle\") pod \"router-default-ff7bb96c-8p6lk\" (UID: \"0aaa04d0-1e6e-42c1-887b-bb6b96c8ea4a\") " pod="openshift-ingress/router-default-ff7bb96c-8p6lk"
Jul 06 23:56:41.277351 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:41.277327    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/4e16f8f2-9fde-4234-9392-e1465eebb6e0-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-d5dmf\" (UID: \"4e16f8f2-9fde-4234-9392-e1465eebb6e0\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-d5dmf"
Jul 06 23:56:41.277446 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:41.277369    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dd5b072f-a02f-482e-abd1-5dd590d0a93c-metrics-tls\") pod \"dns-default-g7n6m\" (UID: \"dd5b072f-a02f-482e-abd1-5dd590d0a93c\") " pod="openshift-dns/dns-default-g7n6m"
Jul 06 23:56:41.277522 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:41.277451    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0aaa04d0-1e6e-42c1-887b-bb6b96c8ea4a-metrics-certs\") pod \"router-default-ff7bb96c-8p6lk\" (UID: \"0aaa04d0-1e6e-42c1-887b-bb6b96c8ea4a\") " pod="openshift-ingress/router-default-ff7bb96c-8p6lk"
Jul 06 23:56:41.277603 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:41.277582    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e2139ac9-3d13-4d35-8344-b94be920985a-registry-tls\") pod \"image-registry-6d5ddc46dd-hpvrn\" (UID: \"e2139ac9-3d13-4d35-8344-b94be920985a\") " pod="openshift-image-registry/image-registry-6d5ddc46dd-hpvrn"
Jul 06 23:56:41.277720 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:41.277704    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7631f141-62e9-410a-ba79-c1bdcad24e4e-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-f2xzn\" (UID: \"7631f141-62e9-410a-ba79-c1bdcad24e4e\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-f2xzn"
Jul 06 23:56:41.394527 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:41.394505    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-7t4mh\""
Jul 06 23:56:41.399651 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:41.399636    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-g68bw\""
Jul 06 23:56:41.402555 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:41.402543    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-rzrpw"
Jul 06 23:56:41.407128 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:41.407115    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-cl7lm\""
Jul 06 23:56:41.408198 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:41.408183    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6d5ddc46dd-hpvrn"
Jul 06 23:56:41.414978 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:41.414957    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-d5dmf"
Jul 06 23:56:41.418803 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:41.418770    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-kmjrl\""
Jul 06 23:56:41.427012 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:41.426984    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-ff7bb96c-8p6lk"
Jul 06 23:56:41.482237 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:41.479561    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-km2h9\""
Jul 06 23:56:41.486593 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:41.486016    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-lhsfz\""
Jul 06 23:56:41.486593 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:41.486348    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-f2xzn"
Jul 06 23:56:41.497299 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:41.496887    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-g7n6m"
Jul 06 23:56:41.602461 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:41.596038    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-rzrpw"]
Jul 06 23:56:41.621425 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:41.620299    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6d5ddc46dd-hpvrn"]
Jul 06 23:56:41.679576 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:41.679496    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-d5dmf"]
Jul 06 23:56:41.692134 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:41.692113    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-ff7bb96c-8p6lk"]
Jul 06 23:56:41.748408 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:41.747931    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-f2xzn"]
Jul 06 23:56:41.783673 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:41.782852    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-g7n6m"]
Jul 06 23:56:41.802502 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:56:41.802471    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7631f141_62e9_410a_ba79_c1bdcad24e4e.slice/crio-fac7941aa7a29b6b523a9204b236e1b604dbcd41035a9b088ef42c826d3484c7 WatchSource:0}: Error finding container fac7941aa7a29b6b523a9204b236e1b604dbcd41035a9b088ef42c826d3484c7: Status 404 returned error can't find the container with id fac7941aa7a29b6b523a9204b236e1b604dbcd41035a9b088ef42c826d3484c7
Jul 06 23:56:41.803383 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:56:41.803357    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd5b072f_a02f_482e_abd1_5dd590d0a93c.slice/crio-5cba74db7e2b026504b467e0e955696192c3799625b14b23d3fdf07595bd0a49 WatchSource:0}: Error finding container 5cba74db7e2b026504b467e0e955696192c3799625b14b23d3fdf07595bd0a49: Status 404 returned error can't find the container with id 5cba74db7e2b026504b467e0e955696192c3799625b14b23d3fdf07595bd0a49
Jul 06 23:56:41.804302 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:56:41.804142    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0aaa04d0_1e6e_42c1_887b_bb6b96c8ea4a.slice/crio-f0298f750f21f75a5a9519dc53c668aba83aaa3e5f2c8634e5ac5718bd5a8d3b WatchSource:0}: Error finding container f0298f750f21f75a5a9519dc53c668aba83aaa3e5f2c8634e5ac5718bd5a8d3b: Status 404 returned error can't find the container with id f0298f750f21f75a5a9519dc53c668aba83aaa3e5f2c8634e5ac5718bd5a8d3b
Jul 06 23:56:41.855987 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:41.855953    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-g7n6m" event={"ID":"dd5b072f-a02f-482e-abd1-5dd590d0a93c","Type":"ContainerStarted","Data":"5cba74db7e2b026504b467e0e955696192c3799625b14b23d3fdf07595bd0a49"}
Jul 06 23:56:41.857542 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:41.857424    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6bffdf9778-f2xzn" event={"ID":"7631f141-62e9-410a-ba79-c1bdcad24e4e","Type":"ContainerStarted","Data":"fac7941aa7a29b6b523a9204b236e1b604dbcd41035a9b088ef42c826d3484c7"}
Jul 06 23:56:41.859272 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:41.859248    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6d5ddc46dd-hpvrn" event={"ID":"e2139ac9-3d13-4d35-8344-b94be920985a","Type":"ContainerStarted","Data":"7ac0f04109e76b1f20f2408d35604259e52d5144a34267df8a67db90ff850a3b"}
Jul 06 23:56:41.859377 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:41.859312    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6d5ddc46dd-hpvrn" event={"ID":"e2139ac9-3d13-4d35-8344-b94be920985a","Type":"ContainerStarted","Data":"c1f891e6ab68c33ddc48a279738710767cccb040b693a3c69a619fb248cc8706"}
Jul 06 23:56:41.859377 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:41.859365    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6d5ddc46dd-hpvrn"
Jul 06 23:56:41.861225 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:41.861162    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-sqcsc" event={"ID":"7db1fb04-9b13-425c-abb1-05f4274fe959","Type":"ContainerStarted","Data":"04601791a645f01acc36d622371859cc29a7ad1c4c4d44a91631e8a2377d990f"}
Jul 06 23:56:41.861276 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:41.861228    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-sqcsc" event={"ID":"7db1fb04-9b13-425c-abb1-05f4274fe959","Type":"ContainerStarted","Data":"8ac92a4b2a2af8a46e6857e2b6791ac9ffd0293e72804a754408278bb8190e2f"}
Jul 06 23:56:41.861276 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:41.861256    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-sqcsc"
Jul 06 23:56:41.863727 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:41.863611    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-g45vp" event={"ID":"ed50a99b-7856-44b3-bb1a-12f8b25546b9","Type":"ContainerStarted","Data":"711a0918437e5177a5db98dce61977676f72fa2167b3f806763399f4a053259f"}
Jul 06 23:56:41.867994 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:41.867692    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-cm65t" event={"ID":"f6ae72be-9753-46d1-a665-c2124741a26a","Type":"ContainerStarted","Data":"693c3f1584f43a9182fe8fb1a6c421543d2f8f8dd4d3cf8aa336db751a4e98cf"}
Jul 06 23:56:41.868771 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:41.868750    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-d5dmf" event={"ID":"4e16f8f2-9fde-4234-9392-e1465eebb6e0","Type":"ContainerStarted","Data":"84bac48e7ac8d8947fba01f751bd9381eb1e806b529b4cad4831d4fd5f9c7036"}
Jul 06 23:56:41.870258 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:41.870234    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-cbpw8" event={"ID":"79aa8feb-3527-409b-b097-35ce8c0ea0ef","Type":"ContainerStarted","Data":"44ec0dfb49b76fe4eef58be4fab26a9ad92ffac1666078db5abcf3c0b36a1bae"}
Jul 06 23:56:41.871866 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:41.871836    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-ff7bb96c-8p6lk" event={"ID":"0aaa04d0-1e6e-42c1-887b-bb6b96c8ea4a","Type":"ContainerStarted","Data":"f0298f750f21f75a5a9519dc53c668aba83aaa3e5f2c8634e5ac5718bd5a8d3b"}
Jul 06 23:56:41.873142 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:41.873095    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-rzrpw" event={"ID":"2a199158-37fe-4467-ae56-2268721f790e","Type":"ContainerStarted","Data":"70c293a6aa291a07a6dc3733229701add7ec3ea18f90bf55401a2b35eabd6f8c"}
Jul 06 23:56:41.875253 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:41.875232    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-7gjwb_1116f765-1ebd-4c12-9ebb-ed7b7760391c/console-operator/1.log"
Jul 06 23:56:41.875366 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:41.875347    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-7gjwb" event={"ID":"1116f765-1ebd-4c12-9ebb-ed7b7760391c","Type":"ContainerStarted","Data":"0de7d25ef3b9801b8e29d20cf8c899c0ee1e972c3c01f8c3a497fcbd6a26853b"}
Jul 06 23:56:41.875612 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:41.875586    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-7gjwb"
Jul 06 23:56:41.881077 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:41.881036    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-68b757fb67-7gjwb"
Jul 06 23:56:41.882783 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:41.882740    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6d5ddc46dd-hpvrn" podStartSLOduration=66.882728867 podStartE2EDuration="1m6.882728867s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:55:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:56:41.882669275 +0000 UTC m=+67.993743090" watchObservedRunningTime="2026-07-06 23:56:41.882728867 +0000 UTC m=+67.993802669"
Jul 06 23:56:41.901680 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:41.901636    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-sqcsc" podStartSLOduration=66.901617694 podStartE2EDuration="1m6.901617694s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:55:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:56:41.901177486 +0000 UTC m=+68.012251304" watchObservedRunningTime="2026-07-06 23:56:41.901617694 +0000 UTC m=+68.012691498"
Jul 06 23:56:41.924922 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:41.924878    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-68b757fb67-7gjwb" podStartSLOduration=40.655022173 podStartE2EDuration="49.924859324s" totalImagesPullingTime="9.269837151s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:55:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:56:41.924132136 +0000 UTC m=+68.035205940" watchObservedRunningTime="2026-07-06 23:56:41.924859324 +0000 UTC m=+68.035933108"
Jul 06 23:56:42.887919 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:42.887881    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-cbpw8" event={"ID":"79aa8feb-3527-409b-b097-35ce8c0ea0ef","Type":"ContainerStarted","Data":"7b9da42ff4a1cb1722be4a4dfd70831c0d5d7bf42d0d88bacea0fbfbfc233407"}
Jul 06 23:56:42.892111 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:42.891301    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-ff7bb96c-8p6lk" event={"ID":"0aaa04d0-1e6e-42c1-887b-bb6b96c8ea4a","Type":"ContainerStarted","Data":"659ca6b46000c1ec461b313bb9dafc11b3554f50baceaa94d48c148e1a7e7ac3"}
Jul 06 23:56:42.912677 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:42.912627    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-ff7bb96c-8p6lk" podStartSLOduration=50.912610024 podStartE2EDuration="50.912610024s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:55:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:56:42.911605284 +0000 UTC m=+69.022679087" watchObservedRunningTime="2026-07-06 23:56:42.912610024 +0000 UTC m=+69.023683827"
Jul 06 23:56:43.428267 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:43.428191    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-ff7bb96c-8p6lk"
Jul 06 23:56:43.430905 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:43.430881    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-ff7bb96c-8p6lk"
Jul 06 23:56:43.895268 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:43.895201    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-ff7bb96c-8p6lk"
Jul 06 23:56:43.896663 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:43.896643    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-ff7bb96c-8p6lk"
Jul 06 23:56:45.741128 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:45.741087    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-77bdc46db6-vkfw4"]
Jul 06 23:56:45.762981 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:45.762952    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-588d9df898-bkvk5"]
Jul 06 23:56:45.763731 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:45.763703    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-77bdc46db6-vkfw4"
Jul 06 23:56:45.767986 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:45.767963    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-2g5qj\""
Jul 06 23:56:45.767986 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:45.767963    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Jul 06 23:56:45.770464 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:45.770423    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 06 23:56:45.770464 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:45.770445    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 06 23:56:45.771121 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:45.771089    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 06 23:56:45.779095 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:45.779071    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6957865785-h4767"]
Jul 06 23:56:45.779221 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:45.779201    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-588d9df898-bkvk5"
Jul 06 23:56:45.782144 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:45.782125    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Jul 06 23:56:45.793072 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:45.793051    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-588d9df898-bkvk5"]
Jul 06 23:56:45.793180 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:45.793093    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-77bdc46db6-vkfw4"]
Jul 06 23:56:45.793180 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:45.793176    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6957865785-h4767"
Jul 06 23:56:45.803691 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:45.803673    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Jul 06 23:56:45.803994 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:45.803862    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Jul 06 23:56:45.804210 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:45.804158    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Jul 06 23:56:45.806481 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:45.806460    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Jul 06 23:56:45.806726 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:45.806709    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6957865785-h4767"]
Jul 06 23:56:45.858060 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:45.858027    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-685bfb5f64-kfp7s"]
Jul 06 23:56:45.881665 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:45.881589    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-685bfb5f64-kfp7s"
Jul 06 23:56:45.884235 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:45.884212    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-685bfb5f64-kfp7s"]
Jul 06 23:56:45.885791 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:45.885610    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 06 23:56:45.885791 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:45.885732    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 06 23:56:45.885791 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:45.885783    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-p74qc\""
Jul 06 23:56:45.924017 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:45.923990    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/fbde8ddc-69c5-4bfb-a26f-7527a4013b2f-hub\") pod \"cluster-proxy-proxy-agent-6957865785-h4767\" (UID: \"fbde8ddc-69c5-4bfb-a26f-7527a4013b2f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6957865785-h4767"
Jul 06 23:56:45.924154 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:45.924040    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-khn4c\" (UniqueName: \"kubernetes.io/projected/a1e0cfe9-f62c-4f34-be1f-667e80f26ea8-kube-api-access-khn4c\") pod \"managed-serviceaccount-addon-agent-77bdc46db6-vkfw4\" (UID: \"a1e0cfe9-f62c-4f34-be1f-667e80f26ea8\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-77bdc46db6-vkfw4"
Jul 06 23:56:45.924154 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:45.924078    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/fbde8ddc-69c5-4bfb-a26f-7527a4013b2f-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6957865785-h4767\" (UID: \"fbde8ddc-69c5-4bfb-a26f-7527a4013b2f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6957865785-h4767"
Jul 06 23:56:45.924154 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:45.924104    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/849a4457-6123-45fc-923b-5ffe10afd1fa-klusterlet-config\") pod \"klusterlet-addon-workmgr-588d9df898-bkvk5\" (UID: \"849a4457-6123-45fc-923b-5ffe10afd1fa\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-588d9df898-bkvk5"
Jul 06 23:56:45.924154 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:45.924120    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/fbde8ddc-69c5-4bfb-a26f-7527a4013b2f-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6957865785-h4767\" (UID: \"fbde8ddc-69c5-4bfb-a26f-7527a4013b2f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6957865785-h4767"
Jul 06 23:56:45.924154 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:45.924152    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/849a4457-6123-45fc-923b-5ffe10afd1fa-tmp\") pod \"klusterlet-addon-workmgr-588d9df898-bkvk5\" (UID: \"849a4457-6123-45fc-923b-5ffe10afd1fa\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-588d9df898-bkvk5"
Jul 06 23:56:45.924475 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:45.924196    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/fbde8ddc-69c5-4bfb-a26f-7527a4013b2f-ca\") pod \"cluster-proxy-proxy-agent-6957865785-h4767\" (UID: \"fbde8ddc-69c5-4bfb-a26f-7527a4013b2f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6957865785-h4767"
Jul 06 23:56:45.924475 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:45.924228    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/fbde8ddc-69c5-4bfb-a26f-7527a4013b2f-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6957865785-h4767\" (UID: \"fbde8ddc-69c5-4bfb-a26f-7527a4013b2f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6957865785-h4767"
Jul 06 23:56:45.924475 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:45.924270    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tjnld\" (UniqueName: \"kubernetes.io/projected/849a4457-6123-45fc-923b-5ffe10afd1fa-kube-api-access-tjnld\") pod \"klusterlet-addon-workmgr-588d9df898-bkvk5\" (UID: \"849a4457-6123-45fc-923b-5ffe10afd1fa\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-588d9df898-bkvk5"
Jul 06 23:56:45.924475 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:45.924317    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zkp89\" (UniqueName: \"kubernetes.io/projected/fbde8ddc-69c5-4bfb-a26f-7527a4013b2f-kube-api-access-zkp89\") pod \"cluster-proxy-proxy-agent-6957865785-h4767\" (UID: \"fbde8ddc-69c5-4bfb-a26f-7527a4013b2f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6957865785-h4767"
Jul 06 23:56:45.924475 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:45.924350    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a1e0cfe9-f62c-4f34-be1f-667e80f26ea8-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-77bdc46db6-vkfw4\" (UID: \"a1e0cfe9-f62c-4f34-be1f-667e80f26ea8\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-77bdc46db6-vkfw4"
Jul 06 23:56:46.025045 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:46.024972    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zkp89\" (UniqueName: \"kubernetes.io/projected/fbde8ddc-69c5-4bfb-a26f-7527a4013b2f-kube-api-access-zkp89\") pod \"cluster-proxy-proxy-agent-6957865785-h4767\" (UID: \"fbde8ddc-69c5-4bfb-a26f-7527a4013b2f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6957865785-h4767"
Jul 06 23:56:46.025045 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:46.025032    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a1e0cfe9-f62c-4f34-be1f-667e80f26ea8-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-77bdc46db6-vkfw4\" (UID: \"a1e0cfe9-f62c-4f34-be1f-667e80f26ea8\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-77bdc46db6-vkfw4"
Jul 06 23:56:46.025249 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:46.025176    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/fbde8ddc-69c5-4bfb-a26f-7527a4013b2f-hub\") pod \"cluster-proxy-proxy-agent-6957865785-h4767\" (UID: \"fbde8ddc-69c5-4bfb-a26f-7527a4013b2f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6957865785-h4767"
Jul 06 23:56:46.025249 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:46.025239    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-khn4c\" (UniqueName: \"kubernetes.io/projected/a1e0cfe9-f62c-4f34-be1f-667e80f26ea8-kube-api-access-khn4c\") pod \"managed-serviceaccount-addon-agent-77bdc46db6-vkfw4\" (UID: \"a1e0cfe9-f62c-4f34-be1f-667e80f26ea8\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-77bdc46db6-vkfw4"
Jul 06 23:56:46.025376 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:46.025316    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/fbde8ddc-69c5-4bfb-a26f-7527a4013b2f-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6957865785-h4767\" (UID: \"fbde8ddc-69c5-4bfb-a26f-7527a4013b2f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6957865785-h4767"
Jul 06 23:56:46.025376 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:46.025367    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/849a4457-6123-45fc-923b-5ffe10afd1fa-klusterlet-config\") pod \"klusterlet-addon-workmgr-588d9df898-bkvk5\" (UID: \"849a4457-6123-45fc-923b-5ffe10afd1fa\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-588d9df898-bkvk5"
Jul 06 23:56:46.025485 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:46.025389    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/fbde8ddc-69c5-4bfb-a26f-7527a4013b2f-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6957865785-h4767\" (UID: \"fbde8ddc-69c5-4bfb-a26f-7527a4013b2f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6957865785-h4767"
Jul 06 23:56:46.025485 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:46.025415    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/849a4457-6123-45fc-923b-5ffe10afd1fa-tmp\") pod \"klusterlet-addon-workmgr-588d9df898-bkvk5\" (UID: \"849a4457-6123-45fc-923b-5ffe10afd1fa\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-588d9df898-bkvk5"
Jul 06 23:56:46.025485 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:46.025458    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/fbde8ddc-69c5-4bfb-a26f-7527a4013b2f-ca\") pod \"cluster-proxy-proxy-agent-6957865785-h4767\" (UID: \"fbde8ddc-69c5-4bfb-a26f-7527a4013b2f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6957865785-h4767"
Jul 06 23:56:46.025621 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:46.025490    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/fbde8ddc-69c5-4bfb-a26f-7527a4013b2f-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6957865785-h4767\" (UID: \"fbde8ddc-69c5-4bfb-a26f-7527a4013b2f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6957865785-h4767"
Jul 06 23:56:46.025621 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:46.025523    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x5n9g\" (UniqueName: \"kubernetes.io/projected/dddc07aa-a6dc-45a8-b146-ee4dba7686eb-kube-api-access-x5n9g\") pod \"downloads-685bfb5f64-kfp7s\" (UID: \"dddc07aa-a6dc-45a8-b146-ee4dba7686eb\") " pod="openshift-console/downloads-685bfb5f64-kfp7s"
Jul 06 23:56:46.025621 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:46.025586    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tjnld\" (UniqueName: \"kubernetes.io/projected/849a4457-6123-45fc-923b-5ffe10afd1fa-kube-api-access-tjnld\") pod \"klusterlet-addon-workmgr-588d9df898-bkvk5\" (UID: \"849a4457-6123-45fc-923b-5ffe10afd1fa\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-588d9df898-bkvk5"
Jul 06 23:56:46.026418 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:46.025865    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/849a4457-6123-45fc-923b-5ffe10afd1fa-tmp\") pod \"klusterlet-addon-workmgr-588d9df898-bkvk5\" (UID: \"849a4457-6123-45fc-923b-5ffe10afd1fa\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-588d9df898-bkvk5"
Jul 06 23:56:46.026707 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:46.026656    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/fbde8ddc-69c5-4bfb-a26f-7527a4013b2f-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6957865785-h4767\" (UID: \"fbde8ddc-69c5-4bfb-a26f-7527a4013b2f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6957865785-h4767"
Jul 06 23:56:46.028395 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:46.028369    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a1e0cfe9-f62c-4f34-be1f-667e80f26ea8-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-77bdc46db6-vkfw4\" (UID: \"a1e0cfe9-f62c-4f34-be1f-667e80f26ea8\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-77bdc46db6-vkfw4"
Jul 06 23:56:46.028893 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:46.028870    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/fbde8ddc-69c5-4bfb-a26f-7527a4013b2f-hub\") pod \"cluster-proxy-proxy-agent-6957865785-h4767\" (UID: \"fbde8ddc-69c5-4bfb-a26f-7527a4013b2f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6957865785-h4767"
Jul 06 23:56:46.029020 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:46.028998    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/fbde8ddc-69c5-4bfb-a26f-7527a4013b2f-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6957865785-h4767\" (UID: \"fbde8ddc-69c5-4bfb-a26f-7527a4013b2f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6957865785-h4767"
Jul 06 23:56:46.029180 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:46.029161    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/fbde8ddc-69c5-4bfb-a26f-7527a4013b2f-ca\") pod \"cluster-proxy-proxy-agent-6957865785-h4767\" (UID: \"fbde8ddc-69c5-4bfb-a26f-7527a4013b2f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6957865785-h4767"
Jul 06 23:56:46.029618 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:46.029600    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/849a4457-6123-45fc-923b-5ffe10afd1fa-klusterlet-config\") pod \"klusterlet-addon-workmgr-588d9df898-bkvk5\" (UID: \"849a4457-6123-45fc-923b-5ffe10afd1fa\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-588d9df898-bkvk5"
Jul 06 23:56:46.029701 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:46.029628    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/fbde8ddc-69c5-4bfb-a26f-7527a4013b2f-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6957865785-h4767\" (UID: \"fbde8ddc-69c5-4bfb-a26f-7527a4013b2f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6957865785-h4767"
Jul 06 23:56:46.036776 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:46.036749    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-khn4c\" (UniqueName: \"kubernetes.io/projected/a1e0cfe9-f62c-4f34-be1f-667e80f26ea8-kube-api-access-khn4c\") pod \"managed-serviceaccount-addon-agent-77bdc46db6-vkfw4\" (UID: \"a1e0cfe9-f62c-4f34-be1f-667e80f26ea8\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-77bdc46db6-vkfw4"
Jul 06 23:56:46.037674 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:46.037650    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tjnld\" (UniqueName: \"kubernetes.io/projected/849a4457-6123-45fc-923b-5ffe10afd1fa-kube-api-access-tjnld\") pod \"klusterlet-addon-workmgr-588d9df898-bkvk5\" (UID: \"849a4457-6123-45fc-923b-5ffe10afd1fa\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-588d9df898-bkvk5"
Jul 06 23:56:46.038195 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:46.038153    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zkp89\" (UniqueName: \"kubernetes.io/projected/fbde8ddc-69c5-4bfb-a26f-7527a4013b2f-kube-api-access-zkp89\") pod \"cluster-proxy-proxy-agent-6957865785-h4767\" (UID: \"fbde8ddc-69c5-4bfb-a26f-7527a4013b2f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6957865785-h4767"
Jul 06 23:56:46.087955 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:46.087937    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-77bdc46db6-vkfw4"
Jul 06 23:56:46.096096 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:46.096069    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-588d9df898-bkvk5"
Jul 06 23:56:46.103645 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:46.103599    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6957865785-h4767"
Jul 06 23:56:46.128329 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:46.128300    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x5n9g\" (UniqueName: \"kubernetes.io/projected/dddc07aa-a6dc-45a8-b146-ee4dba7686eb-kube-api-access-x5n9g\") pod \"downloads-685bfb5f64-kfp7s\" (UID: \"dddc07aa-a6dc-45a8-b146-ee4dba7686eb\") " pod="openshift-console/downloads-685bfb5f64-kfp7s"
Jul 06 23:56:46.138797 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:46.138776    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x5n9g\" (UniqueName: \"kubernetes.io/projected/dddc07aa-a6dc-45a8-b146-ee4dba7686eb-kube-api-access-x5n9g\") pod \"downloads-685bfb5f64-kfp7s\" (UID: \"dddc07aa-a6dc-45a8-b146-ee4dba7686eb\") " pod="openshift-console/downloads-685bfb5f64-kfp7s"
Jul 06 23:56:46.201170 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:46.201145    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-685bfb5f64-kfp7s"
Jul 06 23:56:48.868459 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:48.868406    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-77bdc46db6-vkfw4"]
Jul 06 23:56:48.918421 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:48.918250    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-rzrpw" event={"ID":"2a199158-37fe-4467-ae56-2268721f790e","Type":"ContainerStarted","Data":"ee119eff06be84a71769efc3c3038e2208e58adb35cbd4ab05d879c3d2092380"}
Jul 06 23:56:48.922297 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:48.922244    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6bffdf9778-f2xzn" event={"ID":"7631f141-62e9-410a-ba79-c1bdcad24e4e","Type":"ContainerStarted","Data":"4208bc045d042429569074d668e313cca37493379b9bfd65132c920f7a0cd1e2"}
Jul 06 23:56:48.924619 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:48.924594    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-g45vp" event={"ID":"ed50a99b-7856-44b3-bb1a-12f8b25546b9","Type":"ContainerStarted","Data":"09952e0be7169a0a79e9c42374ae172004f7c79e7903cadce0fe0b4acb08f6c4"}
Jul 06 23:56:48.926105 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:48.926083    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-d5dmf" event={"ID":"4e16f8f2-9fde-4234-9392-e1465eebb6e0","Type":"ContainerStarted","Data":"d11657f69fe1e1b92d0e07c7e9484c99ec34f5f1a6d917ef03bf0ae3dc574c73"}
Jul 06 23:56:48.933139 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:48.933093    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-588d9df898-bkvk5"]
Jul 06 23:56:49.010029 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:56:49.009994    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda1e0cfe9_f62c_4f34_be1f_667e80f26ea8.slice/crio-4f265635b779307b85d4c7a0c2d7653c78090b4d6f2f21c1fe822883aaa28fbb WatchSource:0}: Error finding container 4f265635b779307b85d4c7a0c2d7653c78090b4d6f2f21c1fe822883aaa28fbb: Status 404 returned error can't find the container with id 4f265635b779307b85d4c7a0c2d7653c78090b4d6f2f21c1fe822883aaa28fbb
Jul 06 23:56:49.010739 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:56:49.010716    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod849a4457_6123_45fc_923b_5ffe10afd1fa.slice/crio-a01826a6c62f18d6734f584aecc43ada206941a16a06d17ae3acd1897d0a6e14 WatchSource:0}: Error finding container a01826a6c62f18d6734f584aecc43ada206941a16a06d17ae3acd1897d0a6e14: Status 404 returned error can't find the container with id a01826a6c62f18d6734f584aecc43ada206941a16a06d17ae3acd1897d0a6e14
Jul 06 23:56:49.131563 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:49.131532    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-685bfb5f64-kfp7s"]
Jul 06 23:56:49.136778 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:49.136346    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6957865785-h4767"]
Jul 06 23:56:49.141761 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:56:49.141734    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddddc07aa_a6dc_45a8_b146_ee4dba7686eb.slice/crio-2881abc0922ff58bfdaec1508bd838fd99078710f859bcf2054878990610e62a WatchSource:0}: Error finding container 2881abc0922ff58bfdaec1508bd838fd99078710f859bcf2054878990610e62a: Status 404 returned error can't find the container with id 2881abc0922ff58bfdaec1508bd838fd99078710f859bcf2054878990610e62a
Jul 06 23:56:49.145473 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:56:49.144062    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfbde8ddc_69c5_4bfb_a26f_7527a4013b2f.slice/crio-3159c087a86e483737b71040724ec466712e54f96586f4a5b9cc86bbc56428bc WatchSource:0}: Error finding container 3159c087a86e483737b71040724ec466712e54f96586f4a5b9cc86bbc56428bc: Status 404 returned error can't find the container with id 3159c087a86e483737b71040724ec466712e54f96586f4a5b9cc86bbc56428bc
Jul 06 23:56:49.504793 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:49.504762    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-c2f55"]
Jul 06 23:56:49.524531 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:49.523917    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-c2f55"]
Jul 06 23:56:49.524531 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:49.524026    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-c2f55"
Jul 06 23:56:49.530316 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:49.527084    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Jul 06 23:56:49.540403 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:49.540380    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-8jxqj\""
Jul 06 23:56:49.657481 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:49.657429    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/5d6117b2-b79e-4997-852a-df0db2d07b6b-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-c2f55\" (UID: \"5d6117b2-b79e-4997-852a-df0db2d07b6b\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-c2f55"
Jul 06 23:56:49.758891 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:49.758820    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/5d6117b2-b79e-4997-852a-df0db2d07b6b-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-c2f55\" (UID: \"5d6117b2-b79e-4997-852a-df0db2d07b6b\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-c2f55"
Jul 06 23:56:49.759022 ip-10-0-129-23 kubenswrapper[2578]: E0706 23:56:49.759000    2578 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found
Jul 06 23:56:49.759082 ip-10-0-129-23 kubenswrapper[2578]: E0706 23:56:49.759075    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5d6117b2-b79e-4997-852a-df0db2d07b6b-tls-certificates podName:5d6117b2-b79e-4997-852a-df0db2d07b6b nodeName:}" failed. No retries permitted until 2026-07-06 23:56:50.259053327 +0000 UTC m=+76.370127113 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/5d6117b2-b79e-4997-852a-df0db2d07b6b-tls-certificates") pod "prometheus-operator-admission-webhook-d559d66d5-c2f55" (UID: "5d6117b2-b79e-4997-852a-df0db2d07b6b") : secret "prometheus-operator-admission-webhook-tls" not found
Jul 06 23:56:49.942865 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:49.942821    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-d5dmf" event={"ID":"4e16f8f2-9fde-4234-9392-e1465eebb6e0","Type":"ContainerStarted","Data":"a3479f1e0ccf111b894bec717f8af227170146e8fc4b4d25ef3b844e6c9be9e8"}
Jul 06 23:56:49.949171 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:49.949141    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-cbpw8" event={"ID":"79aa8feb-3527-409b-b097-35ce8c0ea0ef","Type":"ContainerStarted","Data":"ac72d4547f4bb4f76ececb9476223339e84ff6c906dfcb20702cadf1b56439d5"}
Jul 06 23:56:49.953260 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:49.952131    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-588d9df898-bkvk5" event={"ID":"849a4457-6123-45fc-923b-5ffe10afd1fa","Type":"ContainerStarted","Data":"a01826a6c62f18d6734f584aecc43ada206941a16a06d17ae3acd1897d0a6e14"}
Jul 06 23:56:49.954145 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:49.954119    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-77bdc46db6-vkfw4" event={"ID":"a1e0cfe9-f62c-4f34-be1f-667e80f26ea8","Type":"ContainerStarted","Data":"4f265635b779307b85d4c7a0c2d7653c78090b4d6f2f21c1fe822883aaa28fbb"}
Jul 06 23:56:49.956711 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:49.956689    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-g7n6m" event={"ID":"dd5b072f-a02f-482e-abd1-5dd590d0a93c","Type":"ContainerStarted","Data":"1923fb14d38344f3834ee04d7986cadc626ef5b2b24c6a96f92f0ebd1c5afe48"}
Jul 06 23:56:49.956828 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:49.956727    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-g7n6m" event={"ID":"dd5b072f-a02f-482e-abd1-5dd590d0a93c","Type":"ContainerStarted","Data":"6885b96bb491f02b16cb01264c2617963cd4685561fa5265e59437411d4cdc0e"}
Jul 06 23:56:49.957132 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:49.957108    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-g7n6m"
Jul 06 23:56:49.959161 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:49.959105    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6957865785-h4767" event={"ID":"fbde8ddc-69c5-4bfb-a26f-7527a4013b2f","Type":"ContainerStarted","Data":"3159c087a86e483737b71040724ec466712e54f96586f4a5b9cc86bbc56428bc"}
Jul 06 23:56:49.962462 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:49.962407    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-g45vp" event={"ID":"ed50a99b-7856-44b3-bb1a-12f8b25546b9","Type":"ContainerStarted","Data":"0a55bf4159206c6086fdeb5adefb0547259e08dc05229e48d58a0a3ab3c8a267"}
Jul 06 23:56:49.965705 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:49.964765    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-d5dmf" podStartSLOduration=51.064652845 podStartE2EDuration="57.964748294s" totalImagesPullingTime="6.900095449s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:55:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:56:49.963958568 +0000 UTC m=+76.075032378" watchObservedRunningTime="2026-07-06 23:56:49.964748294 +0000 UTC m=+76.075822099"
Jul 06 23:56:49.966671 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:49.966011    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-cm65t" event={"ID":"f6ae72be-9753-46d1-a665-c2124741a26a","Type":"ContainerStarted","Data":"b9fd3348ed459f23c480532aaa16fc9949925178bf9deeb15fb26554bad2cbed"}
Jul 06 23:56:49.971804 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:49.971785    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-685bfb5f64-kfp7s" event={"ID":"dddc07aa-a6dc-45a8-b146-ee4dba7686eb","Type":"ContainerStarted","Data":"2881abc0922ff58bfdaec1508bd838fd99078710f859bcf2054878990610e62a"}
Jul 06 23:56:50.007989 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:50.006718    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-g45vp" podStartSLOduration=68.685591307 podStartE2EDuration="1m16.0066996s" totalImagesPullingTime="7.321108293s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:55:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:56:49.986231923 +0000 UTC m=+76.097305730" watchObservedRunningTime="2026-07-06 23:56:50.0066996 +0000 UTC m=+76.117773406"
Jul 06 23:56:50.007989 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:50.007121    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-cbpw8" podStartSLOduration=17.870651778 podStartE2EDuration="29.007110616s" totalImagesPullingTime="11.136458838s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 23:56:21 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:56:50.005235007 +0000 UTC m=+76.116308811" watchObservedRunningTime="2026-07-06 23:56:50.007110616 +0000 UTC m=+76.118184404"
Jul 06 23:56:50.027988 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:50.027237    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-g7n6m" podStartSLOduration=34.176269973 podStartE2EDuration="41.027221131s" totalImagesPullingTime="6.850951158s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:56:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:56:50.026537982 +0000 UTC m=+76.137611787" watchObservedRunningTime="2026-07-06 23:56:50.027221131 +0000 UTC m=+76.138294936"
Jul 06 23:56:50.065213 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:50.064527    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6bffdf9778-f2xzn" podStartSLOduration=41.229144628 podStartE2EDuration="48.064509598s" totalImagesPullingTime="6.83536497s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:56:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:56:50.064200826 +0000 UTC m=+76.175274631" watchObservedRunningTime="2026-07-06 23:56:50.064509598 +0000 UTC m=+76.175583403"
Jul 06 23:56:50.065213 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:50.064712    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-cm65t" podStartSLOduration=67.259528939 podStartE2EDuration="1m15.064703679s" totalImagesPullingTime="7.80517474s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 23:55:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:56:50.046432079 +0000 UTC m=+76.157505884" watchObservedRunningTime="2026-07-06 23:56:50.064703679 +0000 UTC m=+76.175777486"
Jul 06 23:56:50.084655 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:50.083911    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-rzrpw" podStartSLOduration=52.058835769 podStartE2EDuration="59.083892443s" totalImagesPullingTime="7.025056674s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:55:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:56:50.082864302 +0000 UTC m=+76.193938107" watchObservedRunningTime="2026-07-06 23:56:50.083892443 +0000 UTC m=+76.194966248"
Jul 06 23:56:50.263867 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:50.263833    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/5d6117b2-b79e-4997-852a-df0db2d07b6b-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-c2f55\" (UID: \"5d6117b2-b79e-4997-852a-df0db2d07b6b\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-c2f55"
Jul 06 23:56:50.290698 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:50.290629    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/5d6117b2-b79e-4997-852a-df0db2d07b6b-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-c2f55\" (UID: \"5d6117b2-b79e-4997-852a-df0db2d07b6b\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-c2f55"
Jul 06 23:56:50.441903 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:50.441870    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-c2f55"
Jul 06 23:56:50.680381 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:50.679825    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-c2f55"]
Jul 06 23:56:50.697854 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:56:50.697820    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d6117b2_b79e_4997_852a_df0db2d07b6b.slice/crio-3f19dba52f858a81564ea988560adce2af5006435530b2837414afee6cce2adf WatchSource:0}: Error finding container 3f19dba52f858a81564ea988560adce2af5006435530b2837414afee6cce2adf: Status 404 returned error can't find the container with id 3f19dba52f858a81564ea988560adce2af5006435530b2837414afee6cce2adf
Jul 06 23:56:50.918649 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:50.918590    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-79c79968b7-k5ftc"]
Jul 06 23:56:50.962220 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:50.962190    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-79c79968b7-k5ftc"]
Jul 06 23:56:50.962681 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:50.962402    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-79c79968b7-k5ftc"
Jul 06 23:56:50.968936 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:50.966818    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 06 23:56:50.968936 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:50.967348    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 06 23:56:50.968936 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:50.967655    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-mswz6\""
Jul 06 23:56:50.968936 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:50.968543    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 06 23:56:50.968936 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:50.968733    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 06 23:56:50.970667 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:50.969276    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 06 23:56:50.990268 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:50.990240    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-c2f55" event={"ID":"5d6117b2-b79e-4997-852a-df0db2d07b6b","Type":"ContainerStarted","Data":"3f19dba52f858a81564ea988560adce2af5006435530b2837414afee6cce2adf"}
Jul 06 23:56:51.072227 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:51.072194    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cvq95\" (UniqueName: \"kubernetes.io/projected/84ab3e8e-e7bb-4524-ab5c-5faea6afe060-kube-api-access-cvq95\") pod \"console-79c79968b7-k5ftc\" (UID: \"84ab3e8e-e7bb-4524-ab5c-5faea6afe060\") " pod="openshift-console/console-79c79968b7-k5ftc"
Jul 06 23:56:51.072382 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:51.072254    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/84ab3e8e-e7bb-4524-ab5c-5faea6afe060-console-config\") pod \"console-79c79968b7-k5ftc\" (UID: \"84ab3e8e-e7bb-4524-ab5c-5faea6afe060\") " pod="openshift-console/console-79c79968b7-k5ftc"
Jul 06 23:56:51.072382 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:51.072315    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/84ab3e8e-e7bb-4524-ab5c-5faea6afe060-console-oauth-config\") pod \"console-79c79968b7-k5ftc\" (UID: \"84ab3e8e-e7bb-4524-ab5c-5faea6afe060\") " pod="openshift-console/console-79c79968b7-k5ftc"
Jul 06 23:56:51.072382 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:51.072342    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/84ab3e8e-e7bb-4524-ab5c-5faea6afe060-oauth-serving-cert\") pod \"console-79c79968b7-k5ftc\" (UID: \"84ab3e8e-e7bb-4524-ab5c-5faea6afe060\") " pod="openshift-console/console-79c79968b7-k5ftc"
Jul 06 23:56:51.072382 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:51.072369    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/84ab3e8e-e7bb-4524-ab5c-5faea6afe060-console-serving-cert\") pod \"console-79c79968b7-k5ftc\" (UID: \"84ab3e8e-e7bb-4524-ab5c-5faea6afe060\") " pod="openshift-console/console-79c79968b7-k5ftc"
Jul 06 23:56:51.072630 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:51.072394    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/84ab3e8e-e7bb-4524-ab5c-5faea6afe060-service-ca\") pod \"console-79c79968b7-k5ftc\" (UID: \"84ab3e8e-e7bb-4524-ab5c-5faea6afe060\") " pod="openshift-console/console-79c79968b7-k5ftc"
Jul 06 23:56:51.175435 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:51.173849    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cvq95\" (UniqueName: \"kubernetes.io/projected/84ab3e8e-e7bb-4524-ab5c-5faea6afe060-kube-api-access-cvq95\") pod \"console-79c79968b7-k5ftc\" (UID: \"84ab3e8e-e7bb-4524-ab5c-5faea6afe060\") " pod="openshift-console/console-79c79968b7-k5ftc"
Jul 06 23:56:51.175435 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:51.173931    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/84ab3e8e-e7bb-4524-ab5c-5faea6afe060-console-config\") pod \"console-79c79968b7-k5ftc\" (UID: \"84ab3e8e-e7bb-4524-ab5c-5faea6afe060\") " pod="openshift-console/console-79c79968b7-k5ftc"
Jul 06 23:56:51.175435 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:51.174041    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/84ab3e8e-e7bb-4524-ab5c-5faea6afe060-console-oauth-config\") pod \"console-79c79968b7-k5ftc\" (UID: \"84ab3e8e-e7bb-4524-ab5c-5faea6afe060\") " pod="openshift-console/console-79c79968b7-k5ftc"
Jul 06 23:56:51.175435 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:51.174072    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/84ab3e8e-e7bb-4524-ab5c-5faea6afe060-oauth-serving-cert\") pod \"console-79c79968b7-k5ftc\" (UID: \"84ab3e8e-e7bb-4524-ab5c-5faea6afe060\") " pod="openshift-console/console-79c79968b7-k5ftc"
Jul 06 23:56:51.175435 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:51.174099    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/84ab3e8e-e7bb-4524-ab5c-5faea6afe060-console-serving-cert\") pod \"console-79c79968b7-k5ftc\" (UID: \"84ab3e8e-e7bb-4524-ab5c-5faea6afe060\") " pod="openshift-console/console-79c79968b7-k5ftc"
Jul 06 23:56:51.175435 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:51.174186    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/84ab3e8e-e7bb-4524-ab5c-5faea6afe060-service-ca\") pod \"console-79c79968b7-k5ftc\" (UID: \"84ab3e8e-e7bb-4524-ab5c-5faea6afe060\") " pod="openshift-console/console-79c79968b7-k5ftc"
Jul 06 23:56:51.175919 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:51.175512    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/84ab3e8e-e7bb-4524-ab5c-5faea6afe060-oauth-serving-cert\") pod \"console-79c79968b7-k5ftc\" (UID: \"84ab3e8e-e7bb-4524-ab5c-5faea6afe060\") " pod="openshift-console/console-79c79968b7-k5ftc"
Jul 06 23:56:51.177532 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:51.176315    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/84ab3e8e-e7bb-4524-ab5c-5faea6afe060-console-config\") pod \"console-79c79968b7-k5ftc\" (UID: \"84ab3e8e-e7bb-4524-ab5c-5faea6afe060\") " pod="openshift-console/console-79c79968b7-k5ftc"
Jul 06 23:56:51.177532 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:51.176665    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/84ab3e8e-e7bb-4524-ab5c-5faea6afe060-service-ca\") pod \"console-79c79968b7-k5ftc\" (UID: \"84ab3e8e-e7bb-4524-ab5c-5faea6afe060\") " pod="openshift-console/console-79c79968b7-k5ftc"
Jul 06 23:56:51.194961 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:51.194883    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/84ab3e8e-e7bb-4524-ab5c-5faea6afe060-console-serving-cert\") pod \"console-79c79968b7-k5ftc\" (UID: \"84ab3e8e-e7bb-4524-ab5c-5faea6afe060\") " pod="openshift-console/console-79c79968b7-k5ftc"
Jul 06 23:56:51.196136 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:51.196079    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/84ab3e8e-e7bb-4524-ab5c-5faea6afe060-console-oauth-config\") pod \"console-79c79968b7-k5ftc\" (UID: \"84ab3e8e-e7bb-4524-ab5c-5faea6afe060\") " pod="openshift-console/console-79c79968b7-k5ftc"
Jul 06 23:56:51.197629 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:51.197572    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cvq95\" (UniqueName: \"kubernetes.io/projected/84ab3e8e-e7bb-4524-ab5c-5faea6afe060-kube-api-access-cvq95\") pod \"console-79c79968b7-k5ftc\" (UID: \"84ab3e8e-e7bb-4524-ab5c-5faea6afe060\") " pod="openshift-console/console-79c79968b7-k5ftc"
Jul 06 23:56:51.286158 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:51.285898    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-79c79968b7-k5ftc"
Jul 06 23:56:53.341466 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:53.341360    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-79c79968b7-k5ftc"]
Jul 06 23:56:56.505175 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:56:56.505035    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod84ab3e8e_e7bb_4524_ab5c_5faea6afe060.slice/crio-4b0391f2c20997ad9b17672a55e067df1ff4b2d6b1e1020d6a44987f79432614 WatchSource:0}: Error finding container 4b0391f2c20997ad9b17672a55e067df1ff4b2d6b1e1020d6a44987f79432614: Status 404 returned error can't find the container with id 4b0391f2c20997ad9b17672a55e067df1ff4b2d6b1e1020d6a44987f79432614
Jul 06 23:56:57.022106 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:57.022014    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6957865785-h4767" event={"ID":"fbde8ddc-69c5-4bfb-a26f-7527a4013b2f","Type":"ContainerStarted","Data":"f66733e6bf7b108162a915e5a3fa35ded71ec544bc33f84c20200bbdadf3075a"}
Jul 06 23:56:57.022106 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:57.022065    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6957865785-h4767" event={"ID":"fbde8ddc-69c5-4bfb-a26f-7527a4013b2f","Type":"ContainerStarted","Data":"cc48ccaf7a3258796a65e5266ee663682ae065089d2f37675ec2cb9016b7e079"}
Jul 06 23:56:57.022106 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:57.022082    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6957865785-h4767" event={"ID":"fbde8ddc-69c5-4bfb-a26f-7527a4013b2f","Type":"ContainerStarted","Data":"de9819645ab02719a8e124d35a5e55b2b2158028c0126498bcd932f5711372ad"}
Jul 06 23:56:57.023647 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:57.023620    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-79c79968b7-k5ftc" event={"ID":"84ab3e8e-e7bb-4524-ab5c-5faea6afe060","Type":"ContainerStarted","Data":"4b0391f2c20997ad9b17672a55e067df1ff4b2d6b1e1020d6a44987f79432614"}
Jul 06 23:56:57.025461 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:57.025419    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-588d9df898-bkvk5" event={"ID":"849a4457-6123-45fc-923b-5ffe10afd1fa","Type":"ContainerStarted","Data":"0b6ab11fb5f0f61dede835cb85a1d959a7d4c17620eaebd1ff4da6e3f9787d33"}
Jul 06 23:56:57.025592 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:57.025561    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-588d9df898-bkvk5"
Jul 06 23:56:57.027437 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:57.027406    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-77bdc46db6-vkfw4" event={"ID":"a1e0cfe9-f62c-4f34-be1f-667e80f26ea8","Type":"ContainerStarted","Data":"bbc56c6cc257162f4e2d093efe0a73ed924d1ef89cb8cb1f87ee1b3d5e2af402"}
Jul 06 23:56:57.027536 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:57.027496    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-588d9df898-bkvk5"
Jul 06 23:56:57.029394 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:57.029367    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-c2f55" event={"ID":"5d6117b2-b79e-4997-852a-df0db2d07b6b","Type":"ContainerStarted","Data":"3e435b0cae074c7d14842dabb19e2f3c4868a54a7a59cd8eab85785ebf3039d4"}
Jul 06 23:56:57.029590 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:57.029575    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-c2f55"
Jul 06 23:56:57.033765 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:57.033747    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-c2f55"
Jul 06 23:56:57.057317 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:57.056494    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6957865785-h4767" podStartSLOduration=4.614675286 podStartE2EDuration="12.056475504s" totalImagesPullingTime="7.441800218s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:56:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:56:57.056394463 +0000 UTC m=+83.167468267" watchObservedRunningTime="2026-07-06 23:56:57.056475504 +0000 UTC m=+83.167549308"
Jul 06 23:56:57.091729 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:57.091674    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-c2f55" podStartSLOduration=2.227737988 podStartE2EDuration="8.091653742s" totalImagesPullingTime="5.863915754s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:56:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:56:57.090960235 +0000 UTC m=+83.202034038" watchObservedRunningTime="2026-07-06 23:56:57.091653742 +0000 UTC m=+83.202727525"
Jul 06 23:56:57.119253 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:57.119188    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-588d9df898-bkvk5" podStartSLOduration=4.569436542 podStartE2EDuration="12.119166211s" totalImagesPullingTime="7.549729669s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:56:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:56:57.117899645 +0000 UTC m=+83.228973449" watchObservedRunningTime="2026-07-06 23:56:57.119166211 +0000 UTC m=+83.230240016"
Jul 06 23:56:57.142882 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:56:57.142820    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-77bdc46db6-vkfw4" podStartSLOduration=4.605234552 podStartE2EDuration="12.142800848s" totalImagesPullingTime="7.537566296s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:56:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:56:57.141404169 +0000 UTC m=+83.252477975" watchObservedRunningTime="2026-07-06 23:56:57.142800848 +0000 UTC m=+83.253874653"
Jul 06 23:57:00.051457 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:57:00.051422    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-79c79968b7-k5ftc" event={"ID":"84ab3e8e-e7bb-4524-ab5c-5faea6afe060","Type":"ContainerStarted","Data":"6e8299c9de7fc4886eb2c8d84a6993a8674e541618c3d8a8b650993e36136a59"}
Jul 06 23:57:00.073988 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:57:00.073933    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-79c79968b7-k5ftc" podStartSLOduration=6.739191963 podStartE2EDuration="10.07391936s" totalImagesPullingTime="3.334727397s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:56:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:57:00.072667206 +0000 UTC m=+86.183741012" watchObservedRunningTime="2026-07-06 23:57:00.07391936 +0000 UTC m=+86.184993163"
Jul 06 23:57:00.999357 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:57:00.999324    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-g7n6m"
Jul 06 23:57:01.287079 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:57:01.286998    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-79c79968b7-k5ftc"
Jul 06 23:57:01.287079 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:57:01.287067    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-79c79968b7-k5ftc"
Jul 06 23:57:01.288261 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:57:01.288223    2578 patch_prober.go:28] interesting pod/console-79c79968b7-k5ftc container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.132.0.27:8443/health\": dial tcp 10.132.0.27:8443: connect: connection refused" start-of-body=
Jul 06 23:57:01.288412 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:57:01.288307    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-79c79968b7-k5ftc" podUID="84ab3e8e-e7bb-4524-ab5c-5faea6afe060" containerName="console" probeResult="failure" output="Get \"https://10.132.0.27:8443/health\": dial tcp 10.132.0.27:8443: connect: connection refused"
Jul 06 23:57:01.413339 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:57:01.413300    2578 patch_prober.go:28] interesting pod/image-registry-6d5ddc46dd-hpvrn container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 06 23:57:01.413511 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:57:01.413359    2578 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-6d5ddc46dd-hpvrn" podUID="e2139ac9-3d13-4d35-8344-b94be920985a" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 06 23:57:02.897220 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:57:02.897193    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6d5ddc46dd-hpvrn"
Jul 06 23:57:07.961661 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:57:07.961631    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-9hvm9"]
Jul 06 23:57:08.090639 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:57:08.090605    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-9hvm9"
Jul 06 23:57:08.093743 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:57:08.093719    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 06 23:57:08.094708 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:57:08.094686    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 06 23:57:08.094832 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:57:08.094736    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 06 23:57:08.094832 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:57:08.094818    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 06 23:57:08.094962 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:57:08.094938    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-sslvj\""
Jul 06 23:57:08.128291 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:57:08.128261    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7be84f64-e9a8-4eff-9a80-034b9a7947cd-node-exporter-accelerators-collector-config\") pod \"node-exporter-9hvm9\" (UID: \"7be84f64-e9a8-4eff-9a80-034b9a7947cd\") " pod="openshift-monitoring/node-exporter-9hvm9"
Jul 06 23:57:08.128690 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:57:08.128353    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7be84f64-e9a8-4eff-9a80-034b9a7947cd-root\") pod \"node-exporter-9hvm9\" (UID: \"7be84f64-e9a8-4eff-9a80-034b9a7947cd\") " pod="openshift-monitoring/node-exporter-9hvm9"
Jul 06 23:57:08.128690 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:57:08.128409    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7be84f64-e9a8-4eff-9a80-034b9a7947cd-sys\") pod \"node-exporter-9hvm9\" (UID: \"7be84f64-e9a8-4eff-9a80-034b9a7947cd\") " pod="openshift-monitoring/node-exporter-9hvm9"
Jul 06 23:57:08.128690 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:57:08.128433    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7be84f64-e9a8-4eff-9a80-034b9a7947cd-node-exporter-textfile\") pod \"node-exporter-9hvm9\" (UID: \"7be84f64-e9a8-4eff-9a80-034b9a7947cd\") " pod="openshift-monitoring/node-exporter-9hvm9"
Jul 06 23:57:08.128690 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:57:08.128481    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7be84f64-e9a8-4eff-9a80-034b9a7947cd-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-9hvm9\" (UID: \"7be84f64-e9a8-4eff-9a80-034b9a7947cd\") " pod="openshift-monitoring/node-exporter-9hvm9"
Jul 06 23:57:08.128690 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:57:08.128503    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7be84f64-e9a8-4eff-9a80-034b9a7947cd-node-exporter-wtmp\") pod \"node-exporter-9hvm9\" (UID: \"7be84f64-e9a8-4eff-9a80-034b9a7947cd\") " pod="openshift-monitoring/node-exporter-9hvm9"
Jul 06 23:57:08.128690 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:57:08.128518    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m7dzf\" (UniqueName: \"kubernetes.io/projected/7be84f64-e9a8-4eff-9a80-034b9a7947cd-kube-api-access-m7dzf\") pod \"node-exporter-9hvm9\" (UID: \"7be84f64-e9a8-4eff-9a80-034b9a7947cd\") " pod="openshift-monitoring/node-exporter-9hvm9"
Jul 06 23:57:08.128690 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:57:08.128544    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7be84f64-e9a8-4eff-9a80-034b9a7947cd-node-exporter-tls\") pod \"node-exporter-9hvm9\" (UID: \"7be84f64-e9a8-4eff-9a80-034b9a7947cd\") " pod="openshift-monitoring/node-exporter-9hvm9"
Jul 06 23:57:08.128690 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:57:08.128602    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7be84f64-e9a8-4eff-9a80-034b9a7947cd-metrics-client-ca\") pod \"node-exporter-9hvm9\" (UID: \"7be84f64-e9a8-4eff-9a80-034b9a7947cd\") " pod="openshift-monitoring/node-exporter-9hvm9"
Jul 06 23:57:08.229991 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:57:08.229908    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7be84f64-e9a8-4eff-9a80-034b9a7947cd-root\") pod \"node-exporter-9hvm9\" (UID: \"7be84f64-e9a8-4eff-9a80-034b9a7947cd\") " pod="openshift-monitoring/node-exporter-9hvm9"
Jul 06 23:57:08.229991 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:57:08.229971    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7be84f64-e9a8-4eff-9a80-034b9a7947cd-sys\") pod \"node-exporter-9hvm9\" (UID: \"7be84f64-e9a8-4eff-9a80-034b9a7947cd\") " pod="openshift-monitoring/node-exporter-9hvm9"
Jul 06 23:57:08.230202 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:57:08.230025    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7be84f64-e9a8-4eff-9a80-034b9a7947cd-sys\") pod \"node-exporter-9hvm9\" (UID: \"7be84f64-e9a8-4eff-9a80-034b9a7947cd\") " pod="openshift-monitoring/node-exporter-9hvm9"
Jul 06 23:57:08.230202 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:57:08.230023    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7be84f64-e9a8-4eff-9a80-034b9a7947cd-node-exporter-textfile\") pod \"node-exporter-9hvm9\" (UID: \"7be84f64-e9a8-4eff-9a80-034b9a7947cd\") " pod="openshift-monitoring/node-exporter-9hvm9"
Jul 06 23:57:08.230202 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:57:08.230065    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7be84f64-e9a8-4eff-9a80-034b9a7947cd-root\") pod \"node-exporter-9hvm9\" (UID: \"7be84f64-e9a8-4eff-9a80-034b9a7947cd\") " pod="openshift-monitoring/node-exporter-9hvm9"
Jul 06 23:57:08.230202 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:57:08.230082    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7be84f64-e9a8-4eff-9a80-034b9a7947cd-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-9hvm9\" (UID: \"7be84f64-e9a8-4eff-9a80-034b9a7947cd\") " pod="openshift-monitoring/node-exporter-9hvm9"
Jul 06 23:57:08.230202 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:57:08.230109    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7be84f64-e9a8-4eff-9a80-034b9a7947cd-node-exporter-wtmp\") pod \"node-exporter-9hvm9\" (UID: \"7be84f64-e9a8-4eff-9a80-034b9a7947cd\") " pod="openshift-monitoring/node-exporter-9hvm9"
Jul 06 23:57:08.230202 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:57:08.230131    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m7dzf\" (UniqueName: \"kubernetes.io/projected/7be84f64-e9a8-4eff-9a80-034b9a7947cd-kube-api-access-m7dzf\") pod \"node-exporter-9hvm9\" (UID: \"7be84f64-e9a8-4eff-9a80-034b9a7947cd\") " pod="openshift-monitoring/node-exporter-9hvm9"
Jul 06 23:57:08.230202 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:57:08.230160    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7be84f64-e9a8-4eff-9a80-034b9a7947cd-node-exporter-tls\") pod \"node-exporter-9hvm9\" (UID: \"7be84f64-e9a8-4eff-9a80-034b9a7947cd\") " pod="openshift-monitoring/node-exporter-9hvm9"
Jul 06 23:57:08.230202 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:57:08.230196    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7be84f64-e9a8-4eff-9a80-034b9a7947cd-metrics-client-ca\") pod \"node-exporter-9hvm9\" (UID: \"7be84f64-e9a8-4eff-9a80-034b9a7947cd\") " pod="openshift-monitoring/node-exporter-9hvm9"
Jul 06 23:57:08.230592 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:57:08.230270    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7be84f64-e9a8-4eff-9a80-034b9a7947cd-node-exporter-accelerators-collector-config\") pod \"node-exporter-9hvm9\" (UID: \"7be84f64-e9a8-4eff-9a80-034b9a7947cd\") " pod="openshift-monitoring/node-exporter-9hvm9"
Jul 06 23:57:08.230592 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:57:08.230299    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7be84f64-e9a8-4eff-9a80-034b9a7947cd-node-exporter-wtmp\") pod \"node-exporter-9hvm9\" (UID: \"7be84f64-e9a8-4eff-9a80-034b9a7947cd\") " pod="openshift-monitoring/node-exporter-9hvm9"
Jul 06 23:57:08.230592 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:57:08.230402    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7be84f64-e9a8-4eff-9a80-034b9a7947cd-node-exporter-textfile\") pod \"node-exporter-9hvm9\" (UID: \"7be84f64-e9a8-4eff-9a80-034b9a7947cd\") " pod="openshift-monitoring/node-exporter-9hvm9"
Jul 06 23:57:08.230870 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:57:08.230816    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7be84f64-e9a8-4eff-9a80-034b9a7947cd-node-exporter-accelerators-collector-config\") pod \"node-exporter-9hvm9\" (UID: \"7be84f64-e9a8-4eff-9a80-034b9a7947cd\") " pod="openshift-monitoring/node-exporter-9hvm9"
Jul 06 23:57:08.230995 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:57:08.230897    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7be84f64-e9a8-4eff-9a80-034b9a7947cd-metrics-client-ca\") pod \"node-exporter-9hvm9\" (UID: \"7be84f64-e9a8-4eff-9a80-034b9a7947cd\") " pod="openshift-monitoring/node-exporter-9hvm9"
Jul 06 23:57:08.232873 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:57:08.232842    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7be84f64-e9a8-4eff-9a80-034b9a7947cd-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-9hvm9\" (UID: \"7be84f64-e9a8-4eff-9a80-034b9a7947cd\") " pod="openshift-monitoring/node-exporter-9hvm9"
Jul 06 23:57:08.233162 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:57:08.233142    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7be84f64-e9a8-4eff-9a80-034b9a7947cd-node-exporter-tls\") pod \"node-exporter-9hvm9\" (UID: \"7be84f64-e9a8-4eff-9a80-034b9a7947cd\") " pod="openshift-monitoring/node-exporter-9hvm9"
Jul 06 23:57:08.238757 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:57:08.238737    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m7dzf\" (UniqueName: \"kubernetes.io/projected/7be84f64-e9a8-4eff-9a80-034b9a7947cd-kube-api-access-m7dzf\") pod \"node-exporter-9hvm9\" (UID: \"7be84f64-e9a8-4eff-9a80-034b9a7947cd\") " pod="openshift-monitoring/node-exporter-9hvm9"
Jul 06 23:57:08.402540 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:57:08.402483    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-9hvm9"
Jul 06 23:57:10.498942 ip-10-0-129-23 kubenswrapper[2578]: W0706 23:57:10.498908    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7be84f64_e9a8_4eff_9a80_034b9a7947cd.slice/crio-57b6c42b4a0ec293056547872b6b8ead4d3f6325605409b50e920d07117d5c34 WatchSource:0}: Error finding container 57b6c42b4a0ec293056547872b6b8ead4d3f6325605409b50e920d07117d5c34: Status 404 returned error can't find the container with id 57b6c42b4a0ec293056547872b6b8ead4d3f6325605409b50e920d07117d5c34
Jul 06 23:57:11.107665 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:57:11.107580    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-685bfb5f64-kfp7s" event={"ID":"dddc07aa-a6dc-45a8-b146-ee4dba7686eb","Type":"ContainerStarted","Data":"13ee0a3da84e3628c0105869812cc4421f152ebfe291efc76b8efc5e1706e3da"}
Jul 06 23:57:11.107894 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:57:11.107874    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-685bfb5f64-kfp7s"
Jul 06 23:57:11.109263 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:57:11.109234    2578 patch_prober.go:28] interesting pod/downloads-685bfb5f64-kfp7s container/download-server namespace/openshift-console: Readiness probe status=failure output="Get \"http://10.132.0.25:8080/\": dial tcp 10.132.0.25:8080: connect: connection refused" start-of-body=
Jul 06 23:57:11.109406 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:57:11.109277    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/downloads-685bfb5f64-kfp7s" podUID="dddc07aa-a6dc-45a8-b146-ee4dba7686eb" containerName="download-server" probeResult="failure" output="Get \"http://10.132.0.25:8080/\": dial tcp 10.132.0.25:8080: connect: connection refused"
Jul 06 23:57:11.109604 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:57:11.109579    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9hvm9" event={"ID":"7be84f64-e9a8-4eff-9a80-034b9a7947cd","Type":"ContainerStarted","Data":"57b6c42b4a0ec293056547872b6b8ead4d3f6325605409b50e920d07117d5c34"}
Jul 06 23:57:11.128524 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:57:11.128477    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-685bfb5f64-kfp7s" podStartSLOduration=4.4899114430000004 podStartE2EDuration="26.128462723s" totalImagesPullingTime="21.63855128s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:56:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:57:11.125876491 +0000 UTC m=+97.236950292" watchObservedRunningTime="2026-07-06 23:57:11.128462723 +0000 UTC m=+97.239536541"
Jul 06 23:57:11.292244 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:57:11.292209    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-79c79968b7-k5ftc"
Jul 06 23:57:11.298155 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:57:11.298109    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-79c79968b7-k5ftc"
Jul 06 23:57:12.125781 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:57:12.125757    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-685bfb5f64-kfp7s"
Jul 06 23:57:12.895215 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:57:12.895181    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-sqcsc"
Jul 06 23:57:13.121960 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:57:13.121920    2578 generic.go:356] "Generic (PLEG): container finished" podID="7be84f64-e9a8-4eff-9a80-034b9a7947cd" containerID="d42b131850fbf25c9bc3c00d92ccbe78b3945bd8d5c98a4e31f8cbc848ae30e1" exitCode=0
Jul 06 23:57:13.122148 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:57:13.122044    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9hvm9" event={"ID":"7be84f64-e9a8-4eff-9a80-034b9a7947cd","Type":"ContainerDied","Data":"d42b131850fbf25c9bc3c00d92ccbe78b3945bd8d5c98a4e31f8cbc848ae30e1"}
Jul 06 23:57:13.981955 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:57:13.981919    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6d5ddc46dd-hpvrn"]
Jul 06 23:57:14.133012 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:57:14.132976    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9hvm9" event={"ID":"7be84f64-e9a8-4eff-9a80-034b9a7947cd","Type":"ContainerStarted","Data":"b09c0453ab5cb5617b1f151c2f9e23fa49f00dedcf3df734131b5ba2ce347251"}
Jul 06 23:57:14.133184 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:57:14.133046    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9hvm9" event={"ID":"7be84f64-e9a8-4eff-9a80-034b9a7947cd","Type":"ContainerStarted","Data":"1cc48a3f9389a530ceadb6bdb529cea254a640879c356270cdd8d2ed1cf2f5e4"}
Jul 06 23:57:14.160085 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:57:14.160031    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-9hvm9" podStartSLOduration=5.536747077 podStartE2EDuration="7.160016682s" totalImagesPullingTime="1.509154119s" totalInitContainerRuntime="114.115486ms" isStatefulPod=true podCreationTimestamp="2026-07-06 23:57:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:57:14.159295065 +0000 UTC m=+100.270368861" watchObservedRunningTime="2026-07-06 23:57:14.160016682 +0000 UTC m=+100.271090485"
Jul 06 23:57:23.957821 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:57:23.957786    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-79c79968b7-k5ftc"]
Jul 06 23:57:39.010621 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:57:39.010553    2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-6d5ddc46dd-hpvrn" podUID="e2139ac9-3d13-4d35-8344-b94be920985a" containerName="registry" containerID="cri-o://7ac0f04109e76b1f20f2408d35604259e52d5144a34267df8a67db90ff850a3b" gracePeriod=30
Jul 06 23:57:39.244380 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:57:39.244352    2578 generic.go:356] "Generic (PLEG): container finished" podID="e2139ac9-3d13-4d35-8344-b94be920985a" containerID="7ac0f04109e76b1f20f2408d35604259e52d5144a34267df8a67db90ff850a3b" exitCode=0
Jul 06 23:57:39.244521 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:57:39.244391    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6d5ddc46dd-hpvrn" event={"ID":"e2139ac9-3d13-4d35-8344-b94be920985a","Type":"ContainerDied","Data":"7ac0f04109e76b1f20f2408d35604259e52d5144a34267df8a67db90ff850a3b"}
Jul 06 23:57:39.284248 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:57:39.284045    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6d5ddc46dd-hpvrn"
Jul 06 23:57:39.302477 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:57:39.302452    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e2139ac9-3d13-4d35-8344-b94be920985a-ca-trust-extracted\") pod \"e2139ac9-3d13-4d35-8344-b94be920985a\" (UID: \"e2139ac9-3d13-4d35-8344-b94be920985a\") "
Jul 06 23:57:39.302564 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:57:39.302492    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e2139ac9-3d13-4d35-8344-b94be920985a-image-registry-private-configuration\") pod \"e2139ac9-3d13-4d35-8344-b94be920985a\" (UID: \"e2139ac9-3d13-4d35-8344-b94be920985a\") "
Jul 06 23:57:39.302564 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:57:39.302518    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e2139ac9-3d13-4d35-8344-b94be920985a-installation-pull-secrets\") pod \"e2139ac9-3d13-4d35-8344-b94be920985a\" (UID: \"e2139ac9-3d13-4d35-8344-b94be920985a\") "
Jul 06 23:57:39.302564 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:57:39.302539    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e2139ac9-3d13-4d35-8344-b94be920985a-registry-tls\") pod \"e2139ac9-3d13-4d35-8344-b94be920985a\" (UID: \"e2139ac9-3d13-4d35-8344-b94be920985a\") "
Jul 06 23:57:39.302676 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:57:39.302570    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e2139ac9-3d13-4d35-8344-b94be920985a-registry-certificates\") pod \"e2139ac9-3d13-4d35-8344-b94be920985a\" (UID: \"e2139ac9-3d13-4d35-8344-b94be920985a\") "
Jul 06 23:57:39.302676 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:57:39.302594    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5cx6k\" (UniqueName: \"kubernetes.io/projected/e2139ac9-3d13-4d35-8344-b94be920985a-kube-api-access-5cx6k\") pod \"e2139ac9-3d13-4d35-8344-b94be920985a\" (UID: \"e2139ac9-3d13-4d35-8344-b94be920985a\") "
Jul 06 23:57:39.302676 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:57:39.302629    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e2139ac9-3d13-4d35-8344-b94be920985a-trusted-ca\") pod \"e2139ac9-3d13-4d35-8344-b94be920985a\" (UID: \"e2139ac9-3d13-4d35-8344-b94be920985a\") "
Jul 06 23:57:39.302676 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:57:39.302668    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e2139ac9-3d13-4d35-8344-b94be920985a-bound-sa-token\") pod \"e2139ac9-3d13-4d35-8344-b94be920985a\" (UID: \"e2139ac9-3d13-4d35-8344-b94be920985a\") "
Jul 06 23:57:39.303015 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:57:39.302986    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e2139ac9-3d13-4d35-8344-b94be920985a-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "e2139ac9-3d13-4d35-8344-b94be920985a" (UID: "e2139ac9-3d13-4d35-8344-b94be920985a"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 23:57:39.303525 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:57:39.303491    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e2139ac9-3d13-4d35-8344-b94be920985a-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "e2139ac9-3d13-4d35-8344-b94be920985a" (UID: "e2139ac9-3d13-4d35-8344-b94be920985a"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 23:57:39.305334 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:57:39.305306    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e2139ac9-3d13-4d35-8344-b94be920985a-kube-api-access-5cx6k" (OuterVolumeSpecName: "kube-api-access-5cx6k") pod "e2139ac9-3d13-4d35-8344-b94be920985a" (UID: "e2139ac9-3d13-4d35-8344-b94be920985a"). InnerVolumeSpecName "kube-api-access-5cx6k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 23:57:39.305566 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:57:39.305493    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e2139ac9-3d13-4d35-8344-b94be920985a-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "e2139ac9-3d13-4d35-8344-b94be920985a" (UID: "e2139ac9-3d13-4d35-8344-b94be920985a"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 23:57:39.305566 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:57:39.305540    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e2139ac9-3d13-4d35-8344-b94be920985a-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "e2139ac9-3d13-4d35-8344-b94be920985a" (UID: "e2139ac9-3d13-4d35-8344-b94be920985a"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 23:57:39.305838 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:57:39.305610    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e2139ac9-3d13-4d35-8344-b94be920985a-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "e2139ac9-3d13-4d35-8344-b94be920985a" (UID: "e2139ac9-3d13-4d35-8344-b94be920985a"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 23:57:39.305838 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:57:39.305720    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e2139ac9-3d13-4d35-8344-b94be920985a-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "e2139ac9-3d13-4d35-8344-b94be920985a" (UID: "e2139ac9-3d13-4d35-8344-b94be920985a"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 23:57:39.311502 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:57:39.311475    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e2139ac9-3d13-4d35-8344-b94be920985a-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "e2139ac9-3d13-4d35-8344-b94be920985a" (UID: "e2139ac9-3d13-4d35-8344-b94be920985a"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 23:57:39.403532 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:57:39.403507    2578 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e2139ac9-3d13-4d35-8344-b94be920985a-ca-trust-extracted\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Jul 06 23:57:39.403532 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:57:39.403528    2578 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e2139ac9-3d13-4d35-8344-b94be920985a-image-registry-private-configuration\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Jul 06 23:57:39.403705 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:57:39.403537    2578 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e2139ac9-3d13-4d35-8344-b94be920985a-installation-pull-secrets\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Jul 06 23:57:39.403705 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:57:39.403546    2578 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e2139ac9-3d13-4d35-8344-b94be920985a-registry-tls\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Jul 06 23:57:39.403705 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:57:39.403554    2578 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e2139ac9-3d13-4d35-8344-b94be920985a-registry-certificates\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Jul 06 23:57:39.403705 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:57:39.403564    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5cx6k\" (UniqueName: \"kubernetes.io/projected/e2139ac9-3d13-4d35-8344-b94be920985a-kube-api-access-5cx6k\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Jul 06 23:57:39.403705 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:57:39.403578    2578 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e2139ac9-3d13-4d35-8344-b94be920985a-trusted-ca\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Jul 06 23:57:39.403705 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:57:39.403586    2578 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e2139ac9-3d13-4d35-8344-b94be920985a-bound-sa-token\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Jul 06 23:57:40.250738 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:57:40.250707    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6d5ddc46dd-hpvrn"
Jul 06 23:57:40.251219 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:57:40.250737    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6d5ddc46dd-hpvrn" event={"ID":"e2139ac9-3d13-4d35-8344-b94be920985a","Type":"ContainerDied","Data":"c1f891e6ab68c33ddc48a279738710767cccb040b693a3c69a619fb248cc8706"}
Jul 06 23:57:40.251219 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:57:40.250814    2578 scope.go:117] "RemoveContainer" containerID="7ac0f04109e76b1f20f2408d35604259e52d5144a34267df8a67db90ff850a3b"
Jul 06 23:57:40.283037 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:57:40.282362    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6d5ddc46dd-hpvrn"]
Jul 06 23:57:40.285695 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:57:40.285668    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-6d5ddc46dd-hpvrn"]
Jul 06 23:57:40.390170 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:57:40.390137    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e2139ac9-3d13-4d35-8344-b94be920985a" path="/var/lib/kubelet/pods/e2139ac9-3d13-4d35-8344-b94be920985a/volumes"
Jul 06 23:57:41.256631 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:57:41.256592    2578 generic.go:356] "Generic (PLEG): container finished" podID="dff531e0-34c6-4281-8705-149154c350e7" containerID="5f1e8a8a4ae72c300c5251551107eea19ea8a2fa6963cbc8b300b888bafa5d1b" exitCode=0
Jul 06 23:57:41.257072 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:57:41.256665    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-fzzq2" event={"ID":"dff531e0-34c6-4281-8705-149154c350e7","Type":"ContainerDied","Data":"5f1e8a8a4ae72c300c5251551107eea19ea8a2fa6963cbc8b300b888bafa5d1b"}
Jul 06 23:57:41.257072 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:57:41.257023    2578 scope.go:117] "RemoveContainer" containerID="5f1e8a8a4ae72c300c5251551107eea19ea8a2fa6963cbc8b300b888bafa5d1b"
Jul 06 23:57:42.264065 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:57:42.264021    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-fzzq2" event={"ID":"dff531e0-34c6-4281-8705-149154c350e7","Type":"ContainerStarted","Data":"a773227e0f51a88b211bd5bf59692bf0746d0d956f45ac88d89ab7fda56d6879"}
Jul 06 23:57:45.278196 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:57:45.278116    2578 generic.go:356] "Generic (PLEG): container finished" podID="38b01eb6-03b7-4fe6-803c-e7cfb4d355a9" containerID="2bf272a4d3554ab62be12a9fdd16ba5204693412c3e7e86523651c4d886bbc07" exitCode=0
Jul 06 23:57:45.278668 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:57:45.278187    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-jvf67" event={"ID":"38b01eb6-03b7-4fe6-803c-e7cfb4d355a9","Type":"ContainerDied","Data":"2bf272a4d3554ab62be12a9fdd16ba5204693412c3e7e86523651c4d886bbc07"}
Jul 06 23:57:45.278668 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:57:45.278551    2578 scope.go:117] "RemoveContainer" containerID="2bf272a4d3554ab62be12a9fdd16ba5204693412c3e7e86523651c4d886bbc07"
Jul 06 23:57:46.285342 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:57:46.285313    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-jvf67" event={"ID":"38b01eb6-03b7-4fe6-803c-e7cfb4d355a9","Type":"ContainerStarted","Data":"a36210df86cf5147eb95d51e4f4474fbc17a06c117713a505971d9b363040b56"}
Jul 06 23:57:48.979191 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:57:48.979116    2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-79c79968b7-k5ftc" podUID="84ab3e8e-e7bb-4524-ab5c-5faea6afe060" containerName="console" containerID="cri-o://6e8299c9de7fc4886eb2c8d84a6993a8674e541618c3d8a8b650993e36136a59" gracePeriod=15
Jul 06 23:57:49.256647 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:57:49.256571    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-79c79968b7-k5ftc"
Jul 06 23:57:49.299016 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:57:49.298984    2578 generic.go:356] "Generic (PLEG): container finished" podID="84ab3e8e-e7bb-4524-ab5c-5faea6afe060" containerID="6e8299c9de7fc4886eb2c8d84a6993a8674e541618c3d8a8b650993e36136a59" exitCode=0
Jul 06 23:57:49.299163 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:57:49.299030    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-79c79968b7-k5ftc"
Jul 06 23:57:49.299163 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:57:49.299031    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-79c79968b7-k5ftc" event={"ID":"84ab3e8e-e7bb-4524-ab5c-5faea6afe060","Type":"ContainerDied","Data":"6e8299c9de7fc4886eb2c8d84a6993a8674e541618c3d8a8b650993e36136a59"}
Jul 06 23:57:49.299273 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:57:49.299182    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-79c79968b7-k5ftc" event={"ID":"84ab3e8e-e7bb-4524-ab5c-5faea6afe060","Type":"ContainerDied","Data":"4b0391f2c20997ad9b17672a55e067df1ff4b2d6b1e1020d6a44987f79432614"}
Jul 06 23:57:49.299273 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:57:49.299206    2578 scope.go:117] "RemoveContainer" containerID="6e8299c9de7fc4886eb2c8d84a6993a8674e541618c3d8a8b650993e36136a59"
Jul 06 23:57:49.307596 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:57:49.307574    2578 scope.go:117] "RemoveContainer" containerID="6e8299c9de7fc4886eb2c8d84a6993a8674e541618c3d8a8b650993e36136a59"
Jul 06 23:57:49.307860 ip-10-0-129-23 kubenswrapper[2578]: E0706 23:57:49.307840    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6e8299c9de7fc4886eb2c8d84a6993a8674e541618c3d8a8b650993e36136a59\": container with ID starting with 6e8299c9de7fc4886eb2c8d84a6993a8674e541618c3d8a8b650993e36136a59 not found: ID does not exist" containerID="6e8299c9de7fc4886eb2c8d84a6993a8674e541618c3d8a8b650993e36136a59"
Jul 06 23:57:49.307913 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:57:49.307872    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6e8299c9de7fc4886eb2c8d84a6993a8674e541618c3d8a8b650993e36136a59"} err="failed to get container status \"6e8299c9de7fc4886eb2c8d84a6993a8674e541618c3d8a8b650993e36136a59\": rpc error: code = NotFound desc = could not find container \"6e8299c9de7fc4886eb2c8d84a6993a8674e541618c3d8a8b650993e36136a59\": container with ID starting with 6e8299c9de7fc4886eb2c8d84a6993a8674e541618c3d8a8b650993e36136a59 not found: ID does not exist"
Jul 06 23:57:49.371702 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:57:49.371662    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/84ab3e8e-e7bb-4524-ab5c-5faea6afe060-service-ca\") pod \"84ab3e8e-e7bb-4524-ab5c-5faea6afe060\" (UID: \"84ab3e8e-e7bb-4524-ab5c-5faea6afe060\") "
Jul 06 23:57:49.371898 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:57:49.371721    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cvq95\" (UniqueName: \"kubernetes.io/projected/84ab3e8e-e7bb-4524-ab5c-5faea6afe060-kube-api-access-cvq95\") pod \"84ab3e8e-e7bb-4524-ab5c-5faea6afe060\" (UID: \"84ab3e8e-e7bb-4524-ab5c-5faea6afe060\") "
Jul 06 23:57:49.371898 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:57:49.371760    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/84ab3e8e-e7bb-4524-ab5c-5faea6afe060-console-config\") pod \"84ab3e8e-e7bb-4524-ab5c-5faea6afe060\" (UID: \"84ab3e8e-e7bb-4524-ab5c-5faea6afe060\") "
Jul 06 23:57:49.371898 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:57:49.371782    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/84ab3e8e-e7bb-4524-ab5c-5faea6afe060-console-oauth-config\") pod \"84ab3e8e-e7bb-4524-ab5c-5faea6afe060\" (UID: \"84ab3e8e-e7bb-4524-ab5c-5faea6afe060\") "
Jul 06 23:57:49.371898 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:57:49.371826    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/84ab3e8e-e7bb-4524-ab5c-5faea6afe060-console-serving-cert\") pod \"84ab3e8e-e7bb-4524-ab5c-5faea6afe060\" (UID: \"84ab3e8e-e7bb-4524-ab5c-5faea6afe060\") "
Jul 06 23:57:49.371898 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:57:49.371882    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/84ab3e8e-e7bb-4524-ab5c-5faea6afe060-oauth-serving-cert\") pod \"84ab3e8e-e7bb-4524-ab5c-5faea6afe060\" (UID: \"84ab3e8e-e7bb-4524-ab5c-5faea6afe060\") "
Jul 06 23:57:49.372164 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:57:49.372129    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/84ab3e8e-e7bb-4524-ab5c-5faea6afe060-service-ca" (OuterVolumeSpecName: "service-ca") pod "84ab3e8e-e7bb-4524-ab5c-5faea6afe060" (UID: "84ab3e8e-e7bb-4524-ab5c-5faea6afe060"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 23:57:49.372216 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:57:49.372171    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/84ab3e8e-e7bb-4524-ab5c-5faea6afe060-console-config" (OuterVolumeSpecName: "console-config") pod "84ab3e8e-e7bb-4524-ab5c-5faea6afe060" (UID: "84ab3e8e-e7bb-4524-ab5c-5faea6afe060"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 23:57:49.372272 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:57:49.372241    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/84ab3e8e-e7bb-4524-ab5c-5faea6afe060-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "84ab3e8e-e7bb-4524-ab5c-5faea6afe060" (UID: "84ab3e8e-e7bb-4524-ab5c-5faea6afe060"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 23:57:49.374303 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:57:49.374255    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/84ab3e8e-e7bb-4524-ab5c-5faea6afe060-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "84ab3e8e-e7bb-4524-ab5c-5faea6afe060" (UID: "84ab3e8e-e7bb-4524-ab5c-5faea6afe060"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 23:57:49.374303 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:57:49.374272    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/84ab3e8e-e7bb-4524-ab5c-5faea6afe060-kube-api-access-cvq95" (OuterVolumeSpecName: "kube-api-access-cvq95") pod "84ab3e8e-e7bb-4524-ab5c-5faea6afe060" (UID: "84ab3e8e-e7bb-4524-ab5c-5faea6afe060"). InnerVolumeSpecName "kube-api-access-cvq95". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 23:57:49.374429 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:57:49.374311    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/84ab3e8e-e7bb-4524-ab5c-5faea6afe060-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "84ab3e8e-e7bb-4524-ab5c-5faea6afe060" (UID: "84ab3e8e-e7bb-4524-ab5c-5faea6afe060"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 23:57:49.473444 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:57:49.473402    2578 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/84ab3e8e-e7bb-4524-ab5c-5faea6afe060-service-ca\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Jul 06 23:57:49.473444 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:57:49.473439    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cvq95\" (UniqueName: \"kubernetes.io/projected/84ab3e8e-e7bb-4524-ab5c-5faea6afe060-kube-api-access-cvq95\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Jul 06 23:57:49.473444 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:57:49.473453    2578 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/84ab3e8e-e7bb-4524-ab5c-5faea6afe060-console-config\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Jul 06 23:57:49.473722 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:57:49.473465    2578 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/84ab3e8e-e7bb-4524-ab5c-5faea6afe060-console-oauth-config\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Jul 06 23:57:49.473722 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:57:49.473477    2578 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/84ab3e8e-e7bb-4524-ab5c-5faea6afe060-console-serving-cert\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Jul 06 23:57:49.473722 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:57:49.473502    2578 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/84ab3e8e-e7bb-4524-ab5c-5faea6afe060-oauth-serving-cert\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Jul 06 23:57:49.621048 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:57:49.621019    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-79c79968b7-k5ftc"]
Jul 06 23:57:49.624546 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:57:49.624522    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-79c79968b7-k5ftc"]
Jul 06 23:57:50.305545 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:57:50.305450    2578 generic.go:356] "Generic (PLEG): container finished" podID="67c209fe-6215-4191-adfb-81d0bcc8e4bd" containerID="14c35cab03a5cbfecd1bd18bc6f65177b0e70c28428094e8a98ab4a7482b8fea" exitCode=0
Jul 06 23:57:50.305545 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:57:50.305522    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-rx7w7" event={"ID":"67c209fe-6215-4191-adfb-81d0bcc8e4bd","Type":"ContainerDied","Data":"14c35cab03a5cbfecd1bd18bc6f65177b0e70c28428094e8a98ab4a7482b8fea"}
Jul 06 23:57:50.305983 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:57:50.305901    2578 scope.go:117] "RemoveContainer" containerID="14c35cab03a5cbfecd1bd18bc6f65177b0e70c28428094e8a98ab4a7482b8fea"
Jul 06 23:57:50.390165 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:57:50.390134    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="84ab3e8e-e7bb-4524-ab5c-5faea6afe060" path="/var/lib/kubelet/pods/84ab3e8e-e7bb-4524-ab5c-5faea6afe060/volumes"
Jul 06 23:57:51.313134 ip-10-0-129-23 kubenswrapper[2578]: I0706 23:57:51.313098    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-rx7w7" event={"ID":"67c209fe-6215-4191-adfb-81d0bcc8e4bd","Type":"ContainerStarted","Data":"07299ea7910602a11682b727652e690ea67abf03da3fc8e27bf4c6a7c7032fc0"}
Jul 07 00:00:34.298211 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:00:34.298180    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-7gjwb_1116f765-1ebd-4c12-9ebb-ed7b7760391c/console-operator/1.log"
Jul 07 00:00:34.300899 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:00:34.300867    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-7gjwb_1116f765-1ebd-4c12-9ebb-ed7b7760391c/console-operator/1.log"
Jul 07 00:00:34.303117 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:00:34.303090    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jfngf_aba6ad45-845e-4916-8cf1-b8c76da93308/ovn-acl-logging/0.log"
Jul 07 00:00:34.305777 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:00:34.305753    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jfngf_aba6ad45-845e-4916-8cf1-b8c76da93308/ovn-acl-logging/0.log"
Jul 07 00:00:34.311675 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:00:34.311651    2578 kubelet.go:1648] "Image garbage collection succeeded"
Jul 07 00:01:00.539786 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:01:00.539756    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7c7bd8fcf-klksd"]
Jul 07 00:01:00.541242 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:01:00.540171    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e2139ac9-3d13-4d35-8344-b94be920985a" containerName="registry"
Jul 07 00:01:00.541242 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:01:00.540188    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="e2139ac9-3d13-4d35-8344-b94be920985a" containerName="registry"
Jul 07 00:01:00.541242 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:01:00.540201    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="84ab3e8e-e7bb-4524-ab5c-5faea6afe060" containerName="console"
Jul 07 00:01:00.541242 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:01:00.540211    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="84ab3e8e-e7bb-4524-ab5c-5faea6afe060" containerName="console"
Jul 07 00:01:00.541242 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:01:00.540273    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="e2139ac9-3d13-4d35-8344-b94be920985a" containerName="registry"
Jul 07 00:01:00.541242 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:01:00.540302    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="84ab3e8e-e7bb-4524-ab5c-5faea6afe060" containerName="console"
Jul 07 00:01:00.542173 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:01:00.542159    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7c7bd8fcf-klksd"
Jul 07 00:01:00.547428 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:01:00.547361    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 07 00:01:00.547428 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:01:00.547399    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 07 00:01:00.547639 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:01:00.547399    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 07 00:01:00.547639 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:01:00.547553    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-swm29\""
Jul 07 00:01:00.547639 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:01:00.547563    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 07 00:01:00.569379 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:01:00.569353    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7c7bd8fcf-klksd"]
Jul 07 00:01:00.645194 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:01:00.645173    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/47e6beea-776b-4056-b752-be71200243f0-tmp\") pod \"opendatahub-operator-controller-manager-7c7bd8fcf-klksd\" (UID: \"47e6beea-776b-4056-b752-be71200243f0\") " pod="opendatahub/opendatahub-operator-controller-manager-7c7bd8fcf-klksd"
Jul 07 00:01:00.645345 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:01:00.645202    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/47e6beea-776b-4056-b752-be71200243f0-webhook-cert\") pod \"opendatahub-operator-controller-manager-7c7bd8fcf-klksd\" (UID: \"47e6beea-776b-4056-b752-be71200243f0\") " pod="opendatahub/opendatahub-operator-controller-manager-7c7bd8fcf-klksd"
Jul 07 00:01:00.645345 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:01:00.645227    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/47e6beea-776b-4056-b752-be71200243f0-manifests\") pod \"opendatahub-operator-controller-manager-7c7bd8fcf-klksd\" (UID: \"47e6beea-776b-4056-b752-be71200243f0\") " pod="opendatahub/opendatahub-operator-controller-manager-7c7bd8fcf-klksd"
Jul 07 00:01:00.645345 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:01:00.645258    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8znvj\" (UniqueName: \"kubernetes.io/projected/47e6beea-776b-4056-b752-be71200243f0-kube-api-access-8znvj\") pod \"opendatahub-operator-controller-manager-7c7bd8fcf-klksd\" (UID: \"47e6beea-776b-4056-b752-be71200243f0\") " pod="opendatahub/opendatahub-operator-controller-manager-7c7bd8fcf-klksd"
Jul 07 00:01:00.645453 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:01:00.645346    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/47e6beea-776b-4056-b752-be71200243f0-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7c7bd8fcf-klksd\" (UID: \"47e6beea-776b-4056-b752-be71200243f0\") " pod="opendatahub/opendatahub-operator-controller-manager-7c7bd8fcf-klksd"
Jul 07 00:01:00.746555 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:01:00.746532    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/47e6beea-776b-4056-b752-be71200243f0-tmp\") pod \"opendatahub-operator-controller-manager-7c7bd8fcf-klksd\" (UID: \"47e6beea-776b-4056-b752-be71200243f0\") " pod="opendatahub/opendatahub-operator-controller-manager-7c7bd8fcf-klksd"
Jul 07 00:01:00.746673 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:01:00.746558    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/47e6beea-776b-4056-b752-be71200243f0-webhook-cert\") pod \"opendatahub-operator-controller-manager-7c7bd8fcf-klksd\" (UID: \"47e6beea-776b-4056-b752-be71200243f0\") " pod="opendatahub/opendatahub-operator-controller-manager-7c7bd8fcf-klksd"
Jul 07 00:01:00.746673 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:01:00.746587    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/47e6beea-776b-4056-b752-be71200243f0-manifests\") pod \"opendatahub-operator-controller-manager-7c7bd8fcf-klksd\" (UID: \"47e6beea-776b-4056-b752-be71200243f0\") " pod="opendatahub/opendatahub-operator-controller-manager-7c7bd8fcf-klksd"
Jul 07 00:01:00.746673 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:01:00.746619    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8znvj\" (UniqueName: \"kubernetes.io/projected/47e6beea-776b-4056-b752-be71200243f0-kube-api-access-8znvj\") pod \"opendatahub-operator-controller-manager-7c7bd8fcf-klksd\" (UID: \"47e6beea-776b-4056-b752-be71200243f0\") " pod="opendatahub/opendatahub-operator-controller-manager-7c7bd8fcf-klksd"
Jul 07 00:01:00.746821 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:01:00.746676    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/47e6beea-776b-4056-b752-be71200243f0-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7c7bd8fcf-klksd\" (UID: \"47e6beea-776b-4056-b752-be71200243f0\") " pod="opendatahub/opendatahub-operator-controller-manager-7c7bd8fcf-klksd"
Jul 07 00:01:00.746989 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:01:00.746963    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/47e6beea-776b-4056-b752-be71200243f0-manifests\") pod \"opendatahub-operator-controller-manager-7c7bd8fcf-klksd\" (UID: \"47e6beea-776b-4056-b752-be71200243f0\") " pod="opendatahub/opendatahub-operator-controller-manager-7c7bd8fcf-klksd"
Jul 07 00:01:00.748977 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:01:00.748955    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/47e6beea-776b-4056-b752-be71200243f0-tmp\") pod \"opendatahub-operator-controller-manager-7c7bd8fcf-klksd\" (UID: \"47e6beea-776b-4056-b752-be71200243f0\") " pod="opendatahub/opendatahub-operator-controller-manager-7c7bd8fcf-klksd"
Jul 07 00:01:00.749357 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:01:00.749332    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/47e6beea-776b-4056-b752-be71200243f0-webhook-cert\") pod \"opendatahub-operator-controller-manager-7c7bd8fcf-klksd\" (UID: \"47e6beea-776b-4056-b752-be71200243f0\") " pod="opendatahub/opendatahub-operator-controller-manager-7c7bd8fcf-klksd"
Jul 07 00:01:00.749525 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:01:00.749505    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/47e6beea-776b-4056-b752-be71200243f0-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7c7bd8fcf-klksd\" (UID: \"47e6beea-776b-4056-b752-be71200243f0\") " pod="opendatahub/opendatahub-operator-controller-manager-7c7bd8fcf-klksd"
Jul 07 00:01:00.758572 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:01:00.758547    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8znvj\" (UniqueName: \"kubernetes.io/projected/47e6beea-776b-4056-b752-be71200243f0-kube-api-access-8znvj\") pod \"opendatahub-operator-controller-manager-7c7bd8fcf-klksd\" (UID: \"47e6beea-776b-4056-b752-be71200243f0\") " pod="opendatahub/opendatahub-operator-controller-manager-7c7bd8fcf-klksd"
Jul 07 00:01:00.852474 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:01:00.852416    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7c7bd8fcf-klksd"
Jul 07 00:01:01.009593 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:01:01.009570    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7c7bd8fcf-klksd"]
Jul 07 00:01:01.012011 ip-10-0-129-23 kubenswrapper[2578]: W0707 00:01:01.011987    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47e6beea_776b_4056_b752_be71200243f0.slice/crio-7e90bad0ea2defd75d897e6af15ffd093e2e3d7104a4eb13c7881269c60a5610 WatchSource:0}: Error finding container 7e90bad0ea2defd75d897e6af15ffd093e2e3d7104a4eb13c7881269c60a5610: Status 404 returned error can't find the container with id 7e90bad0ea2defd75d897e6af15ffd093e2e3d7104a4eb13c7881269c60a5610
Jul 07 00:01:01.013753 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:01:01.013736    2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 07 00:01:01.095728 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:01:01.095703    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7c7bd8fcf-klksd" event={"ID":"47e6beea-776b-4056-b752-be71200243f0","Type":"ContainerStarted","Data":"7e90bad0ea2defd75d897e6af15ffd093e2e3d7104a4eb13c7881269c60a5610"}
Jul 07 00:01:04.112649 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:01:04.112570    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7c7bd8fcf-klksd" event={"ID":"47e6beea-776b-4056-b752-be71200243f0","Type":"ContainerStarted","Data":"d18f73e27329fc0dba01263b5f8580553aae5dd7a59c5c14e66f2a1d07b424a3"}
Jul 07 00:01:05.118208 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:01:05.118175    2578 generic.go:356] "Generic (PLEG): container finished" podID="47e6beea-776b-4056-b752-be71200243f0" containerID="d18f73e27329fc0dba01263b5f8580553aae5dd7a59c5c14e66f2a1d07b424a3" exitCode=0
Jul 07 00:01:05.118701 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:01:05.118260    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7c7bd8fcf-klksd" event={"ID":"47e6beea-776b-4056-b752-be71200243f0","Type":"ContainerDied","Data":"d18f73e27329fc0dba01263b5f8580553aae5dd7a59c5c14e66f2a1d07b424a3"}
Jul 07 00:01:06.125649 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:01:06.125612    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7c7bd8fcf-klksd" event={"ID":"47e6beea-776b-4056-b752-be71200243f0","Type":"ContainerStarted","Data":"dba238710de28e542ca50b2551c45f3ac16de6856c469168c82433581fee75b7"}
Jul 07 00:01:06.126123 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:01:06.125672    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-7c7bd8fcf-klksd"
Jul 07 00:01:06.150063 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:01:06.150017    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-7c7bd8fcf-klksd" podStartSLOduration=1.811855982 podStartE2EDuration="6.15000273s" totalImagesPullingTime="3.256907063s" totalInitContainerRuntime="1.081239685s" isStatefulPod=false podCreationTimestamp="2026-07-07 00:01:00 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 00:01:06.147766971 +0000 UTC m=+332.258840775" watchObservedRunningTime="2026-07-07 00:01:06.15000273 +0000 UTC m=+332.261076587"
Jul 07 00:01:17.137760 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:01:17.137728    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-7c7bd8fcf-klksd"
Jul 07 00:01:21.079567 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:01:21.079538    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-6b5dbc58cc-wkjrt"]
Jul 07 00:01:21.091898 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:01:21.091872    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6b5dbc58cc-wkjrt"
Jul 07 00:01:21.094505 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:01:21.094483    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 07 00:01:21.095064 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:01:21.095045    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 07 00:01:21.095064 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:01:21.095057    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-6kr5x\""
Jul 07 00:01:21.100938 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:01:21.100916    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6b5dbc58cc-wkjrt"]
Jul 07 00:01:21.191420 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:01:21.191387    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pmrkw\" (UniqueName: \"kubernetes.io/projected/d017afd4-b38e-4958-b388-fda5b252cceb-kube-api-access-pmrkw\") pod \"kube-auth-proxy-6b5dbc58cc-wkjrt\" (UID: \"d017afd4-b38e-4958-b388-fda5b252cceb\") " pod="openshift-ingress/kube-auth-proxy-6b5dbc58cc-wkjrt"
Jul 07 00:01:21.191596 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:01:21.191504    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d017afd4-b38e-4958-b388-fda5b252cceb-tmp\") pod \"kube-auth-proxy-6b5dbc58cc-wkjrt\" (UID: \"d017afd4-b38e-4958-b388-fda5b252cceb\") " pod="openshift-ingress/kube-auth-proxy-6b5dbc58cc-wkjrt"
Jul 07 00:01:21.191596 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:01:21.191565    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d017afd4-b38e-4958-b388-fda5b252cceb-tls-certs\") pod \"kube-auth-proxy-6b5dbc58cc-wkjrt\" (UID: \"d017afd4-b38e-4958-b388-fda5b252cceb\") " pod="openshift-ingress/kube-auth-proxy-6b5dbc58cc-wkjrt"
Jul 07 00:01:21.292561 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:01:21.292529    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pmrkw\" (UniqueName: \"kubernetes.io/projected/d017afd4-b38e-4958-b388-fda5b252cceb-kube-api-access-pmrkw\") pod \"kube-auth-proxy-6b5dbc58cc-wkjrt\" (UID: \"d017afd4-b38e-4958-b388-fda5b252cceb\") " pod="openshift-ingress/kube-auth-proxy-6b5dbc58cc-wkjrt"
Jul 07 00:01:21.292737 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:01:21.292572    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d017afd4-b38e-4958-b388-fda5b252cceb-tmp\") pod \"kube-auth-proxy-6b5dbc58cc-wkjrt\" (UID: \"d017afd4-b38e-4958-b388-fda5b252cceb\") " pod="openshift-ingress/kube-auth-proxy-6b5dbc58cc-wkjrt"
Jul 07 00:01:21.292737 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:01:21.292611    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d017afd4-b38e-4958-b388-fda5b252cceb-tls-certs\") pod \"kube-auth-proxy-6b5dbc58cc-wkjrt\" (UID: \"d017afd4-b38e-4958-b388-fda5b252cceb\") " pod="openshift-ingress/kube-auth-proxy-6b5dbc58cc-wkjrt"
Jul 07 00:01:21.295178 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:01:21.295142    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d017afd4-b38e-4958-b388-fda5b252cceb-tmp\") pod \"kube-auth-proxy-6b5dbc58cc-wkjrt\" (UID: \"d017afd4-b38e-4958-b388-fda5b252cceb\") " pod="openshift-ingress/kube-auth-proxy-6b5dbc58cc-wkjrt"
Jul 07 00:01:21.295422 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:01:21.295405    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d017afd4-b38e-4958-b388-fda5b252cceb-tls-certs\") pod \"kube-auth-proxy-6b5dbc58cc-wkjrt\" (UID: \"d017afd4-b38e-4958-b388-fda5b252cceb\") " pod="openshift-ingress/kube-auth-proxy-6b5dbc58cc-wkjrt"
Jul 07 00:01:21.313639 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:01:21.313616    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pmrkw\" (UniqueName: \"kubernetes.io/projected/d017afd4-b38e-4958-b388-fda5b252cceb-kube-api-access-pmrkw\") pod \"kube-auth-proxy-6b5dbc58cc-wkjrt\" (UID: \"d017afd4-b38e-4958-b388-fda5b252cceb\") " pod="openshift-ingress/kube-auth-proxy-6b5dbc58cc-wkjrt"
Jul 07 00:01:21.362631 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:01:21.362558    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-tzspq"]
Jul 07 00:01:21.366795 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:01:21.366773    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-tzspq"
Jul 07 00:01:21.369507 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:01:21.369489    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Jul 07 00:01:21.369798 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:01:21.369769    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-kjhb2\""
Jul 07 00:01:21.381004 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:01:21.380982    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-tzspq"]
Jul 07 00:01:21.393732 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:01:21.393707    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lg5mq\" (UniqueName: \"kubernetes.io/projected/63651ffc-300b-4230-9312-ade865fc5899-kube-api-access-lg5mq\") pod \"odh-model-controller-7998c67dc4-tzspq\" (UID: \"63651ffc-300b-4230-9312-ade865fc5899\") " pod="opendatahub/odh-model-controller-7998c67dc4-tzspq"
Jul 07 00:01:21.393857 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:01:21.393755    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/63651ffc-300b-4230-9312-ade865fc5899-cert\") pod \"odh-model-controller-7998c67dc4-tzspq\" (UID: \"63651ffc-300b-4230-9312-ade865fc5899\") " pod="opendatahub/odh-model-controller-7998c67dc4-tzspq"
Jul 07 00:01:21.405717 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:01:21.405696    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6b5dbc58cc-wkjrt"
Jul 07 00:01:21.494610 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:01:21.494572    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lg5mq\" (UniqueName: \"kubernetes.io/projected/63651ffc-300b-4230-9312-ade865fc5899-kube-api-access-lg5mq\") pod \"odh-model-controller-7998c67dc4-tzspq\" (UID: \"63651ffc-300b-4230-9312-ade865fc5899\") " pod="opendatahub/odh-model-controller-7998c67dc4-tzspq"
Jul 07 00:01:21.494774 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:01:21.494642    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/63651ffc-300b-4230-9312-ade865fc5899-cert\") pod \"odh-model-controller-7998c67dc4-tzspq\" (UID: \"63651ffc-300b-4230-9312-ade865fc5899\") " pod="opendatahub/odh-model-controller-7998c67dc4-tzspq"
Jul 07 00:01:21.494842 ip-10-0-129-23 kubenswrapper[2578]: E0707 00:01:21.494772    2578 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Jul 07 00:01:21.494842 ip-10-0-129-23 kubenswrapper[2578]: E0707 00:01:21.494831    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/63651ffc-300b-4230-9312-ade865fc5899-cert podName:63651ffc-300b-4230-9312-ade865fc5899 nodeName:}" failed. No retries permitted until 2026-07-07 00:01:21.994809532 +0000 UTC m=+348.105883323 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/63651ffc-300b-4230-9312-ade865fc5899-cert") pod "odh-model-controller-7998c67dc4-tzspq" (UID: "63651ffc-300b-4230-9312-ade865fc5899") : secret "odh-model-controller-webhook-cert" not found
Jul 07 00:01:21.519170 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:01:21.519118    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lg5mq\" (UniqueName: \"kubernetes.io/projected/63651ffc-300b-4230-9312-ade865fc5899-kube-api-access-lg5mq\") pod \"odh-model-controller-7998c67dc4-tzspq\" (UID: \"63651ffc-300b-4230-9312-ade865fc5899\") " pod="opendatahub/odh-model-controller-7998c67dc4-tzspq"
Jul 07 00:01:21.561741 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:01:21.561702    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6b5dbc58cc-wkjrt"]
Jul 07 00:01:21.566092 ip-10-0-129-23 kubenswrapper[2578]: W0707 00:01:21.566067    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd017afd4_b38e_4958_b388_fda5b252cceb.slice/crio-22f1714eebb2c1f7723fb274e8b217b12b42b0c4756d84d2a4d3284b5e21ed00 WatchSource:0}: Error finding container 22f1714eebb2c1f7723fb274e8b217b12b42b0c4756d84d2a4d3284b5e21ed00: Status 404 returned error can't find the container with id 22f1714eebb2c1f7723fb274e8b217b12b42b0c4756d84d2a4d3284b5e21ed00
Jul 07 00:01:21.999376 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:01:21.999339    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/63651ffc-300b-4230-9312-ade865fc5899-cert\") pod \"odh-model-controller-7998c67dc4-tzspq\" (UID: \"63651ffc-300b-4230-9312-ade865fc5899\") " pod="opendatahub/odh-model-controller-7998c67dc4-tzspq"
Jul 07 00:01:22.001858 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:01:22.001828    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/63651ffc-300b-4230-9312-ade865fc5899-cert\") pod \"odh-model-controller-7998c67dc4-tzspq\" (UID: \"63651ffc-300b-4230-9312-ade865fc5899\") " pod="opendatahub/odh-model-controller-7998c67dc4-tzspq"
Jul 07 00:01:22.205352 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:01:22.205265    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6b5dbc58cc-wkjrt" event={"ID":"d017afd4-b38e-4958-b388-fda5b252cceb","Type":"ContainerStarted","Data":"22f1714eebb2c1f7723fb274e8b217b12b42b0c4756d84d2a4d3284b5e21ed00"}
Jul 07 00:01:22.280924 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:01:22.280842    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-tzspq"
Jul 07 00:01:22.468226 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:01:22.468139    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-tzspq"]
Jul 07 00:01:22.471622 ip-10-0-129-23 kubenswrapper[2578]: W0707 00:01:22.471592    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63651ffc_300b_4230_9312_ade865fc5899.slice/crio-019fa7cb5adf629983a49a29bf56b3ba61946cbce2dfbc70f5429c00698bddc6 WatchSource:0}: Error finding container 019fa7cb5adf629983a49a29bf56b3ba61946cbce2dfbc70f5429c00698bddc6: Status 404 returned error can't find the container with id 019fa7cb5adf629983a49a29bf56b3ba61946cbce2dfbc70f5429c00698bddc6
Jul 07 00:01:22.759568 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:01:22.759533    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-d45td"]
Jul 07 00:01:22.764752 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:01:22.764730    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-d45td"
Jul 07 00:01:22.771533 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:01:22.771510    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Jul 07 00:01:22.772643 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:01:22.772622    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-mplb2\""
Jul 07 00:01:22.805798 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:01:22.805579    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bcf0d312-3c6f-4957-a89f-5a42f0006234-tls-certs\") pod \"model-serving-api-54d89bd5fc-d45td\" (UID: \"bcf0d312-3c6f-4957-a89f-5a42f0006234\") " pod="opendatahub/model-serving-api-54d89bd5fc-d45td"
Jul 07 00:01:22.805798 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:01:22.805671    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lmbt9\" (UniqueName: \"kubernetes.io/projected/bcf0d312-3c6f-4957-a89f-5a42f0006234-kube-api-access-lmbt9\") pod \"model-serving-api-54d89bd5fc-d45td\" (UID: \"bcf0d312-3c6f-4957-a89f-5a42f0006234\") " pod="opendatahub/model-serving-api-54d89bd5fc-d45td"
Jul 07 00:01:22.806826 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:01:22.806765    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-d45td"]
Jul 07 00:01:22.906216 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:01:22.906172    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lmbt9\" (UniqueName: \"kubernetes.io/projected/bcf0d312-3c6f-4957-a89f-5a42f0006234-kube-api-access-lmbt9\") pod \"model-serving-api-54d89bd5fc-d45td\" (UID: \"bcf0d312-3c6f-4957-a89f-5a42f0006234\") " pod="opendatahub/model-serving-api-54d89bd5fc-d45td"
Jul 07 00:01:22.906421 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:01:22.906315    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bcf0d312-3c6f-4957-a89f-5a42f0006234-tls-certs\") pod \"model-serving-api-54d89bd5fc-d45td\" (UID: \"bcf0d312-3c6f-4957-a89f-5a42f0006234\") " pod="opendatahub/model-serving-api-54d89bd5fc-d45td"
Jul 07 00:01:22.909646 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:01:22.909620    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bcf0d312-3c6f-4957-a89f-5a42f0006234-tls-certs\") pod \"model-serving-api-54d89bd5fc-d45td\" (UID: \"bcf0d312-3c6f-4957-a89f-5a42f0006234\") " pod="opendatahub/model-serving-api-54d89bd5fc-d45td"
Jul 07 00:01:22.934111 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:01:22.934039    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lmbt9\" (UniqueName: \"kubernetes.io/projected/bcf0d312-3c6f-4957-a89f-5a42f0006234-kube-api-access-lmbt9\") pod \"model-serving-api-54d89bd5fc-d45td\" (UID: \"bcf0d312-3c6f-4957-a89f-5a42f0006234\") " pod="opendatahub/model-serving-api-54d89bd5fc-d45td"
Jul 07 00:01:23.078067 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:01:23.077981    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-d45td"
Jul 07 00:01:23.184153 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:01:23.184119    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-j7rgc"]
Jul 07 00:01:23.187541 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:01:23.187519    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-j7rgc"
Jul 07 00:01:23.190338 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:01:23.190236    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 07 00:01:23.190338 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:01:23.190253    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 07 00:01:23.190338 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:01:23.190241    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 07 00:01:23.190583 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:01:23.190241    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 07 00:01:23.190735 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:01:23.190713    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-7qhsd\""
Jul 07 00:01:23.204837 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:01:23.204812    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-j7rgc"]
Jul 07 00:01:23.209456 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:01:23.209429    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1d75918a-92d8-4746-b416-45558dcc1682-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-j7rgc\" (UID: \"1d75918a-92d8-4746-b416-45558dcc1682\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-j7rgc"
Jul 07 00:01:23.209792 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:01:23.209476    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6nfkh\" (UniqueName: \"kubernetes.io/projected/1d75918a-92d8-4746-b416-45558dcc1682-kube-api-access-6nfkh\") pod \"istiod-openshift-gateway-7574459656-j7rgc\" (UID: \"1d75918a-92d8-4746-b416-45558dcc1682\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-j7rgc"
Jul 07 00:01:23.209792 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:01:23.209515    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/1d75918a-92d8-4746-b416-45558dcc1682-cacerts\") pod \"istiod-openshift-gateway-7574459656-j7rgc\" (UID: \"1d75918a-92d8-4746-b416-45558dcc1682\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-j7rgc"
Jul 07 00:01:23.209792 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:01:23.209542    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/1d75918a-92d8-4746-b416-45558dcc1682-local-certs\") pod \"istiod-openshift-gateway-7574459656-j7rgc\" (UID: \"1d75918a-92d8-4746-b416-45558dcc1682\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-j7rgc"
Jul 07 00:01:23.209792 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:01:23.209569    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/1d75918a-92d8-4746-b416-45558dcc1682-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-j7rgc\" (UID: \"1d75918a-92d8-4746-b416-45558dcc1682\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-j7rgc"
Jul 07 00:01:23.209792 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:01:23.209618    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/1d75918a-92d8-4746-b416-45558dcc1682-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-j7rgc\" (UID: \"1d75918a-92d8-4746-b416-45558dcc1682\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-j7rgc"
Jul 07 00:01:23.209792 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:01:23.209658    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1d75918a-92d8-4746-b416-45558dcc1682-istio-token\") pod \"istiod-openshift-gateway-7574459656-j7rgc\" (UID: \"1d75918a-92d8-4746-b416-45558dcc1682\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-j7rgc"
Jul 07 00:01:23.211944 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:01:23.211918    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-tzspq" event={"ID":"63651ffc-300b-4230-9312-ade865fc5899","Type":"ContainerStarted","Data":"019fa7cb5adf629983a49a29bf56b3ba61946cbce2dfbc70f5429c00698bddc6"}
Jul 07 00:01:23.310326 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:01:23.310276    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6nfkh\" (UniqueName: \"kubernetes.io/projected/1d75918a-92d8-4746-b416-45558dcc1682-kube-api-access-6nfkh\") pod \"istiod-openshift-gateway-7574459656-j7rgc\" (UID: \"1d75918a-92d8-4746-b416-45558dcc1682\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-j7rgc"
Jul 07 00:01:23.310489 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:01:23.310345    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/1d75918a-92d8-4746-b416-45558dcc1682-cacerts\") pod \"istiod-openshift-gateway-7574459656-j7rgc\" (UID: \"1d75918a-92d8-4746-b416-45558dcc1682\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-j7rgc"
Jul 07 00:01:23.310489 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:01:23.310372    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/1d75918a-92d8-4746-b416-45558dcc1682-local-certs\") pod \"istiod-openshift-gateway-7574459656-j7rgc\" (UID: \"1d75918a-92d8-4746-b416-45558dcc1682\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-j7rgc"
Jul 07 00:01:23.310489 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:01:23.310398    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/1d75918a-92d8-4746-b416-45558dcc1682-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-j7rgc\" (UID: \"1d75918a-92d8-4746-b416-45558dcc1682\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-j7rgc"
Jul 07 00:01:23.310489 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:01:23.310447    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/1d75918a-92d8-4746-b416-45558dcc1682-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-j7rgc\" (UID: \"1d75918a-92d8-4746-b416-45558dcc1682\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-j7rgc"
Jul 07 00:01:23.310489 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:01:23.310484    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1d75918a-92d8-4746-b416-45558dcc1682-istio-token\") pod \"istiod-openshift-gateway-7574459656-j7rgc\" (UID: \"1d75918a-92d8-4746-b416-45558dcc1682\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-j7rgc"
Jul 07 00:01:23.310753 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:01:23.310543    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1d75918a-92d8-4746-b416-45558dcc1682-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-j7rgc\" (UID: \"1d75918a-92d8-4746-b416-45558dcc1682\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-j7rgc"
Jul 07 00:01:23.311229 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:01:23.311182    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/1d75918a-92d8-4746-b416-45558dcc1682-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-j7rgc\" (UID: \"1d75918a-92d8-4746-b416-45558dcc1682\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-j7rgc"
Jul 07 00:01:23.313489 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:01:23.313458    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/1d75918a-92d8-4746-b416-45558dcc1682-local-certs\") pod \"istiod-openshift-gateway-7574459656-j7rgc\" (UID: \"1d75918a-92d8-4746-b416-45558dcc1682\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-j7rgc"
Jul 07 00:01:23.313489 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:01:23.313471    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1d75918a-92d8-4746-b416-45558dcc1682-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-j7rgc\" (UID: \"1d75918a-92d8-4746-b416-45558dcc1682\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-j7rgc"
Jul 07 00:01:23.313679 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:01:23.313618    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/1d75918a-92d8-4746-b416-45558dcc1682-cacerts\") pod \"istiod-openshift-gateway-7574459656-j7rgc\" (UID: \"1d75918a-92d8-4746-b416-45558dcc1682\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-j7rgc"
Jul 07 00:01:23.313885 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:01:23.313866    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/1d75918a-92d8-4746-b416-45558dcc1682-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-j7rgc\" (UID: \"1d75918a-92d8-4746-b416-45558dcc1682\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-j7rgc"
Jul 07 00:01:23.320988 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:01:23.320958    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6nfkh\" (UniqueName: \"kubernetes.io/projected/1d75918a-92d8-4746-b416-45558dcc1682-kube-api-access-6nfkh\") pod \"istiod-openshift-gateway-7574459656-j7rgc\" (UID: \"1d75918a-92d8-4746-b416-45558dcc1682\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-j7rgc"
Jul 07 00:01:23.322264 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:01:23.322222    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1d75918a-92d8-4746-b416-45558dcc1682-istio-token\") pod \"istiod-openshift-gateway-7574459656-j7rgc\" (UID: \"1d75918a-92d8-4746-b416-45558dcc1682\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-j7rgc"
Jul 07 00:01:23.501201 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:01:23.501168    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-j7rgc"
Jul 07 00:01:23.786821 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:01:23.786795    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-d45td"]
Jul 07 00:01:23.789335 ip-10-0-129-23 kubenswrapper[2578]: W0707 00:01:23.789308    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbcf0d312_3c6f_4957_a89f_5a42f0006234.slice/crio-df4019148dfd5b1c5b3263cd467bb415ab9d8932d61f21a25891bcbdc58b6965 WatchSource:0}: Error finding container df4019148dfd5b1c5b3263cd467bb415ab9d8932d61f21a25891bcbdc58b6965: Status 404 returned error can't find the container with id df4019148dfd5b1c5b3263cd467bb415ab9d8932d61f21a25891bcbdc58b6965
Jul 07 00:01:23.798424 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:01:23.798399    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-j7rgc"]
Jul 07 00:01:23.800194 ip-10-0-129-23 kubenswrapper[2578]: W0707 00:01:23.800168    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d75918a_92d8_4746_b416_45558dcc1682.slice/crio-3a4d20d6d1027346186847a5de25d6c50b44d0fd6fcdfd0d37effe625d416da3 WatchSource:0}: Error finding container 3a4d20d6d1027346186847a5de25d6c50b44d0fd6fcdfd0d37effe625d416da3: Status 404 returned error can't find the container with id 3a4d20d6d1027346186847a5de25d6c50b44d0fd6fcdfd0d37effe625d416da3
Jul 07 00:01:24.223029 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:01:24.222155    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6b5dbc58cc-wkjrt" event={"ID":"d017afd4-b38e-4958-b388-fda5b252cceb","Type":"ContainerStarted","Data":"05d99ad115c0e652e3bf6c4396dedfe70b2e7d4266e3a15682b70516a95ca99b"}
Jul 07 00:01:24.228240 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:01:24.228159    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-j7rgc" event={"ID":"1d75918a-92d8-4746-b416-45558dcc1682","Type":"ContainerStarted","Data":"3a4d20d6d1027346186847a5de25d6c50b44d0fd6fcdfd0d37effe625d416da3"}
Jul 07 00:01:24.231047 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:01:24.230983    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-d45td" event={"ID":"bcf0d312-3c6f-4957-a89f-5a42f0006234","Type":"ContainerStarted","Data":"df4019148dfd5b1c5b3263cd467bb415ab9d8932d61f21a25891bcbdc58b6965"}
Jul 07 00:01:24.241422 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:01:24.241254    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-6b5dbc58cc-wkjrt" podStartSLOduration=1.132789466 podStartE2EDuration="3.241237643s" totalImagesPullingTime="2.108448177s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 00:01:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 00:01:24.240529641 +0000 UTC m=+350.351603449" watchObservedRunningTime="2026-07-07 00:01:24.241237643 +0000 UTC m=+350.352311448"
Jul 07 00:01:27.887670 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:01:27.887641    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892172Ki","pods":"250"}
Jul 07 00:01:27.887952 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:01:27.887697    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892172Ki","pods":"250"}
Jul 07 00:01:28.256356 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:01:28.256319    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-tzspq" event={"ID":"63651ffc-300b-4230-9312-ade865fc5899","Type":"ContainerStarted","Data":"22acda02d8774cfb070cd5042e83ce8084904c584af823e8b0983a1821960c44"}
Jul 07 00:01:28.256536 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:01:28.256450    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-tzspq"
Jul 07 00:01:28.258162 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:01:28.258135    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-j7rgc" event={"ID":"1d75918a-92d8-4746-b416-45558dcc1682","Type":"ContainerStarted","Data":"ff0c01a460e11f9c013106e80c34cc69d58a28b4027a2b7ac2e2952584fdbecf"}
Jul 07 00:01:28.258416 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:01:28.258389    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-j7rgc"
Jul 07 00:01:28.260001 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:01:28.259976    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-d45td" event={"ID":"bcf0d312-3c6f-4957-a89f-5a42f0006234","Type":"ContainerStarted","Data":"7bcbdcab798d44628776b108b8f6eb835cafe0299b8b498175efca5bf616f4d1"}
Jul 07 00:01:28.260153 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:01:28.260136    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-d45td"
Jul 07 00:01:28.260322 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:01:28.260195    2578 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-j7rgc container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 07 00:01:28.260322 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:01:28.260230    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-j7rgc" podUID="1d75918a-92d8-4746-b416-45558dcc1682" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 07 00:01:28.292003 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:01:28.291952    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-tzspq" podStartSLOduration=1.883296628 podStartE2EDuration="7.291937685s" totalImagesPullingTime="5.408641057s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 00:01:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 00:01:28.29076352 +0000 UTC m=+354.401837324" watchObservedRunningTime="2026-07-07 00:01:28.291937685 +0000 UTC m=+354.403011489"
Jul 07 00:01:28.314506 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:01:28.314455    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-d45td" podStartSLOduration=2.223938475 podStartE2EDuration="6.314436616s" totalImagesPullingTime="4.090498141s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 00:01:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 00:01:28.314120941 +0000 UTC m=+354.425194747" watchObservedRunningTime="2026-07-07 00:01:28.314436616 +0000 UTC m=+354.425510419"
Jul 07 00:01:28.341940 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:01:28.341895    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7574459656-j7rgc" podStartSLOduration=1.256613207 podStartE2EDuration="5.341880771s" totalImagesPullingTime="4.085267564s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 00:01:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 00:01:28.341166721 +0000 UTC m=+354.452240522" watchObservedRunningTime="2026-07-07 00:01:28.341880771 +0000 UTC m=+354.452954574"
Jul 07 00:01:29.265420 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:01:29.265397    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-j7rgc"
Jul 07 00:01:36.099830 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:01:36.099788    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-wvtzc"]
Jul 07 00:01:36.105001 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:01:36.104976    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-wvtzc"
Jul 07 00:01:36.158052 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:01:36.158029    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Jul 07 00:01:36.158182 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:01:36.158082    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-rg9hm\""
Jul 07 00:01:36.226684 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:01:36.226655    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7135e168-178f-4853-bbf5-3b276fe3d092-cert\") pod \"kserve-controller-manager-d6f4b65b8-wvtzc\" (UID: \"7135e168-178f-4853-bbf5-3b276fe3d092\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-wvtzc"
Jul 07 00:01:36.226806 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:01:36.226698    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q7qmc\" (UniqueName: \"kubernetes.io/projected/7135e168-178f-4853-bbf5-3b276fe3d092-kube-api-access-q7qmc\") pod \"kserve-controller-manager-d6f4b65b8-wvtzc\" (UID: \"7135e168-178f-4853-bbf5-3b276fe3d092\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-wvtzc"
Jul 07 00:01:36.256783 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:01:36.256761    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-wvtzc"]
Jul 07 00:01:36.327123 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:01:36.327091    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7135e168-178f-4853-bbf5-3b276fe3d092-cert\") pod \"kserve-controller-manager-d6f4b65b8-wvtzc\" (UID: \"7135e168-178f-4853-bbf5-3b276fe3d092\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-wvtzc"
Jul 07 00:01:36.327304 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:01:36.327145    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q7qmc\" (UniqueName: \"kubernetes.io/projected/7135e168-178f-4853-bbf5-3b276fe3d092-kube-api-access-q7qmc\") pod \"kserve-controller-manager-d6f4b65b8-wvtzc\" (UID: \"7135e168-178f-4853-bbf5-3b276fe3d092\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-wvtzc"
Jul 07 00:01:36.330162 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:01:36.330130    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7135e168-178f-4853-bbf5-3b276fe3d092-cert\") pod \"kserve-controller-manager-d6f4b65b8-wvtzc\" (UID: \"7135e168-178f-4853-bbf5-3b276fe3d092\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-wvtzc"
Jul 07 00:01:36.366756 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:01:36.366688    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q7qmc\" (UniqueName: \"kubernetes.io/projected/7135e168-178f-4853-bbf5-3b276fe3d092-kube-api-access-q7qmc\") pod \"kserve-controller-manager-d6f4b65b8-wvtzc\" (UID: \"7135e168-178f-4853-bbf5-3b276fe3d092\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-wvtzc"
Jul 07 00:01:36.417802 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:01:36.417776    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-wvtzc"
Jul 07 00:01:36.595850 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:01:36.595827    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-wvtzc"]
Jul 07 00:01:36.598508 ip-10-0-129-23 kubenswrapper[2578]: W0707 00:01:36.598482    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7135e168_178f_4853_bbf5_3b276fe3d092.slice/crio-8cfe38fd666333cf14f8cd617cea1f7ee80a895b09aa16398b330fb40adf663e WatchSource:0}: Error finding container 8cfe38fd666333cf14f8cd617cea1f7ee80a895b09aa16398b330fb40adf663e: Status 404 returned error can't find the container with id 8cfe38fd666333cf14f8cd617cea1f7ee80a895b09aa16398b330fb40adf663e
Jul 07 00:01:37.304690 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:01:37.304651    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-wvtzc" event={"ID":"7135e168-178f-4853-bbf5-3b276fe3d092","Type":"ContainerStarted","Data":"8cfe38fd666333cf14f8cd617cea1f7ee80a895b09aa16398b330fb40adf663e"}
Jul 07 00:01:39.049095 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:01:39.049063    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-j7rgc"]
Jul 07 00:01:39.049550 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:01:39.049243    2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7574459656-j7rgc" podUID="1d75918a-92d8-4746-b416-45558dcc1682" containerName="discovery" containerID="cri-o://ff0c01a460e11f9c013106e80c34cc69d58a28b4027a2b7ac2e2952584fdbecf" gracePeriod=30
Jul 07 00:01:39.267589 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:01:39.267564    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-tzspq"
Jul 07 00:01:39.271072 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:01:39.271050    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-d45td"
Jul 07 00:01:39.304801 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:01:39.304733    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-j7rgc"
Jul 07 00:01:39.315828 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:01:39.315797    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-wvtzc" event={"ID":"7135e168-178f-4853-bbf5-3b276fe3d092","Type":"ContainerStarted","Data":"3cbdb50aa2b243ef174b367002f91dd681ed587a50e3a02855222487c69c4810"}
Jul 07 00:01:39.315989 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:01:39.315913    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-wvtzc"
Jul 07 00:01:39.317076 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:01:39.317056    2578 generic.go:356] "Generic (PLEG): container finished" podID="1d75918a-92d8-4746-b416-45558dcc1682" containerID="ff0c01a460e11f9c013106e80c34cc69d58a28b4027a2b7ac2e2952584fdbecf" exitCode=0
Jul 07 00:01:39.317187 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:01:39.317085    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-j7rgc"
Jul 07 00:01:39.317187 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:01:39.317130    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-j7rgc" event={"ID":"1d75918a-92d8-4746-b416-45558dcc1682","Type":"ContainerDied","Data":"ff0c01a460e11f9c013106e80c34cc69d58a28b4027a2b7ac2e2952584fdbecf"}
Jul 07 00:01:39.317187 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:01:39.317176    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-j7rgc" event={"ID":"1d75918a-92d8-4746-b416-45558dcc1682","Type":"ContainerDied","Data":"3a4d20d6d1027346186847a5de25d6c50b44d0fd6fcdfd0d37effe625d416da3"}
Jul 07 00:01:39.317375 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:01:39.317201    2578 scope.go:117] "RemoveContainer" containerID="ff0c01a460e11f9c013106e80c34cc69d58a28b4027a2b7ac2e2952584fdbecf"
Jul 07 00:01:39.325516 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:01:39.325495    2578 scope.go:117] "RemoveContainer" containerID="ff0c01a460e11f9c013106e80c34cc69d58a28b4027a2b7ac2e2952584fdbecf"
Jul 07 00:01:39.325795 ip-10-0-129-23 kubenswrapper[2578]: E0707 00:01:39.325775    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ff0c01a460e11f9c013106e80c34cc69d58a28b4027a2b7ac2e2952584fdbecf\": container with ID starting with ff0c01a460e11f9c013106e80c34cc69d58a28b4027a2b7ac2e2952584fdbecf not found: ID does not exist" containerID="ff0c01a460e11f9c013106e80c34cc69d58a28b4027a2b7ac2e2952584fdbecf"
Jul 07 00:01:39.325857 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:01:39.325806    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ff0c01a460e11f9c013106e80c34cc69d58a28b4027a2b7ac2e2952584fdbecf"} err="failed to get container status \"ff0c01a460e11f9c013106e80c34cc69d58a28b4027a2b7ac2e2952584fdbecf\": rpc error: code = NotFound desc = could not find container \"ff0c01a460e11f9c013106e80c34cc69d58a28b4027a2b7ac2e2952584fdbecf\": container with ID starting with ff0c01a460e11f9c013106e80c34cc69d58a28b4027a2b7ac2e2952584fdbecf not found: ID does not exist"
Jul 07 00:01:39.351582 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:01:39.351553    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/1d75918a-92d8-4746-b416-45558dcc1682-local-certs\") pod \"1d75918a-92d8-4746-b416-45558dcc1682\" (UID: \"1d75918a-92d8-4746-b416-45558dcc1682\") "
Jul 07 00:01:39.351735 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:01:39.351611    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1d75918a-92d8-4746-b416-45558dcc1682-istio-token\") pod \"1d75918a-92d8-4746-b416-45558dcc1682\" (UID: \"1d75918a-92d8-4746-b416-45558dcc1682\") "
Jul 07 00:01:39.351735 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:01:39.351642    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/1d75918a-92d8-4746-b416-45558dcc1682-cacerts\") pod \"1d75918a-92d8-4746-b416-45558dcc1682\" (UID: \"1d75918a-92d8-4746-b416-45558dcc1682\") "
Jul 07 00:01:39.351735 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:01:39.351711    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/1d75918a-92d8-4746-b416-45558dcc1682-istio-csr-dns-cert\") pod \"1d75918a-92d8-4746-b416-45558dcc1682\" (UID: \"1d75918a-92d8-4746-b416-45558dcc1682\") "
Jul 07 00:01:39.351880 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:01:39.351744    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6nfkh\" (UniqueName: \"kubernetes.io/projected/1d75918a-92d8-4746-b416-45558dcc1682-kube-api-access-6nfkh\") pod \"1d75918a-92d8-4746-b416-45558dcc1682\" (UID: \"1d75918a-92d8-4746-b416-45558dcc1682\") "
Jul 07 00:01:39.351880 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:01:39.351787    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1d75918a-92d8-4746-b416-45558dcc1682-istio-kubeconfig\") pod \"1d75918a-92d8-4746-b416-45558dcc1682\" (UID: \"1d75918a-92d8-4746-b416-45558dcc1682\") "
Jul 07 00:01:39.351880 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:01:39.351814    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/1d75918a-92d8-4746-b416-45558dcc1682-istio-csr-ca-configmap\") pod \"1d75918a-92d8-4746-b416-45558dcc1682\" (UID: \"1d75918a-92d8-4746-b416-45558dcc1682\") "
Jul 07 00:01:39.352752 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:01:39.352713    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1d75918a-92d8-4746-b416-45558dcc1682-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "1d75918a-92d8-4746-b416-45558dcc1682" (UID: "1d75918a-92d8-4746-b416-45558dcc1682"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 00:01:39.354845 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:01:39.354770    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1d75918a-92d8-4746-b416-45558dcc1682-kube-api-access-6nfkh" (OuterVolumeSpecName: "kube-api-access-6nfkh") pod "1d75918a-92d8-4746-b416-45558dcc1682" (UID: "1d75918a-92d8-4746-b416-45558dcc1682"). InnerVolumeSpecName "kube-api-access-6nfkh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 00:01:39.354845 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:01:39.354838    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1d75918a-92d8-4746-b416-45558dcc1682-local-certs" (OuterVolumeSpecName: "local-certs") pod "1d75918a-92d8-4746-b416-45558dcc1682" (UID: "1d75918a-92d8-4746-b416-45558dcc1682"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 00:01:39.354983 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:01:39.354852    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1d75918a-92d8-4746-b416-45558dcc1682-cacerts" (OuterVolumeSpecName: "cacerts") pod "1d75918a-92d8-4746-b416-45558dcc1682" (UID: "1d75918a-92d8-4746-b416-45558dcc1682"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 00:01:39.354983 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:01:39.354851    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1d75918a-92d8-4746-b416-45558dcc1682-istio-token" (OuterVolumeSpecName: "istio-token") pod "1d75918a-92d8-4746-b416-45558dcc1682" (UID: "1d75918a-92d8-4746-b416-45558dcc1682"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 00:01:39.354983 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:01:39.354875    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1d75918a-92d8-4746-b416-45558dcc1682-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "1d75918a-92d8-4746-b416-45558dcc1682" (UID: "1d75918a-92d8-4746-b416-45558dcc1682"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 00:01:39.354983 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:01:39.354884    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1d75918a-92d8-4746-b416-45558dcc1682-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "1d75918a-92d8-4746-b416-45558dcc1682" (UID: "1d75918a-92d8-4746-b416-45558dcc1682"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 00:01:39.447756 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:01:39.442645    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-wvtzc" podStartSLOduration=1.66476037 podStartE2EDuration="3.442625474s" totalImagesPullingTime="1.777865104s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 00:01:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 00:01:39.438456896 +0000 UTC m=+365.549530701" watchObservedRunningTime="2026-07-07 00:01:39.442625474 +0000 UTC m=+365.553699279"
Jul 07 00:01:39.452892 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:01:39.452768    2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1d75918a-92d8-4746-b416-45558dcc1682-istio-token\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Jul 07 00:01:39.452892 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:01:39.452798    2578 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/1d75918a-92d8-4746-b416-45558dcc1682-cacerts\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Jul 07 00:01:39.452892 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:01:39.452811    2578 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/1d75918a-92d8-4746-b416-45558dcc1682-istio-csr-dns-cert\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Jul 07 00:01:39.452892 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:01:39.452825    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6nfkh\" (UniqueName: \"kubernetes.io/projected/1d75918a-92d8-4746-b416-45558dcc1682-kube-api-access-6nfkh\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Jul 07 00:01:39.452892 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:01:39.452840    2578 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1d75918a-92d8-4746-b416-45558dcc1682-istio-kubeconfig\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Jul 07 00:01:39.452892 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:01:39.452853    2578 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/1d75918a-92d8-4746-b416-45558dcc1682-istio-csr-ca-configmap\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Jul 07 00:01:39.452892 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:01:39.452866    2578 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/1d75918a-92d8-4746-b416-45558dcc1682-local-certs\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Jul 07 00:01:39.659893 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:01:39.659868    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-j7rgc"]
Jul 07 00:01:39.664243 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:01:39.664221    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-j7rgc"]
Jul 07 00:01:40.390324 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:01:40.390271    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1d75918a-92d8-4746-b416-45558dcc1682" path="/var/lib/kubelet/pods/1d75918a-92d8-4746-b416-45558dcc1682/volumes"
Jul 07 00:02:10.329386 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:02:10.329343    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-wvtzc"
Jul 07 00:02:22.223035 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:02:22.222999    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-4tbp6"]
Jul 07 00:02:22.223530 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:02:22.223354    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1d75918a-92d8-4746-b416-45558dcc1682" containerName="discovery"
Jul 07 00:02:22.223530 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:02:22.223367    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="1d75918a-92d8-4746-b416-45558dcc1682" containerName="discovery"
Jul 07 00:02:22.223530 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:02:22.223433    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="1d75918a-92d8-4746-b416-45558dcc1682" containerName="discovery"
Jul 07 00:02:22.234806 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:02:22.234776    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-4tbp6"
Jul 07 00:02:22.234965 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:02:22.234871    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-4tbp6"]
Jul 07 00:02:22.237627 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:02:22.237604    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 07 00:02:22.237774 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:02:22.237604    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 07 00:02:22.238874 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:02:22.238855    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-l559d\""
Jul 07 00:02:22.371721 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:02:22.371697    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4cfww\" (UniqueName: \"kubernetes.io/projected/f02ec5a7-8e43-46ee-96de-03b8e43e703c-kube-api-access-4cfww\") pod \"kuadrant-operator-catalog-4tbp6\" (UID: \"f02ec5a7-8e43-46ee-96de-03b8e43e703c\") " pod="kuadrant-system/kuadrant-operator-catalog-4tbp6"
Jul 07 00:02:22.472119 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:02:22.472094    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4cfww\" (UniqueName: \"kubernetes.io/projected/f02ec5a7-8e43-46ee-96de-03b8e43e703c-kube-api-access-4cfww\") pod \"kuadrant-operator-catalog-4tbp6\" (UID: \"f02ec5a7-8e43-46ee-96de-03b8e43e703c\") " pod="kuadrant-system/kuadrant-operator-catalog-4tbp6"
Jul 07 00:02:22.481723 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:02:22.481663    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4cfww\" (UniqueName: \"kubernetes.io/projected/f02ec5a7-8e43-46ee-96de-03b8e43e703c-kube-api-access-4cfww\") pod \"kuadrant-operator-catalog-4tbp6\" (UID: \"f02ec5a7-8e43-46ee-96de-03b8e43e703c\") " pod="kuadrant-system/kuadrant-operator-catalog-4tbp6"
Jul 07 00:02:22.546383 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:02:22.546364    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-4tbp6"
Jul 07 00:02:22.593113 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:02:22.593077    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-4tbp6"]
Jul 07 00:02:22.681271 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:02:22.681245    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-4tbp6"]
Jul 07 00:02:22.683215 ip-10-0-129-23 kubenswrapper[2578]: W0707 00:02:22.683186    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf02ec5a7_8e43_46ee_96de_03b8e43e703c.slice/crio-a2d5786fcf16bb76b473810851fdd22d84230b45727304d8722eea4ccc308ff2 WatchSource:0}: Error finding container a2d5786fcf16bb76b473810851fdd22d84230b45727304d8722eea4ccc308ff2: Status 404 returned error can't find the container with id a2d5786fcf16bb76b473810851fdd22d84230b45727304d8722eea4ccc308ff2
Jul 07 00:02:22.801922 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:02:22.801861    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-cl88r"]
Jul 07 00:02:22.806425 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:02:22.806409    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-cl88r"
Jul 07 00:02:22.814301 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:02:22.814260    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-cl88r"]
Jul 07 00:02:22.976018 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:02:22.975997    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2jq6m\" (UniqueName: \"kubernetes.io/projected/47f95e09-5bf3-4a3e-a14b-af8c2b283342-kube-api-access-2jq6m\") pod \"kuadrant-operator-catalog-cl88r\" (UID: \"47f95e09-5bf3-4a3e-a14b-af8c2b283342\") " pod="kuadrant-system/kuadrant-operator-catalog-cl88r"
Jul 07 00:02:23.077215 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:02:23.077149    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2jq6m\" (UniqueName: \"kubernetes.io/projected/47f95e09-5bf3-4a3e-a14b-af8c2b283342-kube-api-access-2jq6m\") pod \"kuadrant-operator-catalog-cl88r\" (UID: \"47f95e09-5bf3-4a3e-a14b-af8c2b283342\") " pod="kuadrant-system/kuadrant-operator-catalog-cl88r"
Jul 07 00:02:23.088812 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:02:23.088781    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2jq6m\" (UniqueName: \"kubernetes.io/projected/47f95e09-5bf3-4a3e-a14b-af8c2b283342-kube-api-access-2jq6m\") pod \"kuadrant-operator-catalog-cl88r\" (UID: \"47f95e09-5bf3-4a3e-a14b-af8c2b283342\") " pod="kuadrant-system/kuadrant-operator-catalog-cl88r"
Jul 07 00:02:23.116803 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:02:23.116779    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-cl88r"
Jul 07 00:02:23.252674 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:02:23.252642    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-cl88r"]
Jul 07 00:02:23.254076 ip-10-0-129-23 kubenswrapper[2578]: W0707 00:02:23.254049    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47f95e09_5bf3_4a3e_a14b_af8c2b283342.slice/crio-f38798abcee6a4b61befb795362490df6778d739459dfcd8462c4999c1ab9c98 WatchSource:0}: Error finding container f38798abcee6a4b61befb795362490df6778d739459dfcd8462c4999c1ab9c98: Status 404 returned error can't find the container with id f38798abcee6a4b61befb795362490df6778d739459dfcd8462c4999c1ab9c98
Jul 07 00:02:23.517952 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:02:23.517917    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-cl88r" event={"ID":"47f95e09-5bf3-4a3e-a14b-af8c2b283342","Type":"ContainerStarted","Data":"f38798abcee6a4b61befb795362490df6778d739459dfcd8462c4999c1ab9c98"}
Jul 07 00:02:23.518979 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:02:23.518960    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-4tbp6" event={"ID":"f02ec5a7-8e43-46ee-96de-03b8e43e703c","Type":"ContainerStarted","Data":"a2d5786fcf16bb76b473810851fdd22d84230b45727304d8722eea4ccc308ff2"}
Jul 07 00:02:26.537087 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:02:26.537049    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-4tbp6" event={"ID":"f02ec5a7-8e43-46ee-96de-03b8e43e703c","Type":"ContainerStarted","Data":"f22e1a6d9255213392e2294d0a67aa57e73e1402428106b973db655977278216"}
Jul 07 00:02:26.537650 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:02:26.537103    2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-4tbp6" podUID="f02ec5a7-8e43-46ee-96de-03b8e43e703c" containerName="registry-server" containerID="cri-o://f22e1a6d9255213392e2294d0a67aa57e73e1402428106b973db655977278216" gracePeriod=2
Jul 07 00:02:26.538635 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:02:26.538607    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-cl88r" event={"ID":"47f95e09-5bf3-4a3e-a14b-af8c2b283342","Type":"ContainerStarted","Data":"119636e8bb936d151bf3345c3320856f6ab867bc6ddf2227356744d4bdf3a3cd"}
Jul 07 00:02:26.552274 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:02:26.552226    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-4tbp6" podStartSLOduration=1.6283268180000001 podStartE2EDuration="4.552211325s" totalImagesPullingTime="2.923884507s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 00:02:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 00:02:26.551793714 +0000 UTC m=+412.662867520" watchObservedRunningTime="2026-07-07 00:02:26.552211325 +0000 UTC m=+412.663285128"
Jul 07 00:02:26.568520 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:02:26.568478    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-cl88r" podStartSLOduration=2.21176213 podStartE2EDuration="4.568465197s" totalImagesPullingTime="2.356703067s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 00:02:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 00:02:26.567460838 +0000 UTC m=+412.678534637" watchObservedRunningTime="2026-07-07 00:02:26.568465197 +0000 UTC m=+412.679539030"
Jul 07 00:02:26.782514 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:02:26.782492    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-4tbp6"
Jul 07 00:02:26.910703 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:02:26.910678    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4cfww\" (UniqueName: \"kubernetes.io/projected/f02ec5a7-8e43-46ee-96de-03b8e43e703c-kube-api-access-4cfww\") pod \"f02ec5a7-8e43-46ee-96de-03b8e43e703c\" (UID: \"f02ec5a7-8e43-46ee-96de-03b8e43e703c\") "
Jul 07 00:02:26.912892 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:02:26.912864    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f02ec5a7-8e43-46ee-96de-03b8e43e703c-kube-api-access-4cfww" (OuterVolumeSpecName: "kube-api-access-4cfww") pod "f02ec5a7-8e43-46ee-96de-03b8e43e703c" (UID: "f02ec5a7-8e43-46ee-96de-03b8e43e703c"). InnerVolumeSpecName "kube-api-access-4cfww". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 00:02:27.011771 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:02:27.011743    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4cfww\" (UniqueName: \"kubernetes.io/projected/f02ec5a7-8e43-46ee-96de-03b8e43e703c-kube-api-access-4cfww\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Jul 07 00:02:27.545679 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:02:27.545640    2578 generic.go:356] "Generic (PLEG): container finished" podID="f02ec5a7-8e43-46ee-96de-03b8e43e703c" containerID="f22e1a6d9255213392e2294d0a67aa57e73e1402428106b973db655977278216" exitCode=0
Jul 07 00:02:27.546138 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:02:27.545690    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-4tbp6"
Jul 07 00:02:27.546138 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:02:27.545728    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-4tbp6" event={"ID":"f02ec5a7-8e43-46ee-96de-03b8e43e703c","Type":"ContainerDied","Data":"f22e1a6d9255213392e2294d0a67aa57e73e1402428106b973db655977278216"}
Jul 07 00:02:27.546138 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:02:27.545801    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-4tbp6" event={"ID":"f02ec5a7-8e43-46ee-96de-03b8e43e703c","Type":"ContainerDied","Data":"a2d5786fcf16bb76b473810851fdd22d84230b45727304d8722eea4ccc308ff2"}
Jul 07 00:02:27.546138 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:02:27.545847    2578 scope.go:117] "RemoveContainer" containerID="f22e1a6d9255213392e2294d0a67aa57e73e1402428106b973db655977278216"
Jul 07 00:02:27.556093 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:02:27.556073    2578 scope.go:117] "RemoveContainer" containerID="f22e1a6d9255213392e2294d0a67aa57e73e1402428106b973db655977278216"
Jul 07 00:02:27.556433 ip-10-0-129-23 kubenswrapper[2578]: E0707 00:02:27.556395    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f22e1a6d9255213392e2294d0a67aa57e73e1402428106b973db655977278216\": container with ID starting with f22e1a6d9255213392e2294d0a67aa57e73e1402428106b973db655977278216 not found: ID does not exist" containerID="f22e1a6d9255213392e2294d0a67aa57e73e1402428106b973db655977278216"
Jul 07 00:02:27.556484 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:02:27.556442    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f22e1a6d9255213392e2294d0a67aa57e73e1402428106b973db655977278216"} err="failed to get container status \"f22e1a6d9255213392e2294d0a67aa57e73e1402428106b973db655977278216\": rpc error: code = NotFound desc = could not find container \"f22e1a6d9255213392e2294d0a67aa57e73e1402428106b973db655977278216\": container with ID starting with f22e1a6d9255213392e2294d0a67aa57e73e1402428106b973db655977278216 not found: ID does not exist"
Jul 07 00:02:27.566254 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:02:27.566222    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-4tbp6"]
Jul 07 00:02:27.570369 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:02:27.570331    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-4tbp6"]
Jul 07 00:02:28.391558 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:02:28.391526    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f02ec5a7-8e43-46ee-96de-03b8e43e703c" path="/var/lib/kubelet/pods/f02ec5a7-8e43-46ee-96de-03b8e43e703c/volumes"
Jul 07 00:02:33.117384 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:02:33.117355    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-cl88r"
Jul 07 00:02:33.117902 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:02:33.117647    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-cl88r"
Jul 07 00:02:33.141669 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:02:33.141646    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-cl88r"
Jul 07 00:02:33.594998 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:02:33.594970    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-cl88r"
Jul 07 00:02:53.907701 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:02:53.907672    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zmh5q"]
Jul 07 00:02:53.908298 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:02:53.908163    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f02ec5a7-8e43-46ee-96de-03b8e43e703c" containerName="registry-server"
Jul 07 00:02:53.908298 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:02:53.908181    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="f02ec5a7-8e43-46ee-96de-03b8e43e703c" containerName="registry-server"
Jul 07 00:02:53.908430 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:02:53.908304    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="f02ec5a7-8e43-46ee-96de-03b8e43e703c" containerName="registry-server"
Jul 07 00:02:53.915803 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:02:53.915778    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zmh5q"
Jul 07 00:02:53.921188 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:02:53.921165    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-hf62t\""
Jul 07 00:02:53.944100 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:02:53.944080    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zmh5q"]
Jul 07 00:02:54.030639 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:02:54.030607    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xwdct\" (UniqueName: \"kubernetes.io/projected/cf713e97-0688-4eda-966f-778e7efcc7f1-kube-api-access-xwdct\") pod \"limitador-operator-controller-manager-859d7b78bd-zmh5q\" (UID: \"cf713e97-0688-4eda-966f-778e7efcc7f1\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zmh5q"
Jul 07 00:02:54.131547 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:02:54.131516    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xwdct\" (UniqueName: \"kubernetes.io/projected/cf713e97-0688-4eda-966f-778e7efcc7f1-kube-api-access-xwdct\") pod \"limitador-operator-controller-manager-859d7b78bd-zmh5q\" (UID: \"cf713e97-0688-4eda-966f-778e7efcc7f1\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zmh5q"
Jul 07 00:02:54.144541 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:02:54.144516    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xwdct\" (UniqueName: \"kubernetes.io/projected/cf713e97-0688-4eda-966f-778e7efcc7f1-kube-api-access-xwdct\") pod \"limitador-operator-controller-manager-859d7b78bd-zmh5q\" (UID: \"cf713e97-0688-4eda-966f-778e7efcc7f1\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zmh5q"
Jul 07 00:02:54.225819 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:02:54.225764    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zmh5q"
Jul 07 00:02:54.366963 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:02:54.366940    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zmh5q"]
Jul 07 00:02:54.369061 ip-10-0-129-23 kubenswrapper[2578]: W0707 00:02:54.369036    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf713e97_0688_4eda_966f_778e7efcc7f1.slice/crio-85d34ae0870415e0ae243f0446983f97d60c3df9fcb32fb21acfc1e84274cf1b WatchSource:0}: Error finding container 85d34ae0870415e0ae243f0446983f97d60c3df9fcb32fb21acfc1e84274cf1b: Status 404 returned error can't find the container with id 85d34ae0870415e0ae243f0446983f97d60c3df9fcb32fb21acfc1e84274cf1b
Jul 07 00:02:54.664482 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:02:54.664444    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zmh5q" event={"ID":"cf713e97-0688-4eda-966f-778e7efcc7f1","Type":"ContainerStarted","Data":"85d34ae0870415e0ae243f0446983f97d60c3df9fcb32fb21acfc1e84274cf1b"}
Jul 07 00:02:56.676405 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:02:56.676365    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zmh5q" event={"ID":"cf713e97-0688-4eda-966f-778e7efcc7f1","Type":"ContainerStarted","Data":"e9dd4f70e1a007c9e4e0311f42efbeb31bb65b93d6be1f4e8ce7b75fd93fe281"}
Jul 07 00:02:56.676821 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:02:56.676488    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zmh5q"
Jul 07 00:02:56.708666 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:02:56.708615    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zmh5q" podStartSLOduration=2.123950744 podStartE2EDuration="3.708599597s" totalImagesPullingTime="1.584648853s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 00:02:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 00:02:56.706141958 +0000 UTC m=+442.817215762" watchObservedRunningTime="2026-07-07 00:02:56.708599597 +0000 UTC m=+442.819673400"
Jul 07 00:02:58.064339 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:02:58.064308    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-b94qb"]
Jul 07 00:02:58.067471 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:02:58.067455    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-b94qb"
Jul 07 00:02:58.070919 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:02:58.070895    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-cjfsb\""
Jul 07 00:02:58.082549 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:02:58.082530    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-b94qb"]
Jul 07 00:02:58.165536 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:02:58.165509    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vwjw9\" (UniqueName: \"kubernetes.io/projected/6bd24b30-85df-4a48-83ed-9e16227218b2-kube-api-access-vwjw9\") pod \"authorino-operator-75cc8d5cb7-b94qb\" (UID: \"6bd24b30-85df-4a48-83ed-9e16227218b2\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-b94qb"
Jul 07 00:02:58.266048 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:02:58.266014    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vwjw9\" (UniqueName: \"kubernetes.io/projected/6bd24b30-85df-4a48-83ed-9e16227218b2-kube-api-access-vwjw9\") pod \"authorino-operator-75cc8d5cb7-b94qb\" (UID: \"6bd24b30-85df-4a48-83ed-9e16227218b2\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-b94qb"
Jul 07 00:02:58.289027 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:02:58.289000    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vwjw9\" (UniqueName: \"kubernetes.io/projected/6bd24b30-85df-4a48-83ed-9e16227218b2-kube-api-access-vwjw9\") pod \"authorino-operator-75cc8d5cb7-b94qb\" (UID: \"6bd24b30-85df-4a48-83ed-9e16227218b2\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-b94qb"
Jul 07 00:02:58.377217 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:02:58.377146    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-b94qb"
Jul 07 00:02:58.569525 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:02:58.569504    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-b94qb"]
Jul 07 00:02:58.571517 ip-10-0-129-23 kubenswrapper[2578]: W0707 00:02:58.571485    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6bd24b30_85df_4a48_83ed_9e16227218b2.slice/crio-af32b0e87f5ac54753acae3c3475214bb0e529673e371abadb3eb6c627c0d82b WatchSource:0}: Error finding container af32b0e87f5ac54753acae3c3475214bb0e529673e371abadb3eb6c627c0d82b: Status 404 returned error can't find the container with id af32b0e87f5ac54753acae3c3475214bb0e529673e371abadb3eb6c627c0d82b
Jul 07 00:02:58.687410 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:02:58.687382    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-b94qb" event={"ID":"6bd24b30-85df-4a48-83ed-9e16227218b2","Type":"ContainerStarted","Data":"af32b0e87f5ac54753acae3c3475214bb0e529673e371abadb3eb6c627c0d82b"}
Jul 07 00:03:01.702491 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:03:01.702452    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-b94qb" event={"ID":"6bd24b30-85df-4a48-83ed-9e16227218b2","Type":"ContainerStarted","Data":"965e23ebd6a0edff7408cad0849fc402c909d81d821de6c055548e762312d15e"}
Jul 07 00:03:01.702859 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:03:01.702517    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-b94qb"
Jul 07 00:03:01.724123 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:03:01.724085    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-b94qb" podStartSLOduration=1.5140376070000001 podStartE2EDuration="3.724071214s" totalImagesPullingTime="2.210033607s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 00:02:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 00:03:01.722390993 +0000 UTC m=+447.833464797" watchObservedRunningTime="2026-07-07 00:03:01.724071214 +0000 UTC m=+447.835145050"
Jul 07 00:03:03.483176 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:03:03.483139    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kgx4h"]
Jul 07 00:03:03.486736 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:03:03.486722    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kgx4h"
Jul 07 00:03:03.489551 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:03:03.489528    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-cph9l\""
Jul 07 00:03:03.585055 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:03:03.585024    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kgx4h"]
Jul 07 00:03:03.610980 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:03:03.610951    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/af31136c-c74d-433a-9016-2c82c8d687e6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-kgx4h\" (UID: \"af31136c-c74d-433a-9016-2c82c8d687e6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kgx4h"
Jul 07 00:03:03.610980 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:03:03.610984    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2dzct\" (UniqueName: \"kubernetes.io/projected/af31136c-c74d-433a-9016-2c82c8d687e6-kube-api-access-2dzct\") pod \"kuadrant-operator-controller-manager-8684c9ff49-kgx4h\" (UID: \"af31136c-c74d-433a-9016-2c82c8d687e6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kgx4h"
Jul 07 00:03:03.711474 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:03:03.711447    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/af31136c-c74d-433a-9016-2c82c8d687e6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-kgx4h\" (UID: \"af31136c-c74d-433a-9016-2c82c8d687e6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kgx4h"
Jul 07 00:03:03.711474 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:03:03.711477    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2dzct\" (UniqueName: \"kubernetes.io/projected/af31136c-c74d-433a-9016-2c82c8d687e6-kube-api-access-2dzct\") pod \"kuadrant-operator-controller-manager-8684c9ff49-kgx4h\" (UID: \"af31136c-c74d-433a-9016-2c82c8d687e6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kgx4h"
Jul 07 00:03:03.711807 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:03:03.711790    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/af31136c-c74d-433a-9016-2c82c8d687e6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-kgx4h\" (UID: \"af31136c-c74d-433a-9016-2c82c8d687e6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kgx4h"
Jul 07 00:03:03.722790 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:03:03.722767    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2dzct\" (UniqueName: \"kubernetes.io/projected/af31136c-c74d-433a-9016-2c82c8d687e6-kube-api-access-2dzct\") pod \"kuadrant-operator-controller-manager-8684c9ff49-kgx4h\" (UID: \"af31136c-c74d-433a-9016-2c82c8d687e6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kgx4h"
Jul 07 00:03:03.797121 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:03:03.797050    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kgx4h"
Jul 07 00:03:03.934702 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:03:03.934678    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kgx4h"]
Jul 07 00:03:03.937747 ip-10-0-129-23 kubenswrapper[2578]: W0707 00:03:03.937721    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf31136c_c74d_433a_9016_2c82c8d687e6.slice/crio-61cb4d1b1cb87a0a5617465e64214f4650609c9df4413ff756c76d999fdd304a WatchSource:0}: Error finding container 61cb4d1b1cb87a0a5617465e64214f4650609c9df4413ff756c76d999fdd304a: Status 404 returned error can't find the container with id 61cb4d1b1cb87a0a5617465e64214f4650609c9df4413ff756c76d999fdd304a
Jul 07 00:03:04.718180 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:03:04.718141    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kgx4h" event={"ID":"af31136c-c74d-433a-9016-2c82c8d687e6","Type":"ContainerStarted","Data":"61cb4d1b1cb87a0a5617465e64214f4650609c9df4413ff756c76d999fdd304a"}
Jul 07 00:03:05.919921 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:03:05.919883    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-mrsp7"]
Jul 07 00:03:05.923774 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:03:05.923753    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-mrsp7"
Jul 07 00:03:05.926618 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:03:05.926591    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Jul 07 00:03:05.926773 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:03:05.926675    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-2n9sh\""
Jul 07 00:03:05.936706 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:03:05.936683    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-mrsp7"]
Jul 07 00:03:06.030790 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:03:06.030762    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-phdcc\" (UniqueName: \"kubernetes.io/projected/b9748d6e-0ead-4547-850e-1bf9702e6ae6-kube-api-access-phdcc\") pod \"dns-operator-controller-manager-864dd78c4c-mrsp7\" (UID: \"b9748d6e-0ead-4547-850e-1bf9702e6ae6\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-mrsp7"
Jul 07 00:03:06.131899 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:03:06.131867    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-phdcc\" (UniqueName: \"kubernetes.io/projected/b9748d6e-0ead-4547-850e-1bf9702e6ae6-kube-api-access-phdcc\") pod \"dns-operator-controller-manager-864dd78c4c-mrsp7\" (UID: \"b9748d6e-0ead-4547-850e-1bf9702e6ae6\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-mrsp7"
Jul 07 00:03:06.141654 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:03:06.141623    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-phdcc\" (UniqueName: \"kubernetes.io/projected/b9748d6e-0ead-4547-850e-1bf9702e6ae6-kube-api-access-phdcc\") pod \"dns-operator-controller-manager-864dd78c4c-mrsp7\" (UID: \"b9748d6e-0ead-4547-850e-1bf9702e6ae6\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-mrsp7"
Jul 07 00:03:06.236951 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:03:06.236885    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-mrsp7"
Jul 07 00:03:06.377531 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:03:06.377509    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-mrsp7"]
Jul 07 00:03:06.379362 ip-10-0-129-23 kubenswrapper[2578]: W0707 00:03:06.379335    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9748d6e_0ead_4547_850e_1bf9702e6ae6.slice/crio-5f23d03044167f997ac3a066821fc8064634eda8631bde4492a89f75c4426cf7 WatchSource:0}: Error finding container 5f23d03044167f997ac3a066821fc8064634eda8631bde4492a89f75c4426cf7: Status 404 returned error can't find the container with id 5f23d03044167f997ac3a066821fc8064634eda8631bde4492a89f75c4426cf7
Jul 07 00:03:06.730542 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:03:06.730503    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-mrsp7" event={"ID":"b9748d6e-0ead-4547-850e-1bf9702e6ae6","Type":"ContainerStarted","Data":"5f23d03044167f997ac3a066821fc8064634eda8631bde4492a89f75c4426cf7"}
Jul 07 00:03:07.684209 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:03:07.684182    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zmh5q"
Jul 07 00:03:09.750231 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:03:09.750195    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-mrsp7" event={"ID":"b9748d6e-0ead-4547-850e-1bf9702e6ae6","Type":"ContainerStarted","Data":"241bf036d10810fddf3e41a117f3a1919e4480d5f196f00ae25a816822bedacc"}
Jul 07 00:03:09.750840 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:03:09.750259    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-mrsp7"
Jul 07 00:03:09.751896 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:03:09.751871    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kgx4h" event={"ID":"af31136c-c74d-433a-9016-2c82c8d687e6","Type":"ContainerStarted","Data":"d712e3165deff3f3d9d20b887ae363930f9de62e58512edbbaa63ec66cebcccd"}
Jul 07 00:03:09.752021 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:03:09.751990    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kgx4h"
Jul 07 00:03:09.768661 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:03:09.768611    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-mrsp7" podStartSLOduration=1.9308960769999999 podStartE2EDuration="4.768598902s" totalImagesPullingTime="2.837702825s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 00:03:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 00:03:09.767553469 +0000 UTC m=+455.878627273" watchObservedRunningTime="2026-07-07 00:03:09.768598902 +0000 UTC m=+455.879672705"
Jul 07 00:03:09.789476 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:03:09.789433    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kgx4h" podStartSLOduration=1.5616501710000001 podStartE2EDuration="6.78942084s" totalImagesPullingTime="5.227770669s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 00:03:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 00:03:09.787513685 +0000 UTC m=+455.898587488" watchObservedRunningTime="2026-07-07 00:03:09.78942084 +0000 UTC m=+455.900494643"
Jul 07 00:03:12.708898 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:03:12.708867    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-b94qb"
Jul 07 00:03:20.758581 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:03:20.758550    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-mrsp7"
Jul 07 00:03:20.759177 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:03:20.758642    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kgx4h"
Jul 07 00:03:22.866079 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:03:22.866049    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kgx4h"]
Jul 07 00:03:22.866505 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:03:22.866231    2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kgx4h" podUID="af31136c-c74d-433a-9016-2c82c8d687e6" containerName="manager" containerID="cri-o://d712e3165deff3f3d9d20b887ae363930f9de62e58512edbbaa63ec66cebcccd" gracePeriod=2
Jul 07 00:03:22.880439 ip-10-0-129-23 kubenswrapper[2578]: E0707 00:03:22.880396    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-kgx4h\" is forbidden: User \"system:node:ip-10-0-129-23.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-23.ec2.internal' and this object" podUID="af31136c-c74d-433a-9016-2c82c8d687e6" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kgx4h"
Jul 07 00:03:22.880647 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:03:22.880619    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kgx4h"]
Jul 07 00:03:22.915325 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:03:22.915277    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zmh5q"]
Jul 07 00:03:22.915539 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:03:22.915504    2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zmh5q" podUID="cf713e97-0688-4eda-966f-778e7efcc7f1" containerName="manager" containerID="cri-o://e9dd4f70e1a007c9e4e0311f42efbeb31bb65b93d6be1f4e8ce7b75fd93fe281" gracePeriod=2
Jul 07 00:03:22.918443 ip-10-0-129-23 kubenswrapper[2578]: E0707 00:03:22.918376    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-kgx4h\" is forbidden: User \"system:node:ip-10-0-129-23.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-23.ec2.internal' and this object" podUID="af31136c-c74d-433a-9016-2c82c8d687e6" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kgx4h"
Jul 07 00:03:22.926552 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:03:22.926533    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zmh5q"]
Jul 07 00:03:23.007187 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:03:23.007156    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fthnp"]
Jul 07 00:03:23.007580 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:03:23.007564    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="af31136c-c74d-433a-9016-2c82c8d687e6" containerName="manager"
Jul 07 00:03:23.007682 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:03:23.007582    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="af31136c-c74d-433a-9016-2c82c8d687e6" containerName="manager"
Jul 07 00:03:23.007682 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:03:23.007608    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cf713e97-0688-4eda-966f-778e7efcc7f1" containerName="manager"
Jul 07 00:03:23.007682 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:03:23.007614    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="cf713e97-0688-4eda-966f-778e7efcc7f1" containerName="manager"
Jul 07 00:03:23.007682 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:03:23.007680    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="af31136c-c74d-433a-9016-2c82c8d687e6" containerName="manager"
Jul 07 00:03:23.007880 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:03:23.007693    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="cf713e97-0688-4eda-966f-778e7efcc7f1" containerName="manager"
Jul 07 00:03:23.010488 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:03:23.010470    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8spt2"]
Jul 07 00:03:23.010620 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:03:23.010602    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fthnp"
Jul 07 00:03:23.013616 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:03:23.013599    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8spt2"
Jul 07 00:03:23.016392 ip-10-0-129-23 kubenswrapper[2578]: E0707 00:03:23.016361    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-zmh5q\" is forbidden: User \"system:node:ip-10-0-129-23.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-23.ec2.internal' and this object" podUID="cf713e97-0688-4eda-966f-778e7efcc7f1" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zmh5q"
Jul 07 00:03:23.030348 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:03:23.030259    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fthnp"]
Jul 07 00:03:23.040795 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:03:23.040766    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8spt2"]
Jul 07 00:03:23.062796 ip-10-0-129-23 kubenswrapper[2578]: E0707 00:03:23.062759    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-kgx4h\" is forbidden: User \"system:node:ip-10-0-129-23.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-23.ec2.internal' and this object" podUID="af31136c-c74d-433a-9016-2c82c8d687e6" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kgx4h"
Jul 07 00:03:23.066157 ip-10-0-129-23 kubenswrapper[2578]: E0707 00:03:23.066122    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-kgx4h\" is forbidden: User \"system:node:ip-10-0-129-23.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-23.ec2.internal' and this object" podUID="af31136c-c74d-433a-9016-2c82c8d687e6" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kgx4h"
Jul 07 00:03:23.135735 ip-10-0-129-23 kubenswrapper[2578]: E0707 00:03:23.135664    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-zmh5q\" is forbidden: User \"system:node:ip-10-0-129-23.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-23.ec2.internal' and this object" podUID="cf713e97-0688-4eda-966f-778e7efcc7f1" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zmh5q"
Jul 07 00:03:23.177681 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:03:23.177658    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/86887ca3-0bb2-477d-831b-6dcf9094e28f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-fthnp\" (UID: \"86887ca3-0bb2-477d-831b-6dcf9094e28f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fthnp"
Jul 07 00:03:23.177774 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:03:23.177704    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n4fzg\" (UniqueName: \"kubernetes.io/projected/30f3c9fc-59c8-438c-8916-65f5643fdc17-kube-api-access-n4fzg\") pod \"limitador-operator-controller-manager-859d7b78bd-8spt2\" (UID: \"30f3c9fc-59c8-438c-8916-65f5643fdc17\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8spt2"
Jul 07 00:03:23.177825 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:03:23.177804    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fsp6b\" (UniqueName: \"kubernetes.io/projected/86887ca3-0bb2-477d-831b-6dcf9094e28f-kube-api-access-fsp6b\") pod \"kuadrant-operator-controller-manager-8684c9ff49-fthnp\" (UID: \"86887ca3-0bb2-477d-831b-6dcf9094e28f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fthnp"
Jul 07 00:03:23.190757 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:03:23.190738    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zmh5q"
Jul 07 00:03:23.193410 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:03:23.193392    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kgx4h"
Jul 07 00:03:23.195911 ip-10-0-129-23 kubenswrapper[2578]: E0707 00:03:23.195883    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-kgx4h\" is forbidden: User \"system:node:ip-10-0-129-23.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-23.ec2.internal' and this object" podUID="af31136c-c74d-433a-9016-2c82c8d687e6" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kgx4h"
Jul 07 00:03:23.199385 ip-10-0-129-23 kubenswrapper[2578]: E0707 00:03:23.199361    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-zmh5q\" is forbidden: User \"system:node:ip-10-0-129-23.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-23.ec2.internal' and this object" podUID="cf713e97-0688-4eda-966f-778e7efcc7f1" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zmh5q"
Jul 07 00:03:23.203472 ip-10-0-129-23 kubenswrapper[2578]: E0707 00:03:23.203447    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-kgx4h\" is forbidden: User \"system:node:ip-10-0-129-23.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-23.ec2.internal' and this object" podUID="af31136c-c74d-433a-9016-2c82c8d687e6" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kgx4h"
Jul 07 00:03:23.207948 ip-10-0-129-23 kubenswrapper[2578]: E0707 00:03:23.207929    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-zmh5q\" is forbidden: User \"system:node:ip-10-0-129-23.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-23.ec2.internal' and this object" podUID="cf713e97-0688-4eda-966f-778e7efcc7f1" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zmh5q"
Jul 07 00:03:23.278266 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:03:23.278243    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xwdct\" (UniqueName: \"kubernetes.io/projected/cf713e97-0688-4eda-966f-778e7efcc7f1-kube-api-access-xwdct\") pod \"cf713e97-0688-4eda-966f-778e7efcc7f1\" (UID: \"cf713e97-0688-4eda-966f-778e7efcc7f1\") "
Jul 07 00:03:23.278386 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:03:23.278303    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/af31136c-c74d-433a-9016-2c82c8d687e6-extensions-socket-volume\") pod \"af31136c-c74d-433a-9016-2c82c8d687e6\" (UID: \"af31136c-c74d-433a-9016-2c82c8d687e6\") "
Jul 07 00:03:23.278448 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:03:23.278416    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2dzct\" (UniqueName: \"kubernetes.io/projected/af31136c-c74d-433a-9016-2c82c8d687e6-kube-api-access-2dzct\") pod \"af31136c-c74d-433a-9016-2c82c8d687e6\" (UID: \"af31136c-c74d-433a-9016-2c82c8d687e6\") "
Jul 07 00:03:23.278550 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:03:23.278530    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n4fzg\" (UniqueName: \"kubernetes.io/projected/30f3c9fc-59c8-438c-8916-65f5643fdc17-kube-api-access-n4fzg\") pod \"limitador-operator-controller-manager-859d7b78bd-8spt2\" (UID: \"30f3c9fc-59c8-438c-8916-65f5643fdc17\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8spt2"
Jul 07 00:03:23.278608 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:03:23.278590    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fsp6b\" (UniqueName: \"kubernetes.io/projected/86887ca3-0bb2-477d-831b-6dcf9094e28f-kube-api-access-fsp6b\") pod \"kuadrant-operator-controller-manager-8684c9ff49-fthnp\" (UID: \"86887ca3-0bb2-477d-831b-6dcf9094e28f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fthnp"
Jul 07 00:03:23.278688 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:03:23.278674    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/86887ca3-0bb2-477d-831b-6dcf9094e28f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-fthnp\" (UID: \"86887ca3-0bb2-477d-831b-6dcf9094e28f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fthnp"
Jul 07 00:03:23.278829 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:03:23.278805    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/af31136c-c74d-433a-9016-2c82c8d687e6-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "af31136c-c74d-433a-9016-2c82c8d687e6" (UID: "af31136c-c74d-433a-9016-2c82c8d687e6"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 00:03:23.279009 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:03:23.278995    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/86887ca3-0bb2-477d-831b-6dcf9094e28f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-fthnp\" (UID: \"86887ca3-0bb2-477d-831b-6dcf9094e28f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fthnp"
Jul 07 00:03:23.280535 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:03:23.280508    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/af31136c-c74d-433a-9016-2c82c8d687e6-kube-api-access-2dzct" (OuterVolumeSpecName: "kube-api-access-2dzct") pod "af31136c-c74d-433a-9016-2c82c8d687e6" (UID: "af31136c-c74d-433a-9016-2c82c8d687e6"). InnerVolumeSpecName "kube-api-access-2dzct". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 00:03:23.280602 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:03:23.280545    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cf713e97-0688-4eda-966f-778e7efcc7f1-kube-api-access-xwdct" (OuterVolumeSpecName: "kube-api-access-xwdct") pod "cf713e97-0688-4eda-966f-778e7efcc7f1" (UID: "cf713e97-0688-4eda-966f-778e7efcc7f1"). InnerVolumeSpecName "kube-api-access-xwdct". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 00:03:23.311113 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:03:23.311088    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fsp6b\" (UniqueName: \"kubernetes.io/projected/86887ca3-0bb2-477d-831b-6dcf9094e28f-kube-api-access-fsp6b\") pod \"kuadrant-operator-controller-manager-8684c9ff49-fthnp\" (UID: \"86887ca3-0bb2-477d-831b-6dcf9094e28f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fthnp"
Jul 07 00:03:23.311330 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:03:23.311309    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n4fzg\" (UniqueName: \"kubernetes.io/projected/30f3c9fc-59c8-438c-8916-65f5643fdc17-kube-api-access-n4fzg\") pod \"limitador-operator-controller-manager-859d7b78bd-8spt2\" (UID: \"30f3c9fc-59c8-438c-8916-65f5643fdc17\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8spt2"
Jul 07 00:03:23.326115 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:03:23.326090    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fthnp"
Jul 07 00:03:23.336135 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:03:23.336118    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8spt2"
Jul 07 00:03:23.379947 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:03:23.379917    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2dzct\" (UniqueName: \"kubernetes.io/projected/af31136c-c74d-433a-9016-2c82c8d687e6-kube-api-access-2dzct\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Jul 07 00:03:23.380077 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:03:23.379949    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xwdct\" (UniqueName: \"kubernetes.io/projected/cf713e97-0688-4eda-966f-778e7efcc7f1-kube-api-access-xwdct\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Jul 07 00:03:23.380077 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:03:23.379968    2578 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/af31136c-c74d-433a-9016-2c82c8d687e6-extensions-socket-volume\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Jul 07 00:03:23.495085 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:03:23.495060    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fthnp"]
Jul 07 00:03:23.497072 ip-10-0-129-23 kubenswrapper[2578]: W0707 00:03:23.497041    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86887ca3_0bb2_477d_831b_6dcf9094e28f.slice/crio-e02c52b7cc9fa12945292b6b253b9f7c50fbdd913cfe8ff11b5e22b9783b0a94 WatchSource:0}: Error finding container e02c52b7cc9fa12945292b6b253b9f7c50fbdd913cfe8ff11b5e22b9783b0a94: Status 404 returned error can't find the container with id e02c52b7cc9fa12945292b6b253b9f7c50fbdd913cfe8ff11b5e22b9783b0a94
Jul 07 00:03:23.509752 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:03:23.509728    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8spt2"]
Jul 07 00:03:23.511835 ip-10-0-129-23 kubenswrapper[2578]: W0707 00:03:23.511813    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30f3c9fc_59c8_438c_8916_65f5643fdc17.slice/crio-01fe643de19bc4c1a8c14fcd3ea13a25e0bd6b1f16684713b1d858556156f1c1 WatchSource:0}: Error finding container 01fe643de19bc4c1a8c14fcd3ea13a25e0bd6b1f16684713b1d858556156f1c1: Status 404 returned error can't find the container with id 01fe643de19bc4c1a8c14fcd3ea13a25e0bd6b1f16684713b1d858556156f1c1
Jul 07 00:03:23.818848 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:03:23.818811    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8spt2" event={"ID":"30f3c9fc-59c8-438c-8916-65f5643fdc17","Type":"ContainerStarted","Data":"c3b850340692cc5cf50475bfe861a0ea1bcfeb5d94c7b605bb306d25f3531fc2"}
Jul 07 00:03:23.819037 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:03:23.818981    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8spt2"
Jul 07 00:03:23.819037 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:03:23.819025    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8spt2" event={"ID":"30f3c9fc-59c8-438c-8916-65f5643fdc17","Type":"ContainerStarted","Data":"01fe643de19bc4c1a8c14fcd3ea13a25e0bd6b1f16684713b1d858556156f1c1"}
Jul 07 00:03:23.820125 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:03:23.820099    2578 generic.go:356] "Generic (PLEG): container finished" podID="cf713e97-0688-4eda-966f-778e7efcc7f1" containerID="e9dd4f70e1a007c9e4e0311f42efbeb31bb65b93d6be1f4e8ce7b75fd93fe281" exitCode=0
Jul 07 00:03:23.820125 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:03:23.820132    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zmh5q"
Jul 07 00:03:23.820322 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:03:23.820179    2578 scope.go:117] "RemoveContainer" containerID="e9dd4f70e1a007c9e4e0311f42efbeb31bb65b93d6be1f4e8ce7b75fd93fe281"
Jul 07 00:03:23.821584 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:03:23.821502    2578 generic.go:356] "Generic (PLEG): container finished" podID="af31136c-c74d-433a-9016-2c82c8d687e6" containerID="d712e3165deff3f3d9d20b887ae363930f9de62e58512edbbaa63ec66cebcccd" exitCode=0
Jul 07 00:03:23.821584 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:03:23.821541    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kgx4h"
Jul 07 00:03:23.821977 ip-10-0-129-23 kubenswrapper[2578]: E0707 00:03:23.821949    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-zmh5q\" is forbidden: User \"system:node:ip-10-0-129-23.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-23.ec2.internal' and this object" podUID="cf713e97-0688-4eda-966f-778e7efcc7f1" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zmh5q"
Jul 07 00:03:23.823323 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:03:23.823274    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fthnp" event={"ID":"86887ca3-0bb2-477d-831b-6dcf9094e28f","Type":"ContainerStarted","Data":"764ac63f4c0b01a84643e8978f6d89848fbe401d17c5d891a070b3f4b310a3fd"}
Jul 07 00:03:23.823464 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:03:23.823342    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fthnp" event={"ID":"86887ca3-0bb2-477d-831b-6dcf9094e28f","Type":"ContainerStarted","Data":"e02c52b7cc9fa12945292b6b253b9f7c50fbdd913cfe8ff11b5e22b9783b0a94"}
Jul 07 00:03:23.823464 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:03:23.823433    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fthnp"
Jul 07 00:03:23.824448 ip-10-0-129-23 kubenswrapper[2578]: E0707 00:03:23.824420    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-kgx4h\" is forbidden: User \"system:node:ip-10-0-129-23.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-23.ec2.internal' and this object" podUID="af31136c-c74d-433a-9016-2c82c8d687e6" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kgx4h"
Jul 07 00:03:23.829594 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:03:23.829510    2578 scope.go:117] "RemoveContainer" containerID="e9dd4f70e1a007c9e4e0311f42efbeb31bb65b93d6be1f4e8ce7b75fd93fe281"
Jul 07 00:03:23.829895 ip-10-0-129-23 kubenswrapper[2578]: E0707 00:03:23.829872    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e9dd4f70e1a007c9e4e0311f42efbeb31bb65b93d6be1f4e8ce7b75fd93fe281\": container with ID starting with e9dd4f70e1a007c9e4e0311f42efbeb31bb65b93d6be1f4e8ce7b75fd93fe281 not found: ID does not exist" containerID="e9dd4f70e1a007c9e4e0311f42efbeb31bb65b93d6be1f4e8ce7b75fd93fe281"
Jul 07 00:03:23.829963 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:03:23.829907    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e9dd4f70e1a007c9e4e0311f42efbeb31bb65b93d6be1f4e8ce7b75fd93fe281"} err="failed to get container status \"e9dd4f70e1a007c9e4e0311f42efbeb31bb65b93d6be1f4e8ce7b75fd93fe281\": rpc error: code = NotFound desc = could not find container \"e9dd4f70e1a007c9e4e0311f42efbeb31bb65b93d6be1f4e8ce7b75fd93fe281\": container with ID starting with e9dd4f70e1a007c9e4e0311f42efbeb31bb65b93d6be1f4e8ce7b75fd93fe281 not found: ID does not exist"
Jul 07 00:03:23.829963 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:03:23.829931    2578 scope.go:117] "RemoveContainer" containerID="d712e3165deff3f3d9d20b887ae363930f9de62e58512edbbaa63ec66cebcccd"
Jul 07 00:03:23.837717 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:03:23.837700    2578 scope.go:117] "RemoveContainer" containerID="d712e3165deff3f3d9d20b887ae363930f9de62e58512edbbaa63ec66cebcccd"
Jul 07 00:03:23.837966 ip-10-0-129-23 kubenswrapper[2578]: E0707 00:03:23.837949    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d712e3165deff3f3d9d20b887ae363930f9de62e58512edbbaa63ec66cebcccd\": container with ID starting with d712e3165deff3f3d9d20b887ae363930f9de62e58512edbbaa63ec66cebcccd not found: ID does not exist" containerID="d712e3165deff3f3d9d20b887ae363930f9de62e58512edbbaa63ec66cebcccd"
Jul 07 00:03:23.838015 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:03:23.837973    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d712e3165deff3f3d9d20b887ae363930f9de62e58512edbbaa63ec66cebcccd"} err="failed to get container status \"d712e3165deff3f3d9d20b887ae363930f9de62e58512edbbaa63ec66cebcccd\": rpc error: code = NotFound desc = could not find container \"d712e3165deff3f3d9d20b887ae363930f9de62e58512edbbaa63ec66cebcccd\": container with ID starting with d712e3165deff3f3d9d20b887ae363930f9de62e58512edbbaa63ec66cebcccd not found: ID does not exist"
Jul 07 00:03:23.935939 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:03:23.935896    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8spt2" podStartSLOduration=1.935882973 podStartE2EDuration="1.935882973s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 00:03:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 00:03:23.933745249 +0000 UTC m=+470.044819052" watchObservedRunningTime="2026-07-07 00:03:23.935882973 +0000 UTC m=+470.046956776"
Jul 07 00:03:23.936346 ip-10-0-129-23 kubenswrapper[2578]: E0707 00:03:23.936327    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-zmh5q\" is forbidden: User \"system:node:ip-10-0-129-23.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-23.ec2.internal' and this object" podUID="cf713e97-0688-4eda-966f-778e7efcc7f1" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zmh5q"
Jul 07 00:03:23.977506 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:03:23.977468    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fthnp" podStartSLOduration=1.977455316 podStartE2EDuration="1.977455316s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 00:03:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 00:03:23.975042788 +0000 UTC m=+470.086116593" watchObservedRunningTime="2026-07-07 00:03:23.977455316 +0000 UTC m=+470.088529120"
Jul 07 00:03:23.979096 ip-10-0-129-23 kubenswrapper[2578]: E0707 00:03:23.979075    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-kgx4h\" is forbidden: User \"system:node:ip-10-0-129-23.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-23.ec2.internal' and this object" podUID="af31136c-c74d-433a-9016-2c82c8d687e6" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kgx4h"
Jul 07 00:03:24.390109 ip-10-0-129-23 kubenswrapper[2578]: E0707 00:03:24.390070    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-zmh5q\" is forbidden: User \"system:node:ip-10-0-129-23.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-23.ec2.internal' and this object" podUID="cf713e97-0688-4eda-966f-778e7efcc7f1" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zmh5q"
Jul 07 00:03:24.392759 ip-10-0-129-23 kubenswrapper[2578]: E0707 00:03:24.392722    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-kgx4h\" is forbidden: User \"system:node:ip-10-0-129-23.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-23.ec2.internal' and this object" podUID="af31136c-c74d-433a-9016-2c82c8d687e6" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kgx4h"
Jul 07 00:03:24.392901 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:03:24.392808    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="af31136c-c74d-433a-9016-2c82c8d687e6" path="/var/lib/kubelet/pods/af31136c-c74d-433a-9016-2c82c8d687e6/volumes"
Jul 07 00:03:24.393104 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:03:24.393088    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cf713e97-0688-4eda-966f-778e7efcc7f1" path="/var/lib/kubelet/pods/cf713e97-0688-4eda-966f-778e7efcc7f1/volumes"
Jul 07 00:03:24.640871 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:03:24.640791    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-h77nl"]
Jul 07 00:03:24.648482 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:03:24.648458    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-h77nl"
Jul 07 00:03:24.662184 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:03:24.662162    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-h77nl"]
Jul 07 00:03:24.791423 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:03:24.791401    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qtgnz\" (UniqueName: \"kubernetes.io/projected/eb6aadbf-62c3-483a-8ffc-2c5495f1b4e2-kube-api-access-qtgnz\") pod \"kuadrant-operator-controller-manager-86878c769f-h77nl\" (UID: \"eb6aadbf-62c3-483a-8ffc-2c5495f1b4e2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-h77nl"
Jul 07 00:03:24.791554 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:03:24.791471    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/eb6aadbf-62c3-483a-8ffc-2c5495f1b4e2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-h77nl\" (UID: \"eb6aadbf-62c3-483a-8ffc-2c5495f1b4e2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-h77nl"
Jul 07 00:03:24.892576 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:03:24.892518    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/eb6aadbf-62c3-483a-8ffc-2c5495f1b4e2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-h77nl\" (UID: \"eb6aadbf-62c3-483a-8ffc-2c5495f1b4e2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-h77nl"
Jul 07 00:03:24.892576 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:03:24.892553    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qtgnz\" (UniqueName: \"kubernetes.io/projected/eb6aadbf-62c3-483a-8ffc-2c5495f1b4e2-kube-api-access-qtgnz\") pod \"kuadrant-operator-controller-manager-86878c769f-h77nl\" (UID: \"eb6aadbf-62c3-483a-8ffc-2c5495f1b4e2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-h77nl"
Jul 07 00:03:24.892837 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:03:24.892820    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/eb6aadbf-62c3-483a-8ffc-2c5495f1b4e2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-h77nl\" (UID: \"eb6aadbf-62c3-483a-8ffc-2c5495f1b4e2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-h77nl"
Jul 07 00:03:24.906831 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:03:24.906805    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qtgnz\" (UniqueName: \"kubernetes.io/projected/eb6aadbf-62c3-483a-8ffc-2c5495f1b4e2-kube-api-access-qtgnz\") pod \"kuadrant-operator-controller-manager-86878c769f-h77nl\" (UID: \"eb6aadbf-62c3-483a-8ffc-2c5495f1b4e2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-h77nl"
Jul 07 00:03:24.958781 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:03:24.958757    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-h77nl"
Jul 07 00:03:25.101546 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:03:25.101517    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-h77nl"]
Jul 07 00:03:25.104176 ip-10-0-129-23 kubenswrapper[2578]: W0707 00:03:25.104147    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb6aadbf_62c3_483a_8ffc_2c5495f1b4e2.slice/crio-382cbe63917a196b9e84fe821c0a18ac762a6abd56ee0d03b2493d0b0b34e198 WatchSource:0}: Error finding container 382cbe63917a196b9e84fe821c0a18ac762a6abd56ee0d03b2493d0b0b34e198: Status 404 returned error can't find the container with id 382cbe63917a196b9e84fe821c0a18ac762a6abd56ee0d03b2493d0b0b34e198
Jul 07 00:03:25.835599 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:03:25.835566    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-h77nl" event={"ID":"eb6aadbf-62c3-483a-8ffc-2c5495f1b4e2","Type":"ContainerStarted","Data":"d4246d67545371597c001ba99f26b4287e1401cccab22d4f2805f0e22a68c74b"}
Jul 07 00:03:25.835770 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:03:25.835614    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-h77nl" event={"ID":"eb6aadbf-62c3-483a-8ffc-2c5495f1b4e2","Type":"ContainerStarted","Data":"382cbe63917a196b9e84fe821c0a18ac762a6abd56ee0d03b2493d0b0b34e198"}
Jul 07 00:03:25.835770 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:03:25.835709    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-h77nl"
Jul 07 00:03:25.879729 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:03:25.879683    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-h77nl" podStartSLOduration=1.879669778 podStartE2EDuration="1.879669778s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 00:03:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 00:03:25.876925896 +0000 UTC m=+471.987999700" watchObservedRunningTime="2026-07-07 00:03:25.879669778 +0000 UTC m=+471.990743582"
Jul 07 00:03:34.831656 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:03:34.831628    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fthnp"
Jul 07 00:03:34.832062 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:03:34.831695    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8spt2"
Jul 07 00:03:36.842676 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:03:36.842647    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-h77nl"
Jul 07 00:03:36.927591 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:03:36.927552    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fthnp"]
Jul 07 00:03:36.927779 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:03:36.927741    2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fthnp" podUID="86887ca3-0bb2-477d-831b-6dcf9094e28f" containerName="manager" containerID="cri-o://764ac63f4c0b01a84643e8978f6d89848fbe401d17c5d891a070b3f4b310a3fd" gracePeriod=10
Jul 07 00:03:37.179807 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:03:37.179778    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fthnp"
Jul 07 00:03:37.290478 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:03:37.290449    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fsp6b\" (UniqueName: \"kubernetes.io/projected/86887ca3-0bb2-477d-831b-6dcf9094e28f-kube-api-access-fsp6b\") pod \"86887ca3-0bb2-477d-831b-6dcf9094e28f\" (UID: \"86887ca3-0bb2-477d-831b-6dcf9094e28f\") "
Jul 07 00:03:37.290662 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:03:37.290514    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/86887ca3-0bb2-477d-831b-6dcf9094e28f-extensions-socket-volume\") pod \"86887ca3-0bb2-477d-831b-6dcf9094e28f\" (UID: \"86887ca3-0bb2-477d-831b-6dcf9094e28f\") "
Jul 07 00:03:37.290875 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:03:37.290847    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/86887ca3-0bb2-477d-831b-6dcf9094e28f-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "86887ca3-0bb2-477d-831b-6dcf9094e28f" (UID: "86887ca3-0bb2-477d-831b-6dcf9094e28f"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 00:03:37.292615 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:03:37.292591    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/86887ca3-0bb2-477d-831b-6dcf9094e28f-kube-api-access-fsp6b" (OuterVolumeSpecName: "kube-api-access-fsp6b") pod "86887ca3-0bb2-477d-831b-6dcf9094e28f" (UID: "86887ca3-0bb2-477d-831b-6dcf9094e28f"). InnerVolumeSpecName "kube-api-access-fsp6b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 00:03:37.391586 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:03:37.391555    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fsp6b\" (UniqueName: \"kubernetes.io/projected/86887ca3-0bb2-477d-831b-6dcf9094e28f-kube-api-access-fsp6b\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Jul 07 00:03:37.391586 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:03:37.391582    2578 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/86887ca3-0bb2-477d-831b-6dcf9094e28f-extensions-socket-volume\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Jul 07 00:03:37.896009 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:03:37.895973    2578 generic.go:356] "Generic (PLEG): container finished" podID="86887ca3-0bb2-477d-831b-6dcf9094e28f" containerID="764ac63f4c0b01a84643e8978f6d89848fbe401d17c5d891a070b3f4b310a3fd" exitCode=0
Jul 07 00:03:37.896411 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:03:37.896021    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fthnp"
Jul 07 00:03:37.896411 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:03:37.896065    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fthnp" event={"ID":"86887ca3-0bb2-477d-831b-6dcf9094e28f","Type":"ContainerDied","Data":"764ac63f4c0b01a84643e8978f6d89848fbe401d17c5d891a070b3f4b310a3fd"}
Jul 07 00:03:37.896411 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:03:37.896117    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fthnp" event={"ID":"86887ca3-0bb2-477d-831b-6dcf9094e28f","Type":"ContainerDied","Data":"e02c52b7cc9fa12945292b6b253b9f7c50fbdd913cfe8ff11b5e22b9783b0a94"}
Jul 07 00:03:37.896411 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:03:37.896138    2578 scope.go:117] "RemoveContainer" containerID="764ac63f4c0b01a84643e8978f6d89848fbe401d17c5d891a070b3f4b310a3fd"
Jul 07 00:03:37.906638 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:03:37.906616    2578 scope.go:117] "RemoveContainer" containerID="764ac63f4c0b01a84643e8978f6d89848fbe401d17c5d891a070b3f4b310a3fd"
Jul 07 00:03:37.906923 ip-10-0-129-23 kubenswrapper[2578]: E0707 00:03:37.906897    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"764ac63f4c0b01a84643e8978f6d89848fbe401d17c5d891a070b3f4b310a3fd\": container with ID starting with 764ac63f4c0b01a84643e8978f6d89848fbe401d17c5d891a070b3f4b310a3fd not found: ID does not exist" containerID="764ac63f4c0b01a84643e8978f6d89848fbe401d17c5d891a070b3f4b310a3fd"
Jul 07 00:03:37.907040 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:03:37.906930    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"764ac63f4c0b01a84643e8978f6d89848fbe401d17c5d891a070b3f4b310a3fd"} err="failed to get container status \"764ac63f4c0b01a84643e8978f6d89848fbe401d17c5d891a070b3f4b310a3fd\": rpc error: code = NotFound desc = could not find container \"764ac63f4c0b01a84643e8978f6d89848fbe401d17c5d891a070b3f4b310a3fd\": container with ID starting with 764ac63f4c0b01a84643e8978f6d89848fbe401d17c5d891a070b3f4b310a3fd not found: ID does not exist"
Jul 07 00:03:37.934464 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:03:37.934437    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fthnp"]
Jul 07 00:03:37.940989 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:03:37.940967    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fthnp"]
Jul 07 00:03:38.390908 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:03:38.390874    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="86887ca3-0bb2-477d-831b-6dcf9094e28f" path="/var/lib/kubelet/pods/86887ca3-0bb2-477d-831b-6dcf9094e28f/volumes"
Jul 07 00:03:55.650320 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:03:55.650276    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-l42gw"]
Jul 07 00:03:55.650782 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:03:55.650627    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="86887ca3-0bb2-477d-831b-6dcf9094e28f" containerName="manager"
Jul 07 00:03:55.650782 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:03:55.650637    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="86887ca3-0bb2-477d-831b-6dcf9094e28f" containerName="manager"
Jul 07 00:03:55.650782 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:03:55.650715    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="86887ca3-0bb2-477d-831b-6dcf9094e28f" containerName="manager"
Jul 07 00:03:55.654226 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:03:55.654211    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-l42gw"
Jul 07 00:03:55.656853 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:03:55.656834    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-htsf7\""
Jul 07 00:03:55.656951 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:03:55.656837    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 07 00:03:55.664649 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:03:55.664597    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-l42gw"]
Jul 07 00:03:55.734209 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:03:55.734178    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/2d7515a7-e547-4f2a-aa9a-ef726ab3157d-config-file\") pod \"limitador-limitador-64c94fd64f-l42gw\" (UID: \"2d7515a7-e547-4f2a-aa9a-ef726ab3157d\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-l42gw"
Jul 07 00:03:55.734377 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:03:55.734243    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4lncr\" (UniqueName: \"kubernetes.io/projected/2d7515a7-e547-4f2a-aa9a-ef726ab3157d-kube-api-access-4lncr\") pod \"limitador-limitador-64c94fd64f-l42gw\" (UID: \"2d7515a7-e547-4f2a-aa9a-ef726ab3157d\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-l42gw"
Jul 07 00:03:55.747232 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:03:55.747205    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-l42gw"]
Jul 07 00:03:55.835535 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:03:55.835502    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/2d7515a7-e547-4f2a-aa9a-ef726ab3157d-config-file\") pod \"limitador-limitador-64c94fd64f-l42gw\" (UID: \"2d7515a7-e547-4f2a-aa9a-ef726ab3157d\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-l42gw"
Jul 07 00:03:55.835676 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:03:55.835556    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4lncr\" (UniqueName: \"kubernetes.io/projected/2d7515a7-e547-4f2a-aa9a-ef726ab3157d-kube-api-access-4lncr\") pod \"limitador-limitador-64c94fd64f-l42gw\" (UID: \"2d7515a7-e547-4f2a-aa9a-ef726ab3157d\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-l42gw"
Jul 07 00:03:55.836130 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:03:55.836113    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/2d7515a7-e547-4f2a-aa9a-ef726ab3157d-config-file\") pod \"limitador-limitador-64c94fd64f-l42gw\" (UID: \"2d7515a7-e547-4f2a-aa9a-ef726ab3157d\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-l42gw"
Jul 07 00:03:55.845153 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:03:55.845133    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4lncr\" (UniqueName: \"kubernetes.io/projected/2d7515a7-e547-4f2a-aa9a-ef726ab3157d-kube-api-access-4lncr\") pod \"limitador-limitador-64c94fd64f-l42gw\" (UID: \"2d7515a7-e547-4f2a-aa9a-ef726ab3157d\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-l42gw"
Jul 07 00:03:55.965037 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:03:55.964956    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-l42gw"
Jul 07 00:03:56.106923 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:03:56.106898    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-l42gw"]
Jul 07 00:03:56.109403 ip-10-0-129-23 kubenswrapper[2578]: W0707 00:03:56.109381    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d7515a7_e547_4f2a_aa9a_ef726ab3157d.slice/crio-aec047416954cd6a42fcd52c4dfaa8b364370481b57bc5ea5dbe0f83c9771e10 WatchSource:0}: Error finding container aec047416954cd6a42fcd52c4dfaa8b364370481b57bc5ea5dbe0f83c9771e10: Status 404 returned error can't find the container with id aec047416954cd6a42fcd52c4dfaa8b364370481b57bc5ea5dbe0f83c9771e10
Jul 07 00:03:56.784057 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:03:56.782259    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-97gtg"]
Jul 07 00:03:56.786201 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:03:56.786179    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-97gtg"
Jul 07 00:03:56.790551 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:03:56.790508    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-97gtg"]
Jul 07 00:03:56.791592 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:03:56.791432    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-zcg8l\""
Jul 07 00:03:56.843833 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:03:56.843712    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-49zml\" (UniqueName: \"kubernetes.io/projected/f02bdc6e-f0fd-4842-8d35-212e98bee739-kube-api-access-49zml\") pod \"authorino-75d556bd77-97gtg\" (UID: \"f02bdc6e-f0fd-4842-8d35-212e98bee739\") " pod="kuadrant-system/authorino-75d556bd77-97gtg"
Jul 07 00:03:56.944353 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:03:56.944320    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-49zml\" (UniqueName: \"kubernetes.io/projected/f02bdc6e-f0fd-4842-8d35-212e98bee739-kube-api-access-49zml\") pod \"authorino-75d556bd77-97gtg\" (UID: \"f02bdc6e-f0fd-4842-8d35-212e98bee739\") " pod="kuadrant-system/authorino-75d556bd77-97gtg"
Jul 07 00:03:56.953657 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:03:56.953632    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-49zml\" (UniqueName: \"kubernetes.io/projected/f02bdc6e-f0fd-4842-8d35-212e98bee739-kube-api-access-49zml\") pod \"authorino-75d556bd77-97gtg\" (UID: \"f02bdc6e-f0fd-4842-8d35-212e98bee739\") " pod="kuadrant-system/authorino-75d556bd77-97gtg"
Jul 07 00:03:56.998246 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:03:56.998211    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-l42gw" event={"ID":"2d7515a7-e547-4f2a-aa9a-ef726ab3157d","Type":"ContainerStarted","Data":"aec047416954cd6a42fcd52c4dfaa8b364370481b57bc5ea5dbe0f83c9771e10"}
Jul 07 00:03:57.100817 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:03:57.100722    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-97gtg"
Jul 07 00:03:57.264200 ip-10-0-129-23 kubenswrapper[2578]: W0707 00:03:57.264163    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf02bdc6e_f0fd_4842_8d35_212e98bee739.slice/crio-0a9c013e4cc264242ecf8f39a37c78d84c413f9676f569cbbfa871cda859b013 WatchSource:0}: Error finding container 0a9c013e4cc264242ecf8f39a37c78d84c413f9676f569cbbfa871cda859b013: Status 404 returned error can't find the container with id 0a9c013e4cc264242ecf8f39a37c78d84c413f9676f569cbbfa871cda859b013
Jul 07 00:03:57.264356 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:03:57.264206    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-97gtg"]
Jul 07 00:03:58.004557 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:03:58.004527    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-97gtg" event={"ID":"f02bdc6e-f0fd-4842-8d35-212e98bee739","Type":"ContainerStarted","Data":"0a9c013e4cc264242ecf8f39a37c78d84c413f9676f569cbbfa871cda859b013"}
Jul 07 00:03:59.013081 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:03:59.013044    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-l42gw" event={"ID":"2d7515a7-e547-4f2a-aa9a-ef726ab3157d","Type":"ContainerStarted","Data":"57634d2bf56d74544dd799fcefacf35623dcfac9695dedbcd993d0cea416a8f2"}
Jul 07 00:03:59.013517 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:03:59.013314    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-l42gw"
Jul 07 00:03:59.032675 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:03:59.032340    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-l42gw" podStartSLOduration=1.287884881 podStartE2EDuration="4.032324571s" totalImagesPullingTime="2.74443969s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 00:03:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 00:03:59.02986401 +0000 UTC m=+505.140937815" watchObservedRunningTime="2026-07-07 00:03:59.032324571 +0000 UTC m=+505.143398375"
Jul 07 00:04:02.028942 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:04:02.028910    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-97gtg" event={"ID":"f02bdc6e-f0fd-4842-8d35-212e98bee739","Type":"ContainerStarted","Data":"bddcecc4ba80fa2b61e077cffaa6f91067997206a0e0fa07609132cb13827657"}
Jul 07 00:04:02.050035 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:04:02.049988    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-97gtg" podStartSLOduration=2.008475249 podStartE2EDuration="6.049975141s" totalImagesPullingTime="4.041499892s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 00:03:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 00:04:02.04873004 +0000 UTC m=+508.159803844" watchObservedRunningTime="2026-07-07 00:04:02.049975141 +0000 UTC m=+508.161048945"
Jul 07 00:04:10.019685 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:04:10.019650    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-l42gw"
Jul 07 00:04:11.980386 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:04:11.980347    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-l42gw"]
Jul 07 00:04:11.980945 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:04:11.980556    2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-l42gw" podUID="2d7515a7-e547-4f2a-aa9a-ef726ab3157d" containerName="limitador" containerID="cri-o://57634d2bf56d74544dd799fcefacf35623dcfac9695dedbcd993d0cea416a8f2" gracePeriod=30
Jul 07 00:04:12.927021 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:04:12.926994    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-l42gw"
Jul 07 00:04:12.968626 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:04:12.968604    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/2d7515a7-e547-4f2a-aa9a-ef726ab3157d-config-file\") pod \"2d7515a7-e547-4f2a-aa9a-ef726ab3157d\" (UID: \"2d7515a7-e547-4f2a-aa9a-ef726ab3157d\") "
Jul 07 00:04:12.968744 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:04:12.968671    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4lncr\" (UniqueName: \"kubernetes.io/projected/2d7515a7-e547-4f2a-aa9a-ef726ab3157d-kube-api-access-4lncr\") pod \"2d7515a7-e547-4f2a-aa9a-ef726ab3157d\" (UID: \"2d7515a7-e547-4f2a-aa9a-ef726ab3157d\") "
Jul 07 00:04:12.968929 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:04:12.968907    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2d7515a7-e547-4f2a-aa9a-ef726ab3157d-config-file" (OuterVolumeSpecName: "config-file") pod "2d7515a7-e547-4f2a-aa9a-ef726ab3157d" (UID: "2d7515a7-e547-4f2a-aa9a-ef726ab3157d"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 00:04:12.970709 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:04:12.970687    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2d7515a7-e547-4f2a-aa9a-ef726ab3157d-kube-api-access-4lncr" (OuterVolumeSpecName: "kube-api-access-4lncr") pod "2d7515a7-e547-4f2a-aa9a-ef726ab3157d" (UID: "2d7515a7-e547-4f2a-aa9a-ef726ab3157d"). InnerVolumeSpecName "kube-api-access-4lncr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 00:04:13.070114 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:04:13.070063    2578 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/2d7515a7-e547-4f2a-aa9a-ef726ab3157d-config-file\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Jul 07 00:04:13.070114 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:04:13.070082    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4lncr\" (UniqueName: \"kubernetes.io/projected/2d7515a7-e547-4f2a-aa9a-ef726ab3157d-kube-api-access-4lncr\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Jul 07 00:04:13.081731 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:04:13.081703    2578 generic.go:356] "Generic (PLEG): container finished" podID="2d7515a7-e547-4f2a-aa9a-ef726ab3157d" containerID="57634d2bf56d74544dd799fcefacf35623dcfac9695dedbcd993d0cea416a8f2" exitCode=0
Jul 07 00:04:13.081836 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:04:13.081739    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-l42gw"
Jul 07 00:04:13.081836 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:04:13.081781    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-l42gw" event={"ID":"2d7515a7-e547-4f2a-aa9a-ef726ab3157d","Type":"ContainerDied","Data":"57634d2bf56d74544dd799fcefacf35623dcfac9695dedbcd993d0cea416a8f2"}
Jul 07 00:04:13.081836 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:04:13.081830    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-l42gw" event={"ID":"2d7515a7-e547-4f2a-aa9a-ef726ab3157d","Type":"ContainerDied","Data":"aec047416954cd6a42fcd52c4dfaa8b364370481b57bc5ea5dbe0f83c9771e10"}
Jul 07 00:04:13.081964 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:04:13.081861    2578 scope.go:117] "RemoveContainer" containerID="57634d2bf56d74544dd799fcefacf35623dcfac9695dedbcd993d0cea416a8f2"
Jul 07 00:04:13.090593 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:04:13.090579    2578 scope.go:117] "RemoveContainer" containerID="57634d2bf56d74544dd799fcefacf35623dcfac9695dedbcd993d0cea416a8f2"
Jul 07 00:04:13.090848 ip-10-0-129-23 kubenswrapper[2578]: E0707 00:04:13.090827    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"57634d2bf56d74544dd799fcefacf35623dcfac9695dedbcd993d0cea416a8f2\": container with ID starting with 57634d2bf56d74544dd799fcefacf35623dcfac9695dedbcd993d0cea416a8f2 not found: ID does not exist" containerID="57634d2bf56d74544dd799fcefacf35623dcfac9695dedbcd993d0cea416a8f2"
Jul 07 00:04:13.090909 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:04:13.090854    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"57634d2bf56d74544dd799fcefacf35623dcfac9695dedbcd993d0cea416a8f2"} err="failed to get container status \"57634d2bf56d74544dd799fcefacf35623dcfac9695dedbcd993d0cea416a8f2\": rpc error: code = NotFound desc = could not find container \"57634d2bf56d74544dd799fcefacf35623dcfac9695dedbcd993d0cea416a8f2\": container with ID starting with 57634d2bf56d74544dd799fcefacf35623dcfac9695dedbcd993d0cea416a8f2 not found: ID does not exist"
Jul 07 00:04:13.109336 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:04:13.109312    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-l42gw"]
Jul 07 00:04:13.115006 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:04:13.114990    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-l42gw"]
Jul 07 00:04:14.390225 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:04:14.390196    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2d7515a7-e547-4f2a-aa9a-ef726ab3157d" path="/var/lib/kubelet/pods/2d7515a7-e547-4f2a-aa9a-ef726ab3157d/volumes"
Jul 07 00:04:17.327576 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:04:17.327547    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/postgres-69fb4594cf-s89xw"]
Jul 07 00:04:17.327918 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:04:17.327905    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2d7515a7-e547-4f2a-aa9a-ef726ab3157d" containerName="limitador"
Jul 07 00:04:17.327918 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:04:17.327915    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="2d7515a7-e547-4f2a-aa9a-ef726ab3157d" containerName="limitador"
Jul 07 00:04:17.327988 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:04:17.327980    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="2d7515a7-e547-4f2a-aa9a-ef726ab3157d" containerName="limitador"
Jul 07 00:04:17.332432 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:04:17.332414    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-s89xw"
Jul 07 00:04:17.335123 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:04:17.335101    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-smtg5\""
Jul 07 00:04:17.339936 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:04:17.339916    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\""
Jul 07 00:04:17.342599 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:04:17.342579    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-s89xw"]
Jul 07 00:04:17.406022 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:04:17.405997    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t6nt5\" (UniqueName: \"kubernetes.io/projected/6fea54f1-781a-4801-85e8-12bef29fb813-kube-api-access-t6nt5\") pod \"postgres-69fb4594cf-s89xw\" (UID: \"6fea54f1-781a-4801-85e8-12bef29fb813\") " pod="opendatahub/postgres-69fb4594cf-s89xw"
Jul 07 00:04:17.406111 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:04:17.406035    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/6fea54f1-781a-4801-85e8-12bef29fb813-data\") pod \"postgres-69fb4594cf-s89xw\" (UID: \"6fea54f1-781a-4801-85e8-12bef29fb813\") " pod="opendatahub/postgres-69fb4594cf-s89xw"
Jul 07 00:04:17.506360 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:04:17.506336    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t6nt5\" (UniqueName: \"kubernetes.io/projected/6fea54f1-781a-4801-85e8-12bef29fb813-kube-api-access-t6nt5\") pod \"postgres-69fb4594cf-s89xw\" (UID: \"6fea54f1-781a-4801-85e8-12bef29fb813\") " pod="opendatahub/postgres-69fb4594cf-s89xw"
Jul 07 00:04:17.506459 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:04:17.506393    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/6fea54f1-781a-4801-85e8-12bef29fb813-data\") pod \"postgres-69fb4594cf-s89xw\" (UID: \"6fea54f1-781a-4801-85e8-12bef29fb813\") " pod="opendatahub/postgres-69fb4594cf-s89xw"
Jul 07 00:04:17.506743 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:04:17.506725    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/6fea54f1-781a-4801-85e8-12bef29fb813-data\") pod \"postgres-69fb4594cf-s89xw\" (UID: \"6fea54f1-781a-4801-85e8-12bef29fb813\") " pod="opendatahub/postgres-69fb4594cf-s89xw"
Jul 07 00:04:17.515538 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:04:17.515517    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t6nt5\" (UniqueName: \"kubernetes.io/projected/6fea54f1-781a-4801-85e8-12bef29fb813-kube-api-access-t6nt5\") pod \"postgres-69fb4594cf-s89xw\" (UID: \"6fea54f1-781a-4801-85e8-12bef29fb813\") " pod="opendatahub/postgres-69fb4594cf-s89xw"
Jul 07 00:04:17.642940 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:04:17.642881    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-s89xw"
Jul 07 00:04:17.794154 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:04:17.794130    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-s89xw"]
Jul 07 00:04:17.795359 ip-10-0-129-23 kubenswrapper[2578]: W0707 00:04:17.795335    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6fea54f1_781a_4801_85e8_12bef29fb813.slice/crio-c57e3082899837bd8011e4f466756eb4903158bce04ae671091e0005fa39cd8b WatchSource:0}: Error finding container c57e3082899837bd8011e4f466756eb4903158bce04ae671091e0005fa39cd8b: Status 404 returned error can't find the container with id c57e3082899837bd8011e4f466756eb4903158bce04ae671091e0005fa39cd8b
Jul 07 00:04:18.109148 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:04:18.109115    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-s89xw" event={"ID":"6fea54f1-781a-4801-85e8-12bef29fb813","Type":"ContainerStarted","Data":"c57e3082899837bd8011e4f466756eb4903158bce04ae671091e0005fa39cd8b"}
Jul 07 00:04:23.140830 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:04:23.140797    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-s89xw" event={"ID":"6fea54f1-781a-4801-85e8-12bef29fb813","Type":"ContainerStarted","Data":"d2d9031a5a4c7611f7325cbd106002c2bb9bac752dcdc244b9b631062e798618"}
Jul 07 00:04:23.141266 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:04:23.140881    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/postgres-69fb4594cf-s89xw"
Jul 07 00:04:23.158010 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:04:23.157970    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/postgres-69fb4594cf-s89xw" podStartSLOduration=1.5159389989999998 podStartE2EDuration="6.157958333s" totalImagesPullingTime="4.642019334s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 00:04:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 00:04:23.156048742 +0000 UTC m=+529.267122545" watchObservedRunningTime="2026-07-07 00:04:23.157958333 +0000 UTC m=+529.269032155"
Jul 07 00:04:29.176168 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:04:29.176081    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/postgres-69fb4594cf-s89xw"
Jul 07 00:04:30.268392 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:04:30.268363    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5c88c8cf66-c9rdp"]
Jul 07 00:04:30.289786 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:04:30.289760    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5c88c8cf66-c9rdp"
Jul 07 00:04:30.289931 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:04:30.289763    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5c88c8cf66-c9rdp"]
Jul 07 00:04:30.292359 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:04:30.292338    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 07 00:04:30.410345 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:04:30.410314    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hmj28\" (UniqueName: \"kubernetes.io/projected/e5be7905-f3ef-47af-8086-d16e91bef0a9-kube-api-access-hmj28\") pod \"authorino-5c88c8cf66-c9rdp\" (UID: \"e5be7905-f3ef-47af-8086-d16e91bef0a9\") " pod="kuadrant-system/authorino-5c88c8cf66-c9rdp"
Jul 07 00:04:30.410468 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:04:30.410361    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e5be7905-f3ef-47af-8086-d16e91bef0a9-tls-cert\") pod \"authorino-5c88c8cf66-c9rdp\" (UID: \"e5be7905-f3ef-47af-8086-d16e91bef0a9\") " pod="kuadrant-system/authorino-5c88c8cf66-c9rdp"
Jul 07 00:04:30.511123 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:04:30.511096    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hmj28\" (UniqueName: \"kubernetes.io/projected/e5be7905-f3ef-47af-8086-d16e91bef0a9-kube-api-access-hmj28\") pod \"authorino-5c88c8cf66-c9rdp\" (UID: \"e5be7905-f3ef-47af-8086-d16e91bef0a9\") " pod="kuadrant-system/authorino-5c88c8cf66-c9rdp"
Jul 07 00:04:30.511254 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:04:30.511139    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e5be7905-f3ef-47af-8086-d16e91bef0a9-tls-cert\") pod \"authorino-5c88c8cf66-c9rdp\" (UID: \"e5be7905-f3ef-47af-8086-d16e91bef0a9\") " pod="kuadrant-system/authorino-5c88c8cf66-c9rdp"
Jul 07 00:04:30.513609 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:04:30.513590    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e5be7905-f3ef-47af-8086-d16e91bef0a9-tls-cert\") pod \"authorino-5c88c8cf66-c9rdp\" (UID: \"e5be7905-f3ef-47af-8086-d16e91bef0a9\") " pod="kuadrant-system/authorino-5c88c8cf66-c9rdp"
Jul 07 00:04:30.518911 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:04:30.518860    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hmj28\" (UniqueName: \"kubernetes.io/projected/e5be7905-f3ef-47af-8086-d16e91bef0a9-kube-api-access-hmj28\") pod \"authorino-5c88c8cf66-c9rdp\" (UID: \"e5be7905-f3ef-47af-8086-d16e91bef0a9\") " pod="kuadrant-system/authorino-5c88c8cf66-c9rdp"
Jul 07 00:04:30.601344 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:04:30.601316    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5c88c8cf66-c9rdp"
Jul 07 00:04:30.758278 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:04:30.758253    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5c88c8cf66-c9rdp"]
Jul 07 00:04:30.760610 ip-10-0-129-23 kubenswrapper[2578]: W0707 00:04:30.760586    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode5be7905_f3ef_47af_8086_d16e91bef0a9.slice/crio-64e29ee0c8abb80ef944f0d0472558b63ef652393f7e506da449d6d363a0d30a WatchSource:0}: Error finding container 64e29ee0c8abb80ef944f0d0472558b63ef652393f7e506da449d6d363a0d30a: Status 404 returned error can't find the container with id 64e29ee0c8abb80ef944f0d0472558b63ef652393f7e506da449d6d363a0d30a
Jul 07 00:04:31.181430 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:04:31.181399    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5c88c8cf66-c9rdp" event={"ID":"e5be7905-f3ef-47af-8086-d16e91bef0a9","Type":"ContainerStarted","Data":"64e29ee0c8abb80ef944f0d0472558b63ef652393f7e506da449d6d363a0d30a"}
Jul 07 00:04:32.188579 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:04:32.188543    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5c88c8cf66-c9rdp" event={"ID":"e5be7905-f3ef-47af-8086-d16e91bef0a9","Type":"ContainerStarted","Data":"a07d960f2974cc0ca342bc1c98fcb1b854c6a3acd4674460bffe7f53616defd4"}
Jul 07 00:04:32.210914 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:04:32.210868    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5c88c8cf66-c9rdp" podStartSLOduration=1.6634715180000001 podStartE2EDuration="2.210851604s" totalImagesPullingTime="547.380086ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 00:04:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 00:04:32.208360822 +0000 UTC m=+538.319434625" watchObservedRunningTime="2026-07-07 00:04:32.210851604 +0000 UTC m=+538.321925407"
Jul 07 00:04:32.246240 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:04:32.246208    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-97gtg"]
Jul 07 00:04:32.246489 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:04:32.246463    2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-97gtg" podUID="f02bdc6e-f0fd-4842-8d35-212e98bee739" containerName="authorino" containerID="cri-o://bddcecc4ba80fa2b61e077cffaa6f91067997206a0e0fa07609132cb13827657" gracePeriod=30
Jul 07 00:04:32.522571 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:04:32.522535    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-97gtg"
Jul 07 00:04:32.628111 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:04:32.628080    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-49zml\" (UniqueName: \"kubernetes.io/projected/f02bdc6e-f0fd-4842-8d35-212e98bee739-kube-api-access-49zml\") pod \"f02bdc6e-f0fd-4842-8d35-212e98bee739\" (UID: \"f02bdc6e-f0fd-4842-8d35-212e98bee739\") "
Jul 07 00:04:32.630239 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:04:32.630218    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f02bdc6e-f0fd-4842-8d35-212e98bee739-kube-api-access-49zml" (OuterVolumeSpecName: "kube-api-access-49zml") pod "f02bdc6e-f0fd-4842-8d35-212e98bee739" (UID: "f02bdc6e-f0fd-4842-8d35-212e98bee739"). InnerVolumeSpecName "kube-api-access-49zml". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 00:04:32.728894 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:04:32.728865    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-49zml\" (UniqueName: \"kubernetes.io/projected/f02bdc6e-f0fd-4842-8d35-212e98bee739-kube-api-access-49zml\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Jul 07 00:04:33.199702 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:04:33.199672    2578 generic.go:356] "Generic (PLEG): container finished" podID="f02bdc6e-f0fd-4842-8d35-212e98bee739" containerID="bddcecc4ba80fa2b61e077cffaa6f91067997206a0e0fa07609132cb13827657" exitCode=0
Jul 07 00:04:33.200132 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:04:33.199726    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-97gtg"
Jul 07 00:04:33.200132 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:04:33.199758    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-97gtg" event={"ID":"f02bdc6e-f0fd-4842-8d35-212e98bee739","Type":"ContainerDied","Data":"bddcecc4ba80fa2b61e077cffaa6f91067997206a0e0fa07609132cb13827657"}
Jul 07 00:04:33.200132 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:04:33.199802    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-97gtg" event={"ID":"f02bdc6e-f0fd-4842-8d35-212e98bee739","Type":"ContainerDied","Data":"0a9c013e4cc264242ecf8f39a37c78d84c413f9676f569cbbfa871cda859b013"}
Jul 07 00:04:33.200132 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:04:33.199823    2578 scope.go:117] "RemoveContainer" containerID="bddcecc4ba80fa2b61e077cffaa6f91067997206a0e0fa07609132cb13827657"
Jul 07 00:04:33.208415 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:04:33.208390    2578 scope.go:117] "RemoveContainer" containerID="bddcecc4ba80fa2b61e077cffaa6f91067997206a0e0fa07609132cb13827657"
Jul 07 00:04:33.208674 ip-10-0-129-23 kubenswrapper[2578]: E0707 00:04:33.208648    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bddcecc4ba80fa2b61e077cffaa6f91067997206a0e0fa07609132cb13827657\": container with ID starting with bddcecc4ba80fa2b61e077cffaa6f91067997206a0e0fa07609132cb13827657 not found: ID does not exist" containerID="bddcecc4ba80fa2b61e077cffaa6f91067997206a0e0fa07609132cb13827657"
Jul 07 00:04:33.208743 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:04:33.208673    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bddcecc4ba80fa2b61e077cffaa6f91067997206a0e0fa07609132cb13827657"} err="failed to get container status \"bddcecc4ba80fa2b61e077cffaa6f91067997206a0e0fa07609132cb13827657\": rpc error: code = NotFound desc = could not find container \"bddcecc4ba80fa2b61e077cffaa6f91067997206a0e0fa07609132cb13827657\": container with ID starting with bddcecc4ba80fa2b61e077cffaa6f91067997206a0e0fa07609132cb13827657 not found: ID does not exist"
Jul 07 00:04:33.220342 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:04:33.220311    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-97gtg"]
Jul 07 00:04:33.224089 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:04:33.224070    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-97gtg"]
Jul 07 00:04:34.391071 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:04:34.391047    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f02bdc6e-f0fd-4842-8d35-212e98bee739" path="/var/lib/kubelet/pods/f02bdc6e-f0fd-4842-8d35-212e98bee739/volumes"
Jul 07 00:05:13.109353 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:05:13.109317    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-7d9nx"]
Jul 07 00:05:13.109796 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:05:13.109683    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f02bdc6e-f0fd-4842-8d35-212e98bee739" containerName="authorino"
Jul 07 00:05:13.109796 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:05:13.109693    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="f02bdc6e-f0fd-4842-8d35-212e98bee739" containerName="authorino"
Jul 07 00:05:13.109796 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:05:13.109756    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="f02bdc6e-f0fd-4842-8d35-212e98bee739" containerName="authorino"
Jul 07 00:05:13.111938 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:05:13.111922    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58f86c7798-7d9nx"
Jul 07 00:05:13.115022 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:05:13.114969    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 07 00:05:13.115229 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:05:13.115215    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-d7zq9\""
Jul 07 00:05:13.124600 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:05:13.124574    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-7d9nx"]
Jul 07 00:05:13.241596 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:05:13.241564    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dnv4h\" (UniqueName: \"kubernetes.io/projected/9e105368-9b09-41df-8ae9-30432841931f-kube-api-access-dnv4h\") pod \"payload-processing-58f86c7798-7d9nx\" (UID: \"9e105368-9b09-41df-8ae9-30432841931f\") " pod="openshift-ingress/payload-processing-58f86c7798-7d9nx"
Jul 07 00:05:13.241737 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:05:13.241605    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9e105368-9b09-41df-8ae9-30432841931f-plugins-config-volume\") pod \"payload-processing-58f86c7798-7d9nx\" (UID: \"9e105368-9b09-41df-8ae9-30432841931f\") " pod="openshift-ingress/payload-processing-58f86c7798-7d9nx"
Jul 07 00:05:13.342466 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:05:13.342437    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dnv4h\" (UniqueName: \"kubernetes.io/projected/9e105368-9b09-41df-8ae9-30432841931f-kube-api-access-dnv4h\") pod \"payload-processing-58f86c7798-7d9nx\" (UID: \"9e105368-9b09-41df-8ae9-30432841931f\") " pod="openshift-ingress/payload-processing-58f86c7798-7d9nx"
Jul 07 00:05:13.342612 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:05:13.342476    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9e105368-9b09-41df-8ae9-30432841931f-plugins-config-volume\") pod \"payload-processing-58f86c7798-7d9nx\" (UID: \"9e105368-9b09-41df-8ae9-30432841931f\") " pod="openshift-ingress/payload-processing-58f86c7798-7d9nx"
Jul 07 00:05:13.343116 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:05:13.343097    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9e105368-9b09-41df-8ae9-30432841931f-plugins-config-volume\") pod \"payload-processing-58f86c7798-7d9nx\" (UID: \"9e105368-9b09-41df-8ae9-30432841931f\") " pod="openshift-ingress/payload-processing-58f86c7798-7d9nx"
Jul 07 00:05:13.350679 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:05:13.350651    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dnv4h\" (UniqueName: \"kubernetes.io/projected/9e105368-9b09-41df-8ae9-30432841931f-kube-api-access-dnv4h\") pod \"payload-processing-58f86c7798-7d9nx\" (UID: \"9e105368-9b09-41df-8ae9-30432841931f\") " pod="openshift-ingress/payload-processing-58f86c7798-7d9nx"
Jul 07 00:05:13.424134 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:05:13.424109    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58f86c7798-7d9nx"
Jul 07 00:05:13.598858 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:05:13.598835    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-7d9nx"]
Jul 07 00:05:13.600440 ip-10-0-129-23 kubenswrapper[2578]: W0707 00:05:13.600414    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e105368_9b09_41df_8ae9_30432841931f.slice/crio-74083f0670ad4aecf4951479f8385b6fec3a4d6ac02972ef14049a692dc684a7 WatchSource:0}: Error finding container 74083f0670ad4aecf4951479f8385b6fec3a4d6ac02972ef14049a692dc684a7: Status 404 returned error can't find the container with id 74083f0670ad4aecf4951479f8385b6fec3a4d6ac02972ef14049a692dc684a7
Jul 07 00:05:14.411793 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:05:14.411763    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58f86c7798-7d9nx" event={"ID":"9e105368-9b09-41df-8ae9-30432841931f","Type":"ContainerStarted","Data":"74083f0670ad4aecf4951479f8385b6fec3a4d6ac02972ef14049a692dc684a7"}
Jul 07 00:05:15.418306 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:05:15.418256    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58f86c7798-7d9nx" event={"ID":"9e105368-9b09-41df-8ae9-30432841931f","Type":"ContainerStarted","Data":"1c9adf169907a1043f6b562bb2c0b24dbc7489cc8716369098c4351de7945f3b"}
Jul 07 00:05:15.418663 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:05:15.418346    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-58f86c7798-7d9nx"
Jul 07 00:05:15.435942 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:05:15.435904    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-58f86c7798-7d9nx" podStartSLOduration=1.308699839 podStartE2EDuration="2.435892252s" totalImagesPullingTime="1.127192413s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 00:05:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 00:05:15.434484619 +0000 UTC m=+581.545558424" watchObservedRunningTime="2026-07-07 00:05:15.435892252 +0000 UTC m=+581.546966056"
Jul 07 00:05:26.424751 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:05:26.424722    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-58f86c7798-7d9nx"
Jul 07 00:05:34.340206 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:05:34.340172    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-7gjwb_1116f765-1ebd-4c12-9ebb-ed7b7760391c/console-operator/1.log"
Jul 07 00:05:34.340754 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:05:34.340568    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-7gjwb_1116f765-1ebd-4c12-9ebb-ed7b7760391c/console-operator/1.log"
Jul 07 00:05:34.344275 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:05:34.344257    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jfngf_aba6ad45-845e-4916-8cf1-b8c76da93308/ovn-acl-logging/0.log"
Jul 07 00:05:34.344581 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:05:34.344563    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jfngf_aba6ad45-845e-4916-8cf1-b8c76da93308/ovn-acl-logging/0.log"
Jul 07 00:05:37.780832 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:05:37.780796    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-skxq9"]
Jul 07 00:05:37.783568 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:05:37.783549    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-skxq9"
Jul 07 00:05:37.787069 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:05:37.787045    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 07 00:05:37.788617 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:05:37.788588    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 07 00:05:37.788617 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:05:37.788608    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Jul 07 00:05:37.788796 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:05:37.788642    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-st4mb\""
Jul 07 00:05:37.816432 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:05:37.816411    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-skxq9"]
Jul 07 00:05:37.829579 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:05:37.829554    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8wfnl\" (UniqueName: \"kubernetes.io/projected/543fcf9f-27d0-486e-ac37-3413ba2a4275-kube-api-access-8wfnl\") pod \"e2e-distinct-simulated-kserve-59975d69f9-skxq9\" (UID: \"543fcf9f-27d0-486e-ac37-3413ba2a4275\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-skxq9"
Jul 07 00:05:37.829696 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:05:37.829613    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/543fcf9f-27d0-486e-ac37-3413ba2a4275-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-skxq9\" (UID: \"543fcf9f-27d0-486e-ac37-3413ba2a4275\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-skxq9"
Jul 07 00:05:37.829696 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:05:37.829647    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/543fcf9f-27d0-486e-ac37-3413ba2a4275-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-skxq9\" (UID: \"543fcf9f-27d0-486e-ac37-3413ba2a4275\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-skxq9"
Jul 07 00:05:37.829696 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:05:37.829688    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/543fcf9f-27d0-486e-ac37-3413ba2a4275-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-skxq9\" (UID: \"543fcf9f-27d0-486e-ac37-3413ba2a4275\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-skxq9"
Jul 07 00:05:37.829816 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:05:37.829734    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/543fcf9f-27d0-486e-ac37-3413ba2a4275-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-skxq9\" (UID: \"543fcf9f-27d0-486e-ac37-3413ba2a4275\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-skxq9"
Jul 07 00:05:37.829816 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:05:37.829762    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/543fcf9f-27d0-486e-ac37-3413ba2a4275-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-skxq9\" (UID: \"543fcf9f-27d0-486e-ac37-3413ba2a4275\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-skxq9"
Jul 07 00:05:37.930981 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:05:37.930954    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8wfnl\" (UniqueName: \"kubernetes.io/projected/543fcf9f-27d0-486e-ac37-3413ba2a4275-kube-api-access-8wfnl\") pod \"e2e-distinct-simulated-kserve-59975d69f9-skxq9\" (UID: \"543fcf9f-27d0-486e-ac37-3413ba2a4275\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-skxq9"
Jul 07 00:05:37.931103 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:05:37.930991    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/543fcf9f-27d0-486e-ac37-3413ba2a4275-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-skxq9\" (UID: \"543fcf9f-27d0-486e-ac37-3413ba2a4275\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-skxq9"
Jul 07 00:05:37.931103 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:05:37.931009    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/543fcf9f-27d0-486e-ac37-3413ba2a4275-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-skxq9\" (UID: \"543fcf9f-27d0-486e-ac37-3413ba2a4275\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-skxq9"
Jul 07 00:05:37.931103 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:05:37.931041    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/543fcf9f-27d0-486e-ac37-3413ba2a4275-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-skxq9\" (UID: \"543fcf9f-27d0-486e-ac37-3413ba2a4275\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-skxq9"
Jul 07 00:05:37.931103 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:05:37.931072    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/543fcf9f-27d0-486e-ac37-3413ba2a4275-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-skxq9\" (UID: \"543fcf9f-27d0-486e-ac37-3413ba2a4275\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-skxq9"
Jul 07 00:05:37.931103 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:05:37.931097    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/543fcf9f-27d0-486e-ac37-3413ba2a4275-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-skxq9\" (UID: \"543fcf9f-27d0-486e-ac37-3413ba2a4275\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-skxq9"
Jul 07 00:05:37.931438 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:05:37.931417    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/543fcf9f-27d0-486e-ac37-3413ba2a4275-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-skxq9\" (UID: \"543fcf9f-27d0-486e-ac37-3413ba2a4275\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-skxq9"
Jul 07 00:05:37.931506 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:05:37.931457    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/543fcf9f-27d0-486e-ac37-3413ba2a4275-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-skxq9\" (UID: \"543fcf9f-27d0-486e-ac37-3413ba2a4275\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-skxq9"
Jul 07 00:05:37.931562 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:05:37.931529    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/543fcf9f-27d0-486e-ac37-3413ba2a4275-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-skxq9\" (UID: \"543fcf9f-27d0-486e-ac37-3413ba2a4275\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-skxq9"
Jul 07 00:05:37.933538 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:05:37.933515    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/543fcf9f-27d0-486e-ac37-3413ba2a4275-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-skxq9\" (UID: \"543fcf9f-27d0-486e-ac37-3413ba2a4275\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-skxq9"
Jul 07 00:05:37.933765 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:05:37.933748    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/543fcf9f-27d0-486e-ac37-3413ba2a4275-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-skxq9\" (UID: \"543fcf9f-27d0-486e-ac37-3413ba2a4275\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-skxq9"
Jul 07 00:05:37.942630 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:05:37.942607    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8wfnl\" (UniqueName: \"kubernetes.io/projected/543fcf9f-27d0-486e-ac37-3413ba2a4275-kube-api-access-8wfnl\") pod \"e2e-distinct-simulated-kserve-59975d69f9-skxq9\" (UID: \"543fcf9f-27d0-486e-ac37-3413ba2a4275\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-skxq9"
Jul 07 00:05:38.094859 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:05:38.094801    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-skxq9"
Jul 07 00:05:38.232552 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:05:38.232527    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-skxq9"]
Jul 07 00:05:38.234537 ip-10-0-129-23 kubenswrapper[2578]: W0707 00:05:38.234506    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod543fcf9f_27d0_486e_ac37_3413ba2a4275.slice/crio-9ec241f1432b239d413da7b53296a4d61e44ad493a76a00fb5980e1d067c6a96 WatchSource:0}: Error finding container 9ec241f1432b239d413da7b53296a4d61e44ad493a76a00fb5980e1d067c6a96: Status 404 returned error can't find the container with id 9ec241f1432b239d413da7b53296a4d61e44ad493a76a00fb5980e1d067c6a96
Jul 07 00:05:38.530216 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:05:38.530172    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-skxq9" event={"ID":"543fcf9f-27d0-486e-ac37-3413ba2a4275","Type":"ContainerStarted","Data":"9ec241f1432b239d413da7b53296a4d61e44ad493a76a00fb5980e1d067c6a96"}
Jul 07 00:05:39.536410 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:05:39.536377    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-skxq9" event={"ID":"543fcf9f-27d0-486e-ac37-3413ba2a4275","Type":"ContainerStarted","Data":"53b03cacc1a2deb9766db849a309b16c0d47dcdb0881417accfa4e4884999fdb"}
Jul 07 00:05:39.561751 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:05:39.561696    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-skxq9" podStartSLOduration=1.452804639 podStartE2EDuration="2.56167772s" totalImagesPullingTime="1.108873081s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 00:05:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 00:05:39.560379394 +0000 UTC m=+605.671453211" watchObservedRunningTime="2026-07-07 00:05:39.56167772 +0000 UTC m=+605.672751525"
Jul 07 00:05:48.095094 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:05:48.095055    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-skxq9"
Jul 07 00:05:48.095673 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:05:48.095118    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-skxq9"
Jul 07 00:05:48.108411 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:05:48.108385    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-skxq9"
Jul 07 00:05:48.590235 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:05:48.590209    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-skxq9"
Jul 07 00:07:13.414793 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:07:13.414759    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d947bf65f-x68c7"]
Jul 07 00:07:13.418432 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:07:13.418398    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d947bf65f-x68c7"
Jul 07 00:07:13.427363 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:07:13.427338    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d947bf65f-x68c7"]
Jul 07 00:07:13.525719 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:07:13.525688    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/ff3ba37a-518f-4809-b5a9-bea66923d0d8-tls-cert\") pod \"authorino-5d947bf65f-x68c7\" (UID: \"ff3ba37a-518f-4809-b5a9-bea66923d0d8\") " pod="kuadrant-system/authorino-5d947bf65f-x68c7"
Jul 07 00:07:13.525719 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:07:13.525720    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7hltv\" (UniqueName: \"kubernetes.io/projected/ff3ba37a-518f-4809-b5a9-bea66923d0d8-kube-api-access-7hltv\") pod \"authorino-5d947bf65f-x68c7\" (UID: \"ff3ba37a-518f-4809-b5a9-bea66923d0d8\") " pod="kuadrant-system/authorino-5d947bf65f-x68c7"
Jul 07 00:07:13.626492 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:07:13.626462    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/ff3ba37a-518f-4809-b5a9-bea66923d0d8-tls-cert\") pod \"authorino-5d947bf65f-x68c7\" (UID: \"ff3ba37a-518f-4809-b5a9-bea66923d0d8\") " pod="kuadrant-system/authorino-5d947bf65f-x68c7"
Jul 07 00:07:13.626492 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:07:13.626497    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7hltv\" (UniqueName: \"kubernetes.io/projected/ff3ba37a-518f-4809-b5a9-bea66923d0d8-kube-api-access-7hltv\") pod \"authorino-5d947bf65f-x68c7\" (UID: \"ff3ba37a-518f-4809-b5a9-bea66923d0d8\") " pod="kuadrant-system/authorino-5d947bf65f-x68c7"
Jul 07 00:07:13.628944 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:07:13.628917    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/ff3ba37a-518f-4809-b5a9-bea66923d0d8-tls-cert\") pod \"authorino-5d947bf65f-x68c7\" (UID: \"ff3ba37a-518f-4809-b5a9-bea66923d0d8\") " pod="kuadrant-system/authorino-5d947bf65f-x68c7"
Jul 07 00:07:13.635353 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:07:13.635329    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7hltv\" (UniqueName: \"kubernetes.io/projected/ff3ba37a-518f-4809-b5a9-bea66923d0d8-kube-api-access-7hltv\") pod \"authorino-5d947bf65f-x68c7\" (UID: \"ff3ba37a-518f-4809-b5a9-bea66923d0d8\") " pod="kuadrant-system/authorino-5d947bf65f-x68c7"
Jul 07 00:07:13.728406 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:07:13.728351    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d947bf65f-x68c7"
Jul 07 00:07:13.868114 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:07:13.868090    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d947bf65f-x68c7"]
Jul 07 00:07:13.870498 ip-10-0-129-23 kubenswrapper[2578]: W0707 00:07:13.870470    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podff3ba37a_518f_4809_b5a9_bea66923d0d8.slice/crio-9ebc8b2fef9511a60f19ab37ee8c07ef1f627a9440afa5b9c769c01123987e96 WatchSource:0}: Error finding container 9ebc8b2fef9511a60f19ab37ee8c07ef1f627a9440afa5b9c769c01123987e96: Status 404 returned error can't find the container with id 9ebc8b2fef9511a60f19ab37ee8c07ef1f627a9440afa5b9c769c01123987e96
Jul 07 00:07:13.872239 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:07:13.872221    2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 07 00:07:13.988078 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:07:13.987997    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d947bf65f-x68c7" event={"ID":"ff3ba37a-518f-4809-b5a9-bea66923d0d8","Type":"ContainerStarted","Data":"9ebc8b2fef9511a60f19ab37ee8c07ef1f627a9440afa5b9c769c01123987e96"}
Jul 07 00:07:14.997841 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:07:14.997792    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d947bf65f-x68c7" event={"ID":"ff3ba37a-518f-4809-b5a9-bea66923d0d8","Type":"ContainerStarted","Data":"94adda957e8a3ec1de042bfe6d905c49ce8e7dd1107d6629da4b63e84a5e8eef"}
Jul 07 00:07:15.016459 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:07:15.016396    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d947bf65f-x68c7" podStartSLOduration=1.5678332990000001 podStartE2EDuration="2.016355314s" totalImagesPullingTime="448.522015ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 00:07:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 00:07:15.014974651 +0000 UTC m=+701.126048451" watchObservedRunningTime="2026-07-07 00:07:15.016355314 +0000 UTC m=+701.127429119"
Jul 07 00:07:15.051468 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:07:15.051095    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5c88c8cf66-c9rdp"]
Jul 07 00:07:15.051468 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:07:15.051383    2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-5c88c8cf66-c9rdp" podUID="e5be7905-f3ef-47af-8086-d16e91bef0a9" containerName="authorino" containerID="cri-o://a07d960f2974cc0ca342bc1c98fcb1b854c6a3acd4674460bffe7f53616defd4" gracePeriod=30
Jul 07 00:07:15.342046 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:07:15.342023    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5c88c8cf66-c9rdp"
Jul 07 00:07:15.437241 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:07:15.437205    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hmj28\" (UniqueName: \"kubernetes.io/projected/e5be7905-f3ef-47af-8086-d16e91bef0a9-kube-api-access-hmj28\") pod \"e5be7905-f3ef-47af-8086-d16e91bef0a9\" (UID: \"e5be7905-f3ef-47af-8086-d16e91bef0a9\") "
Jul 07 00:07:15.437465 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:07:15.437266    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e5be7905-f3ef-47af-8086-d16e91bef0a9-tls-cert\") pod \"e5be7905-f3ef-47af-8086-d16e91bef0a9\" (UID: \"e5be7905-f3ef-47af-8086-d16e91bef0a9\") "
Jul 07 00:07:15.439583 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:07:15.439551    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e5be7905-f3ef-47af-8086-d16e91bef0a9-kube-api-access-hmj28" (OuterVolumeSpecName: "kube-api-access-hmj28") pod "e5be7905-f3ef-47af-8086-d16e91bef0a9" (UID: "e5be7905-f3ef-47af-8086-d16e91bef0a9"). InnerVolumeSpecName "kube-api-access-hmj28". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 00:07:15.449040 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:07:15.449012    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e5be7905-f3ef-47af-8086-d16e91bef0a9-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "e5be7905-f3ef-47af-8086-d16e91bef0a9" (UID: "e5be7905-f3ef-47af-8086-d16e91bef0a9"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 00:07:15.537904 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:07:15.537868    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hmj28\" (UniqueName: \"kubernetes.io/projected/e5be7905-f3ef-47af-8086-d16e91bef0a9-kube-api-access-hmj28\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Jul 07 00:07:15.537904 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:07:15.537897    2578 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e5be7905-f3ef-47af-8086-d16e91bef0a9-tls-cert\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Jul 07 00:07:16.008868 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:07:16.008835    2578 generic.go:356] "Generic (PLEG): container finished" podID="e5be7905-f3ef-47af-8086-d16e91bef0a9" containerID="a07d960f2974cc0ca342bc1c98fcb1b854c6a3acd4674460bffe7f53616defd4" exitCode=0
Jul 07 00:07:16.009308 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:07:16.008876    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5c88c8cf66-c9rdp"
Jul 07 00:07:16.009308 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:07:16.008916    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5c88c8cf66-c9rdp" event={"ID":"e5be7905-f3ef-47af-8086-d16e91bef0a9","Type":"ContainerDied","Data":"a07d960f2974cc0ca342bc1c98fcb1b854c6a3acd4674460bffe7f53616defd4"}
Jul 07 00:07:16.009308 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:07:16.008965    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5c88c8cf66-c9rdp" event={"ID":"e5be7905-f3ef-47af-8086-d16e91bef0a9","Type":"ContainerDied","Data":"64e29ee0c8abb80ef944f0d0472558b63ef652393f7e506da449d6d363a0d30a"}
Jul 07 00:07:16.009308 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:07:16.008984    2578 scope.go:117] "RemoveContainer" containerID="a07d960f2974cc0ca342bc1c98fcb1b854c6a3acd4674460bffe7f53616defd4"
Jul 07 00:07:16.018809 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:07:16.018790    2578 scope.go:117] "RemoveContainer" containerID="a07d960f2974cc0ca342bc1c98fcb1b854c6a3acd4674460bffe7f53616defd4"
Jul 07 00:07:16.019050 ip-10-0-129-23 kubenswrapper[2578]: E0707 00:07:16.019033    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a07d960f2974cc0ca342bc1c98fcb1b854c6a3acd4674460bffe7f53616defd4\": container with ID starting with a07d960f2974cc0ca342bc1c98fcb1b854c6a3acd4674460bffe7f53616defd4 not found: ID does not exist" containerID="a07d960f2974cc0ca342bc1c98fcb1b854c6a3acd4674460bffe7f53616defd4"
Jul 07 00:07:16.019123 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:07:16.019058    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a07d960f2974cc0ca342bc1c98fcb1b854c6a3acd4674460bffe7f53616defd4"} err="failed to get container status \"a07d960f2974cc0ca342bc1c98fcb1b854c6a3acd4674460bffe7f53616defd4\": rpc error: code = NotFound desc = could not find container \"a07d960f2974cc0ca342bc1c98fcb1b854c6a3acd4674460bffe7f53616defd4\": container with ID starting with a07d960f2974cc0ca342bc1c98fcb1b854c6a3acd4674460bffe7f53616defd4 not found: ID does not exist"
Jul 07 00:07:16.033959 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:07:16.033933    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5c88c8cf66-c9rdp"]
Jul 07 00:07:16.037155 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:07:16.037135    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5c88c8cf66-c9rdp"]
Jul 07 00:07:16.394608 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:07:16.394515    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e5be7905-f3ef-47af-8086-d16e91bef0a9" path="/var/lib/kubelet/pods/e5be7905-f3ef-47af-8086-d16e91bef0a9/volumes"
Jul 07 00:10:34.371455 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:10:34.371370    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-7gjwb_1116f765-1ebd-4c12-9ebb-ed7b7760391c/console-operator/1.log"
Jul 07 00:10:34.372042 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:10:34.371754    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-7gjwb_1116f765-1ebd-4c12-9ebb-ed7b7760391c/console-operator/1.log"
Jul 07 00:10:34.376508 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:10:34.376490    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jfngf_aba6ad45-845e-4916-8cf1-b8c76da93308/ovn-acl-logging/0.log"
Jul 07 00:10:34.376508 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:10:34.376497    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jfngf_aba6ad45-845e-4916-8cf1-b8c76da93308/ovn-acl-logging/0.log"
Jul 07 00:13:10.793587 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:13:10.793552    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-h77nl"]
Jul 07 00:13:10.796085 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:13:10.793746    2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-h77nl" podUID="eb6aadbf-62c3-483a-8ffc-2c5495f1b4e2" containerName="manager" containerID="cri-o://d4246d67545371597c001ba99f26b4287e1401cccab22d4f2805f0e22a68c74b" gracePeriod=10
Jul 07 00:13:13.812526 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:13:13.812159    2578 generic.go:356] "Generic (PLEG): container finished" podID="eb6aadbf-62c3-483a-8ffc-2c5495f1b4e2" containerID="d4246d67545371597c001ba99f26b4287e1401cccab22d4f2805f0e22a68c74b" exitCode=0
Jul 07 00:13:13.812526 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:13:13.812193    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-h77nl" event={"ID":"eb6aadbf-62c3-483a-8ffc-2c5495f1b4e2","Type":"ContainerDied","Data":"d4246d67545371597c001ba99f26b4287e1401cccab22d4f2805f0e22a68c74b"}
Jul 07 00:13:13.956565 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:13:13.956540    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-h77nl"
Jul 07 00:13:14.062678 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:13:14.062583    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/eb6aadbf-62c3-483a-8ffc-2c5495f1b4e2-extensions-socket-volume\") pod \"eb6aadbf-62c3-483a-8ffc-2c5495f1b4e2\" (UID: \"eb6aadbf-62c3-483a-8ffc-2c5495f1b4e2\") "
Jul 07 00:13:14.062678 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:13:14.062648    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qtgnz\" (UniqueName: \"kubernetes.io/projected/eb6aadbf-62c3-483a-8ffc-2c5495f1b4e2-kube-api-access-qtgnz\") pod \"eb6aadbf-62c3-483a-8ffc-2c5495f1b4e2\" (UID: \"eb6aadbf-62c3-483a-8ffc-2c5495f1b4e2\") "
Jul 07 00:13:14.063040 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:13:14.063016    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eb6aadbf-62c3-483a-8ffc-2c5495f1b4e2-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "eb6aadbf-62c3-483a-8ffc-2c5495f1b4e2" (UID: "eb6aadbf-62c3-483a-8ffc-2c5495f1b4e2"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 00:13:14.064856 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:13:14.064833    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eb6aadbf-62c3-483a-8ffc-2c5495f1b4e2-kube-api-access-qtgnz" (OuterVolumeSpecName: "kube-api-access-qtgnz") pod "eb6aadbf-62c3-483a-8ffc-2c5495f1b4e2" (UID: "eb6aadbf-62c3-483a-8ffc-2c5495f1b4e2"). InnerVolumeSpecName "kube-api-access-qtgnz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 00:13:14.164405 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:13:14.164366    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qtgnz\" (UniqueName: \"kubernetes.io/projected/eb6aadbf-62c3-483a-8ffc-2c5495f1b4e2-kube-api-access-qtgnz\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Jul 07 00:13:14.164405 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:13:14.164403    2578 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/eb6aadbf-62c3-483a-8ffc-2c5495f1b4e2-extensions-socket-volume\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Jul 07 00:13:14.818277 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:13:14.818247    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-h77nl" event={"ID":"eb6aadbf-62c3-483a-8ffc-2c5495f1b4e2","Type":"ContainerDied","Data":"382cbe63917a196b9e84fe821c0a18ac762a6abd56ee0d03b2493d0b0b34e198"}
Jul 07 00:13:14.818277 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:13:14.818273    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-h77nl"
Jul 07 00:13:14.818789 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:13:14.818332    2578 scope.go:117] "RemoveContainer" containerID="d4246d67545371597c001ba99f26b4287e1401cccab22d4f2805f0e22a68c74b"
Jul 07 00:13:14.851772 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:13:14.851739    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-h77nl"]
Jul 07 00:13:14.855989 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:13:14.855964    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-h77nl"]
Jul 07 00:13:16.391462 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:13:16.391433    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eb6aadbf-62c3-483a-8ffc-2c5495f1b4e2" path="/var/lib/kubelet/pods/eb6aadbf-62c3-483a-8ffc-2c5495f1b4e2/volumes"
Jul 07 00:14:12.026940 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:14:12.026904    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7rbdd"]
Jul 07 00:14:12.027435 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:14:12.027305    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e5be7905-f3ef-47af-8086-d16e91bef0a9" containerName="authorino"
Jul 07 00:14:12.027435 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:14:12.027317    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="e5be7905-f3ef-47af-8086-d16e91bef0a9" containerName="authorino"
Jul 07 00:14:12.027435 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:14:12.027333    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eb6aadbf-62c3-483a-8ffc-2c5495f1b4e2" containerName="manager"
Jul 07 00:14:12.027435 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:14:12.027338    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="eb6aadbf-62c3-483a-8ffc-2c5495f1b4e2" containerName="manager"
Jul 07 00:14:12.027435 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:14:12.027405    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="eb6aadbf-62c3-483a-8ffc-2c5495f1b4e2" containerName="manager"
Jul 07 00:14:12.027435 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:14:12.027414    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="e5be7905-f3ef-47af-8086-d16e91bef0a9" containerName="authorino"
Jul 07 00:14:12.030443 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:14:12.030426    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7rbdd"
Jul 07 00:14:12.036994 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:14:12.036769    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-cph9l\""
Jul 07 00:14:12.043882 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:14:12.043856    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7rbdd"]
Jul 07 00:14:12.063159 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:14:12.063123    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3b5ca87a-58b0-4523-ac4b-c49abeb73229-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-7rbdd\" (UID: \"3b5ca87a-58b0-4523-ac4b-c49abeb73229\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7rbdd"
Jul 07 00:14:12.063332 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:14:12.063242    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b5wdx\" (UniqueName: \"kubernetes.io/projected/3b5ca87a-58b0-4523-ac4b-c49abeb73229-kube-api-access-b5wdx\") pod \"kuadrant-operator-controller-manager-86878c769f-7rbdd\" (UID: \"3b5ca87a-58b0-4523-ac4b-c49abeb73229\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7rbdd"
Jul 07 00:14:12.163632 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:14:12.163604    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3b5ca87a-58b0-4523-ac4b-c49abeb73229-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-7rbdd\" (UID: \"3b5ca87a-58b0-4523-ac4b-c49abeb73229\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7rbdd"
Jul 07 00:14:12.163807 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:14:12.163667    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b5wdx\" (UniqueName: \"kubernetes.io/projected/3b5ca87a-58b0-4523-ac4b-c49abeb73229-kube-api-access-b5wdx\") pod \"kuadrant-operator-controller-manager-86878c769f-7rbdd\" (UID: \"3b5ca87a-58b0-4523-ac4b-c49abeb73229\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7rbdd"
Jul 07 00:14:12.163956 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:14:12.163936    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3b5ca87a-58b0-4523-ac4b-c49abeb73229-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-7rbdd\" (UID: \"3b5ca87a-58b0-4523-ac4b-c49abeb73229\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7rbdd"
Jul 07 00:14:12.176020 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:14:12.175990    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b5wdx\" (UniqueName: \"kubernetes.io/projected/3b5ca87a-58b0-4523-ac4b-c49abeb73229-kube-api-access-b5wdx\") pod \"kuadrant-operator-controller-manager-86878c769f-7rbdd\" (UID: \"3b5ca87a-58b0-4523-ac4b-c49abeb73229\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7rbdd"
Jul 07 00:14:12.340920 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:14:12.340829    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7rbdd"
Jul 07 00:14:12.484825 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:14:12.484800    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7rbdd"]
Jul 07 00:14:12.487458 ip-10-0-129-23 kubenswrapper[2578]: W0707 00:14:12.487432    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b5ca87a_58b0_4523_ac4b_c49abeb73229.slice/crio-e72bd228910f118d9c742a1baf557a32a67f96869a6e451869def263330426a9 WatchSource:0}: Error finding container e72bd228910f118d9c742a1baf557a32a67f96869a6e451869def263330426a9: Status 404 returned error can't find the container with id e72bd228910f118d9c742a1baf557a32a67f96869a6e451869def263330426a9
Jul 07 00:14:13.102472 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:14:13.102440    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7rbdd" event={"ID":"3b5ca87a-58b0-4523-ac4b-c49abeb73229","Type":"ContainerStarted","Data":"ff89a8089e46cb496b79f42c016325e9b6677d5a8dca14747e6e1f124e6fe12a"}
Jul 07 00:14:13.102872 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:14:13.102489    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7rbdd" event={"ID":"3b5ca87a-58b0-4523-ac4b-c49abeb73229","Type":"ContainerStarted","Data":"e72bd228910f118d9c742a1baf557a32a67f96869a6e451869def263330426a9"}
Jul 07 00:14:13.102872 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:14:13.102536    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7rbdd"
Jul 07 00:14:13.126976 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:14:13.126912    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7rbdd" podStartSLOduration=1.126888753 podStartE2EDuration="1.126888753s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 00:14:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 00:14:13.12416721 +0000 UTC m=+1119.235241015" watchObservedRunningTime="2026-07-07 00:14:13.126888753 +0000 UTC m=+1119.237962560"
Jul 07 00:14:24.110459 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:14:24.110430    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7rbdd"
Jul 07 00:15:00.130118 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:15:00.130033    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29723055-h7qmq"]
Jul 07 00:15:00.133738 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:15:00.133723    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29723055-h7qmq"
Jul 07 00:15:00.139453 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:15:00.139431    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-drsk8\""
Jul 07 00:15:00.143230 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:15:00.143210    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29723055-h7qmq"]
Jul 07 00:15:00.170493 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:15:00.170461    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zfwvj\" (UniqueName: \"kubernetes.io/projected/d1981b93-40dd-447c-b685-f69866ad555a-kube-api-access-zfwvj\") pod \"maas-api-key-cleanup-29723055-h7qmq\" (UID: \"d1981b93-40dd-447c-b685-f69866ad555a\") " pod="opendatahub/maas-api-key-cleanup-29723055-h7qmq"
Jul 07 00:15:00.271115 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:15:00.271078    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zfwvj\" (UniqueName: \"kubernetes.io/projected/d1981b93-40dd-447c-b685-f69866ad555a-kube-api-access-zfwvj\") pod \"maas-api-key-cleanup-29723055-h7qmq\" (UID: \"d1981b93-40dd-447c-b685-f69866ad555a\") " pod="opendatahub/maas-api-key-cleanup-29723055-h7qmq"
Jul 07 00:15:00.279871 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:15:00.279841    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zfwvj\" (UniqueName: \"kubernetes.io/projected/d1981b93-40dd-447c-b685-f69866ad555a-kube-api-access-zfwvj\") pod \"maas-api-key-cleanup-29723055-h7qmq\" (UID: \"d1981b93-40dd-447c-b685-f69866ad555a\") " pod="opendatahub/maas-api-key-cleanup-29723055-h7qmq"
Jul 07 00:15:00.445710 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:15:00.445680    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29723055-h7qmq"
Jul 07 00:15:00.578976 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:15:00.578945    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29723055-h7qmq"]
Jul 07 00:15:00.581032 ip-10-0-129-23 kubenswrapper[2578]: W0707 00:15:00.581003    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1981b93_40dd_447c_b685_f69866ad555a.slice/crio-96963e9f6bf9f467a611a8d83301429aa9a1a87d67174e53c34486f093633efd WatchSource:0}: Error finding container 96963e9f6bf9f467a611a8d83301429aa9a1a87d67174e53c34486f093633efd: Status 404 returned error can't find the container with id 96963e9f6bf9f467a611a8d83301429aa9a1a87d67174e53c34486f093633efd
Jul 07 00:15:00.582914 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:15:00.582898    2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 07 00:15:01.339134 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:15:01.339102    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29723055-h7qmq" event={"ID":"d1981b93-40dd-447c-b685-f69866ad555a","Type":"ContainerStarted","Data":"96963e9f6bf9f467a611a8d83301429aa9a1a87d67174e53c34486f093633efd"}
Jul 07 00:15:03.350674 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:15:03.350644    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29723055-h7qmq" event={"ID":"d1981b93-40dd-447c-b685-f69866ad555a","Type":"ContainerStarted","Data":"56ef6668158b428cc2aff9351c202ed7925a6bef70e572fb9046e8b8a2c856c2"}
Jul 07 00:15:03.368375 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:15:03.368324    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-29723055-h7qmq" podStartSLOduration=0.829291337 podStartE2EDuration="3.368311321s" totalImagesPullingTime="2.539019984s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 00:15:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 00:15:03.366155725 +0000 UTC m=+1169.477229530" watchObservedRunningTime="2026-07-07 00:15:03.368311321 +0000 UTC m=+1169.479385119"
Jul 07 00:15:04.357236 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:15:04.357137    2578 generic.go:356] "Generic (PLEG): container finished" podID="d1981b93-40dd-447c-b685-f69866ad555a" containerID="56ef6668158b428cc2aff9351c202ed7925a6bef70e572fb9046e8b8a2c856c2" exitCode=0
Jul 07 00:15:04.357648 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:15:04.357229    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29723055-h7qmq" event={"ID":"d1981b93-40dd-447c-b685-f69866ad555a","Type":"ContainerDied","Data":"56ef6668158b428cc2aff9351c202ed7925a6bef70e572fb9046e8b8a2c856c2"}
Jul 07 00:15:05.498389 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:15:05.498359    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29723055-h7qmq"
Jul 07 00:15:05.514569 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:15:05.514538    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zfwvj\" (UniqueName: \"kubernetes.io/projected/d1981b93-40dd-447c-b685-f69866ad555a-kube-api-access-zfwvj\") pod \"d1981b93-40dd-447c-b685-f69866ad555a\" (UID: \"d1981b93-40dd-447c-b685-f69866ad555a\") "
Jul 07 00:15:05.517326 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:15:05.517265    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d1981b93-40dd-447c-b685-f69866ad555a-kube-api-access-zfwvj" (OuterVolumeSpecName: "kube-api-access-zfwvj") pod "d1981b93-40dd-447c-b685-f69866ad555a" (UID: "d1981b93-40dd-447c-b685-f69866ad555a"). InnerVolumeSpecName "kube-api-access-zfwvj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 00:15:05.616088 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:15:05.616011    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zfwvj\" (UniqueName: \"kubernetes.io/projected/d1981b93-40dd-447c-b685-f69866ad555a-kube-api-access-zfwvj\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Jul 07 00:15:06.368084 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:15:06.368053    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29723055-h7qmq"
Jul 07 00:15:06.368262 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:15:06.368090    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29723055-h7qmq" event={"ID":"d1981b93-40dd-447c-b685-f69866ad555a","Type":"ContainerDied","Data":"96963e9f6bf9f467a611a8d83301429aa9a1a87d67174e53c34486f093633efd"}
Jul 07 00:15:06.368262 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:15:06.368145    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="96963e9f6bf9f467a611a8d83301429aa9a1a87d67174e53c34486f093633efd"
Jul 07 00:15:34.406174 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:15:34.406137    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-7gjwb_1116f765-1ebd-4c12-9ebb-ed7b7760391c/console-operator/1.log"
Jul 07 00:15:34.407688 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:15:34.407662    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-7gjwb_1116f765-1ebd-4c12-9ebb-ed7b7760391c/console-operator/1.log"
Jul 07 00:15:34.410383 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:15:34.410363    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jfngf_aba6ad45-845e-4916-8cf1-b8c76da93308/ovn-acl-logging/0.log"
Jul 07 00:15:34.411833 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:15:34.411814    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jfngf_aba6ad45-845e-4916-8cf1-b8c76da93308/ovn-acl-logging/0.log"
Jul 07 00:20:34.438608 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:20:34.438577    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-7gjwb_1116f765-1ebd-4c12-9ebb-ed7b7760391c/console-operator/1.log"
Jul 07 00:20:34.441245 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:20:34.441223    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-7gjwb_1116f765-1ebd-4c12-9ebb-ed7b7760391c/console-operator/1.log"
Jul 07 00:20:34.442769 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:20:34.442750    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jfngf_aba6ad45-845e-4916-8cf1-b8c76da93308/ovn-acl-logging/0.log"
Jul 07 00:20:34.445064 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:20:34.445045    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jfngf_aba6ad45-845e-4916-8cf1-b8c76da93308/ovn-acl-logging/0.log"
Jul 07 00:22:49.075229 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:22:49.075195    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-mt-60cbb180-6754c866f9-2s6pn"]
Jul 07 00:22:49.075869 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:22:49.075846    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d1981b93-40dd-447c-b685-f69866ad555a" containerName="cleanup"
Jul 07 00:22:49.075969 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:22:49.075873    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="d1981b93-40dd-447c-b685-f69866ad555a" containerName="cleanup"
Jul 07 00:22:49.076029 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:22:49.076004    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="d1981b93-40dd-447c-b685-f69866ad555a" containerName="cleanup"
Jul 07 00:22:49.079488 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:22:49.079471    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-60cbb180-6754c866f9-2s6pn"
Jul 07 00:22:49.082194 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:22:49.082169    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-mt-60cbb180-serving-cert\""
Jul 07 00:22:49.082372 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:22:49.082344    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-drsk8\""
Jul 07 00:22:49.093300 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:22:49.093263    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-mt-60cbb180-6754c866f9-2s6pn"]
Jul 07 00:22:49.173872 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:22:49.173846    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/46013d6b-e0d3-4eed-ad5f-74e02f93cb54-openshift-service-ca\") pod \"maas-api-e2e-mt-60cbb180-6754c866f9-2s6pn\" (UID: \"46013d6b-e0d3-4eed-ad5f-74e02f93cb54\") " pod="opendatahub/maas-api-e2e-mt-60cbb180-6754c866f9-2s6pn"
Jul 07 00:22:49.174119 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:22:49.173900    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/46013d6b-e0d3-4eed-ad5f-74e02f93cb54-maas-api-tls\") pod \"maas-api-e2e-mt-60cbb180-6754c866f9-2s6pn\" (UID: \"46013d6b-e0d3-4eed-ad5f-74e02f93cb54\") " pod="opendatahub/maas-api-e2e-mt-60cbb180-6754c866f9-2s6pn"
Jul 07 00:22:49.174119 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:22:49.173951    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f9dxz\" (UniqueName: \"kubernetes.io/projected/46013d6b-e0d3-4eed-ad5f-74e02f93cb54-kube-api-access-f9dxz\") pod \"maas-api-e2e-mt-60cbb180-6754c866f9-2s6pn\" (UID: \"46013d6b-e0d3-4eed-ad5f-74e02f93cb54\") " pod="opendatahub/maas-api-e2e-mt-60cbb180-6754c866f9-2s6pn"
Jul 07 00:22:49.274550 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:22:49.274514    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/46013d6b-e0d3-4eed-ad5f-74e02f93cb54-maas-api-tls\") pod \"maas-api-e2e-mt-60cbb180-6754c866f9-2s6pn\" (UID: \"46013d6b-e0d3-4eed-ad5f-74e02f93cb54\") " pod="opendatahub/maas-api-e2e-mt-60cbb180-6754c866f9-2s6pn"
Jul 07 00:22:49.274742 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:22:49.274568    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f9dxz\" (UniqueName: \"kubernetes.io/projected/46013d6b-e0d3-4eed-ad5f-74e02f93cb54-kube-api-access-f9dxz\") pod \"maas-api-e2e-mt-60cbb180-6754c866f9-2s6pn\" (UID: \"46013d6b-e0d3-4eed-ad5f-74e02f93cb54\") " pod="opendatahub/maas-api-e2e-mt-60cbb180-6754c866f9-2s6pn"
Jul 07 00:22:49.274742 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:22:49.274652    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/46013d6b-e0d3-4eed-ad5f-74e02f93cb54-openshift-service-ca\") pod \"maas-api-e2e-mt-60cbb180-6754c866f9-2s6pn\" (UID: \"46013d6b-e0d3-4eed-ad5f-74e02f93cb54\") " pod="opendatahub/maas-api-e2e-mt-60cbb180-6754c866f9-2s6pn"
Jul 07 00:22:49.274742 ip-10-0-129-23 kubenswrapper[2578]: E0707 00:22:49.274659    2578 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-mt-60cbb180-serving-cert: secret "maas-api-e2e-mt-60cbb180-serving-cert" not found
Jul 07 00:22:49.274742 ip-10-0-129-23 kubenswrapper[2578]: E0707 00:22:49.274720    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/46013d6b-e0d3-4eed-ad5f-74e02f93cb54-maas-api-tls podName:46013d6b-e0d3-4eed-ad5f-74e02f93cb54 nodeName:}" failed. No retries permitted until 2026-07-07 00:22:49.774701115 +0000 UTC m=+1635.885774898 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/46013d6b-e0d3-4eed-ad5f-74e02f93cb54-maas-api-tls") pod "maas-api-e2e-mt-60cbb180-6754c866f9-2s6pn" (UID: "46013d6b-e0d3-4eed-ad5f-74e02f93cb54") : secret "maas-api-e2e-mt-60cbb180-serving-cert" not found
Jul 07 00:22:49.275331 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:22:49.275307    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/46013d6b-e0d3-4eed-ad5f-74e02f93cb54-openshift-service-ca\") pod \"maas-api-e2e-mt-60cbb180-6754c866f9-2s6pn\" (UID: \"46013d6b-e0d3-4eed-ad5f-74e02f93cb54\") " pod="opendatahub/maas-api-e2e-mt-60cbb180-6754c866f9-2s6pn"
Jul 07 00:22:49.288168 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:22:49.288137    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f9dxz\" (UniqueName: \"kubernetes.io/projected/46013d6b-e0d3-4eed-ad5f-74e02f93cb54-kube-api-access-f9dxz\") pod \"maas-api-e2e-mt-60cbb180-6754c866f9-2s6pn\" (UID: \"46013d6b-e0d3-4eed-ad5f-74e02f93cb54\") " pod="opendatahub/maas-api-e2e-mt-60cbb180-6754c866f9-2s6pn"
Jul 07 00:22:49.779568 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:22:49.779539    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/46013d6b-e0d3-4eed-ad5f-74e02f93cb54-maas-api-tls\") pod \"maas-api-e2e-mt-60cbb180-6754c866f9-2s6pn\" (UID: \"46013d6b-e0d3-4eed-ad5f-74e02f93cb54\") " pod="opendatahub/maas-api-e2e-mt-60cbb180-6754c866f9-2s6pn"
Jul 07 00:22:49.782138 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:22:49.782106    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/46013d6b-e0d3-4eed-ad5f-74e02f93cb54-maas-api-tls\") pod \"maas-api-e2e-mt-60cbb180-6754c866f9-2s6pn\" (UID: \"46013d6b-e0d3-4eed-ad5f-74e02f93cb54\") " pod="opendatahub/maas-api-e2e-mt-60cbb180-6754c866f9-2s6pn"
Jul 07 00:22:49.995121 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:22:49.995085    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-60cbb180-6754c866f9-2s6pn"
Jul 07 00:22:50.142241 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:22:50.142216    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-mt-60cbb180-6754c866f9-2s6pn"]
Jul 07 00:22:50.144423 ip-10-0-129-23 kubenswrapper[2578]: W0707 00:22:50.144394    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod46013d6b_e0d3_4eed_ad5f_74e02f93cb54.slice/crio-07340748a792487e031e592a191e55457a6e91d18c0e20bb7b1227e349fa7222 WatchSource:0}: Error finding container 07340748a792487e031e592a191e55457a6e91d18c0e20bb7b1227e349fa7222: Status 404 returned error can't find the container with id 07340748a792487e031e592a191e55457a6e91d18c0e20bb7b1227e349fa7222
Jul 07 00:22:50.145743 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:22:50.145724    2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 07 00:22:50.716663 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:22:50.716632    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-60cbb180-6754c866f9-2s6pn" event={"ID":"46013d6b-e0d3-4eed-ad5f-74e02f93cb54","Type":"ContainerStarted","Data":"07340748a792487e031e592a191e55457a6e91d18c0e20bb7b1227e349fa7222"}
Jul 07 00:22:53.737156 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:22:53.737121    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-60cbb180-6754c866f9-2s6pn" event={"ID":"46013d6b-e0d3-4eed-ad5f-74e02f93cb54","Type":"ContainerStarted","Data":"d57450631683e3ef5328842cb89dfa0c58d92dab8877e99a2d977944d5f9244b"}
Jul 07 00:22:53.737536 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:22:53.737213    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-mt-60cbb180-6754c866f9-2s6pn"
Jul 07 00:22:53.754686 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:22:53.754641    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-mt-60cbb180-6754c866f9-2s6pn" podStartSLOduration=2.094573055 podStartE2EDuration="4.754628357s" totalImagesPullingTime="2.660055302s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 00:22:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 00:22:53.753624026 +0000 UTC m=+1639.864697830" watchObservedRunningTime="2026-07-07 00:22:53.754628357 +0000 UTC m=+1639.865702161"
Jul 07 00:22:59.747327 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:22:59.747299    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-mt-60cbb180-6754c866f9-2s6pn"
Jul 07 00:23:01.215333 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:23:01.215297    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-mt-60cbb180-6754c866f9-2s6pn"]
Jul 07 00:23:01.215783 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:23:01.215543    2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-mt-60cbb180-6754c866f9-2s6pn" podUID="46013d6b-e0d3-4eed-ad5f-74e02f93cb54" containerName="maas-api" containerID="cri-o://d57450631683e3ef5328842cb89dfa0c58d92dab8877e99a2d977944d5f9244b" gracePeriod=30
Jul 07 00:23:01.468540 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:23:01.468483    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-60cbb180-6754c866f9-2s6pn"
Jul 07 00:23:01.581732 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:23:01.581697    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/46013d6b-e0d3-4eed-ad5f-74e02f93cb54-openshift-service-ca\") pod \"46013d6b-e0d3-4eed-ad5f-74e02f93cb54\" (UID: \"46013d6b-e0d3-4eed-ad5f-74e02f93cb54\") "
Jul 07 00:23:01.581896 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:23:01.581752    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f9dxz\" (UniqueName: \"kubernetes.io/projected/46013d6b-e0d3-4eed-ad5f-74e02f93cb54-kube-api-access-f9dxz\") pod \"46013d6b-e0d3-4eed-ad5f-74e02f93cb54\" (UID: \"46013d6b-e0d3-4eed-ad5f-74e02f93cb54\") "
Jul 07 00:23:01.581896 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:23:01.581776    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/46013d6b-e0d3-4eed-ad5f-74e02f93cb54-maas-api-tls\") pod \"46013d6b-e0d3-4eed-ad5f-74e02f93cb54\" (UID: \"46013d6b-e0d3-4eed-ad5f-74e02f93cb54\") "
Jul 07 00:23:01.582085 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:23:01.582060    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/46013d6b-e0d3-4eed-ad5f-74e02f93cb54-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "46013d6b-e0d3-4eed-ad5f-74e02f93cb54" (UID: "46013d6b-e0d3-4eed-ad5f-74e02f93cb54"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 00:23:01.583977 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:23:01.583949    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/46013d6b-e0d3-4eed-ad5f-74e02f93cb54-kube-api-access-f9dxz" (OuterVolumeSpecName: "kube-api-access-f9dxz") pod "46013d6b-e0d3-4eed-ad5f-74e02f93cb54" (UID: "46013d6b-e0d3-4eed-ad5f-74e02f93cb54"). InnerVolumeSpecName "kube-api-access-f9dxz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 00:23:01.583977 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:23:01.583965    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/46013d6b-e0d3-4eed-ad5f-74e02f93cb54-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "46013d6b-e0d3-4eed-ad5f-74e02f93cb54" (UID: "46013d6b-e0d3-4eed-ad5f-74e02f93cb54"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 00:23:01.682692 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:23:01.682662    2578 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/46013d6b-e0d3-4eed-ad5f-74e02f93cb54-openshift-service-ca\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Jul 07 00:23:01.682692 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:23:01.682687    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f9dxz\" (UniqueName: \"kubernetes.io/projected/46013d6b-e0d3-4eed-ad5f-74e02f93cb54-kube-api-access-f9dxz\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Jul 07 00:23:01.682692 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:23:01.682697    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/46013d6b-e0d3-4eed-ad5f-74e02f93cb54-maas-api-tls\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Jul 07 00:23:01.776921 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:23:01.776846    2578 generic.go:356] "Generic (PLEG): container finished" podID="46013d6b-e0d3-4eed-ad5f-74e02f93cb54" containerID="d57450631683e3ef5328842cb89dfa0c58d92dab8877e99a2d977944d5f9244b" exitCode=0
Jul 07 00:23:01.776921 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:23:01.776890    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-60cbb180-6754c866f9-2s6pn"
Jul 07 00:23:01.777099 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:23:01.776929    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-60cbb180-6754c866f9-2s6pn" event={"ID":"46013d6b-e0d3-4eed-ad5f-74e02f93cb54","Type":"ContainerDied","Data":"d57450631683e3ef5328842cb89dfa0c58d92dab8877e99a2d977944d5f9244b"}
Jul 07 00:23:01.777099 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:23:01.776980    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-60cbb180-6754c866f9-2s6pn" event={"ID":"46013d6b-e0d3-4eed-ad5f-74e02f93cb54","Type":"ContainerDied","Data":"07340748a792487e031e592a191e55457a6e91d18c0e20bb7b1227e349fa7222"}
Jul 07 00:23:01.777099 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:23:01.777006    2578 scope.go:117] "RemoveContainer" containerID="d57450631683e3ef5328842cb89dfa0c58d92dab8877e99a2d977944d5f9244b"
Jul 07 00:23:01.786566 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:23:01.786548    2578 scope.go:117] "RemoveContainer" containerID="d57450631683e3ef5328842cb89dfa0c58d92dab8877e99a2d977944d5f9244b"
Jul 07 00:23:01.786824 ip-10-0-129-23 kubenswrapper[2578]: E0707 00:23:01.786803    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d57450631683e3ef5328842cb89dfa0c58d92dab8877e99a2d977944d5f9244b\": container with ID starting with d57450631683e3ef5328842cb89dfa0c58d92dab8877e99a2d977944d5f9244b not found: ID does not exist" containerID="d57450631683e3ef5328842cb89dfa0c58d92dab8877e99a2d977944d5f9244b"
Jul 07 00:23:01.786897 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:23:01.786830    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d57450631683e3ef5328842cb89dfa0c58d92dab8877e99a2d977944d5f9244b"} err="failed to get container status \"d57450631683e3ef5328842cb89dfa0c58d92dab8877e99a2d977944d5f9244b\": rpc error: code = NotFound desc = could not find container \"d57450631683e3ef5328842cb89dfa0c58d92dab8877e99a2d977944d5f9244b\": container with ID starting with d57450631683e3ef5328842cb89dfa0c58d92dab8877e99a2d977944d5f9244b not found: ID does not exist"
Jul 07 00:23:01.798867 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:23:01.798847    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-mt-60cbb180-6754c866f9-2s6pn"]
Jul 07 00:23:01.802625 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:23:01.802605    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-mt-60cbb180-6754c866f9-2s6pn"]
Jul 07 00:23:02.391657 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:23:02.391619    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="46013d6b-e0d3-4eed-ad5f-74e02f93cb54" path="/var/lib/kubelet/pods/46013d6b-e0d3-4eed-ad5f-74e02f93cb54/volumes"
Jul 07 00:25:34.467755 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:25:34.467724    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-7gjwb_1116f765-1ebd-4c12-9ebb-ed7b7760391c/console-operator/1.log"
Jul 07 00:25:34.471321 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:25:34.471301    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-7gjwb_1116f765-1ebd-4c12-9ebb-ed7b7760391c/console-operator/1.log"
Jul 07 00:25:34.471930 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:25:34.471913    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jfngf_aba6ad45-845e-4916-8cf1-b8c76da93308/ovn-acl-logging/0.log"
Jul 07 00:25:34.475130 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:25:34.475108    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jfngf_aba6ad45-845e-4916-8cf1-b8c76da93308/ovn-acl-logging/0.log"
Jul 07 00:26:14.925267 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:26:14.925227    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-0ec7c3-openshift-default-55d6d964f-79bl9"]
Jul 07 00:26:14.925869 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:26:14.925853    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="46013d6b-e0d3-4eed-ad5f-74e02f93cb54" containerName="maas-api"
Jul 07 00:26:14.925918 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:26:14.925872    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="46013d6b-e0d3-4eed-ad5f-74e02f93cb54" containerName="maas-api"
Jul 07 00:26:14.925981 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:26:14.925970    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="46013d6b-e0d3-4eed-ad5f-74e02f93cb54" containerName="maas-api"
Jul 07 00:26:14.929497 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:26:14.929481    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-0ec7c3-openshift-default-55d6d964f-79bl9"
Jul 07 00:26:14.932483 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:26:14.932466    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 07 00:26:14.932759 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:26:14.932736    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-0ec7c3-openshift-default-dockercfg-g7n62\""
Jul 07 00:26:14.942399 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:26:14.942376    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-0ec7c3-openshift-default-55d6d964f-79bl9"]
Jul 07 00:26:15.069965 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:26:15.069930    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/67ddb01d-bedf-46a7-96d1-b6a41aa61398-istio-envoy\") pod \"e2e-inf-b-0ec7c3-openshift-default-55d6d964f-79bl9\" (UID: \"67ddb01d-bedf-46a7-96d1-b6a41aa61398\") " pod="openshift-ingress/e2e-inf-b-0ec7c3-openshift-default-55d6d964f-79bl9"
Jul 07 00:26:15.070180 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:26:15.069975    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/67ddb01d-bedf-46a7-96d1-b6a41aa61398-workload-socket\") pod \"e2e-inf-b-0ec7c3-openshift-default-55d6d964f-79bl9\" (UID: \"67ddb01d-bedf-46a7-96d1-b6a41aa61398\") " pod="openshift-ingress/e2e-inf-b-0ec7c3-openshift-default-55d6d964f-79bl9"
Jul 07 00:26:15.070180 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:26:15.070006    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/67ddb01d-bedf-46a7-96d1-b6a41aa61398-istiod-ca-cert\") pod \"e2e-inf-b-0ec7c3-openshift-default-55d6d964f-79bl9\" (UID: \"67ddb01d-bedf-46a7-96d1-b6a41aa61398\") " pod="openshift-ingress/e2e-inf-b-0ec7c3-openshift-default-55d6d964f-79bl9"
Jul 07 00:26:15.070180 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:26:15.070079    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/67ddb01d-bedf-46a7-96d1-b6a41aa61398-istio-token\") pod \"e2e-inf-b-0ec7c3-openshift-default-55d6d964f-79bl9\" (UID: \"67ddb01d-bedf-46a7-96d1-b6a41aa61398\") " pod="openshift-ingress/e2e-inf-b-0ec7c3-openshift-default-55d6d964f-79bl9"
Jul 07 00:26:15.070180 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:26:15.070129    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/67ddb01d-bedf-46a7-96d1-b6a41aa61398-istio-data\") pod \"e2e-inf-b-0ec7c3-openshift-default-55d6d964f-79bl9\" (UID: \"67ddb01d-bedf-46a7-96d1-b6a41aa61398\") " pod="openshift-ingress/e2e-inf-b-0ec7c3-openshift-default-55d6d964f-79bl9"
Jul 07 00:26:15.070180 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:26:15.070156    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/67ddb01d-bedf-46a7-96d1-b6a41aa61398-credential-socket\") pod \"e2e-inf-b-0ec7c3-openshift-default-55d6d964f-79bl9\" (UID: \"67ddb01d-bedf-46a7-96d1-b6a41aa61398\") " pod="openshift-ingress/e2e-inf-b-0ec7c3-openshift-default-55d6d964f-79bl9"
Jul 07 00:26:15.070426 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:26:15.070184    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/67ddb01d-bedf-46a7-96d1-b6a41aa61398-istio-podinfo\") pod \"e2e-inf-b-0ec7c3-openshift-default-55d6d964f-79bl9\" (UID: \"67ddb01d-bedf-46a7-96d1-b6a41aa61398\") " pod="openshift-ingress/e2e-inf-b-0ec7c3-openshift-default-55d6d964f-79bl9"
Jul 07 00:26:15.070426 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:26:15.070277    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/67ddb01d-bedf-46a7-96d1-b6a41aa61398-workload-certs\") pod \"e2e-inf-b-0ec7c3-openshift-default-55d6d964f-79bl9\" (UID: \"67ddb01d-bedf-46a7-96d1-b6a41aa61398\") " pod="openshift-ingress/e2e-inf-b-0ec7c3-openshift-default-55d6d964f-79bl9"
Jul 07 00:26:15.070426 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:26:15.070344    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7dw4l\" (UniqueName: \"kubernetes.io/projected/67ddb01d-bedf-46a7-96d1-b6a41aa61398-kube-api-access-7dw4l\") pod \"e2e-inf-b-0ec7c3-openshift-default-55d6d964f-79bl9\" (UID: \"67ddb01d-bedf-46a7-96d1-b6a41aa61398\") " pod="openshift-ingress/e2e-inf-b-0ec7c3-openshift-default-55d6d964f-79bl9"
Jul 07 00:26:15.171010 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:26:15.170978    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/67ddb01d-bedf-46a7-96d1-b6a41aa61398-istio-envoy\") pod \"e2e-inf-b-0ec7c3-openshift-default-55d6d964f-79bl9\" (UID: \"67ddb01d-bedf-46a7-96d1-b6a41aa61398\") " pod="openshift-ingress/e2e-inf-b-0ec7c3-openshift-default-55d6d964f-79bl9"
Jul 07 00:26:15.171220 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:26:15.171018    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/67ddb01d-bedf-46a7-96d1-b6a41aa61398-workload-socket\") pod \"e2e-inf-b-0ec7c3-openshift-default-55d6d964f-79bl9\" (UID: \"67ddb01d-bedf-46a7-96d1-b6a41aa61398\") " pod="openshift-ingress/e2e-inf-b-0ec7c3-openshift-default-55d6d964f-79bl9"
Jul 07 00:26:15.171220 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:26:15.171041    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/67ddb01d-bedf-46a7-96d1-b6a41aa61398-istiod-ca-cert\") pod \"e2e-inf-b-0ec7c3-openshift-default-55d6d964f-79bl9\" (UID: \"67ddb01d-bedf-46a7-96d1-b6a41aa61398\") " pod="openshift-ingress/e2e-inf-b-0ec7c3-openshift-default-55d6d964f-79bl9"
Jul 07 00:26:15.171220 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:26:15.171064    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/67ddb01d-bedf-46a7-96d1-b6a41aa61398-istio-token\") pod \"e2e-inf-b-0ec7c3-openshift-default-55d6d964f-79bl9\" (UID: \"67ddb01d-bedf-46a7-96d1-b6a41aa61398\") " pod="openshift-ingress/e2e-inf-b-0ec7c3-openshift-default-55d6d964f-79bl9"
Jul 07 00:26:15.171220 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:26:15.171086    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/67ddb01d-bedf-46a7-96d1-b6a41aa61398-istio-data\") pod \"e2e-inf-b-0ec7c3-openshift-default-55d6d964f-79bl9\" (UID: \"67ddb01d-bedf-46a7-96d1-b6a41aa61398\") " pod="openshift-ingress/e2e-inf-b-0ec7c3-openshift-default-55d6d964f-79bl9"
Jul 07 00:26:15.171220 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:26:15.171120    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/67ddb01d-bedf-46a7-96d1-b6a41aa61398-credential-socket\") pod \"e2e-inf-b-0ec7c3-openshift-default-55d6d964f-79bl9\" (UID: \"67ddb01d-bedf-46a7-96d1-b6a41aa61398\") " pod="openshift-ingress/e2e-inf-b-0ec7c3-openshift-default-55d6d964f-79bl9"
Jul 07 00:26:15.171220 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:26:15.171139    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/67ddb01d-bedf-46a7-96d1-b6a41aa61398-istio-podinfo\") pod \"e2e-inf-b-0ec7c3-openshift-default-55d6d964f-79bl9\" (UID: \"67ddb01d-bedf-46a7-96d1-b6a41aa61398\") " pod="openshift-ingress/e2e-inf-b-0ec7c3-openshift-default-55d6d964f-79bl9"
Jul 07 00:26:15.171220 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:26:15.171167    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/67ddb01d-bedf-46a7-96d1-b6a41aa61398-workload-certs\") pod \"e2e-inf-b-0ec7c3-openshift-default-55d6d964f-79bl9\" (UID: \"67ddb01d-bedf-46a7-96d1-b6a41aa61398\") " pod="openshift-ingress/e2e-inf-b-0ec7c3-openshift-default-55d6d964f-79bl9"
Jul 07 00:26:15.171220 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:26:15.171203    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7dw4l\" (UniqueName: \"kubernetes.io/projected/67ddb01d-bedf-46a7-96d1-b6a41aa61398-kube-api-access-7dw4l\") pod \"e2e-inf-b-0ec7c3-openshift-default-55d6d964f-79bl9\" (UID: \"67ddb01d-bedf-46a7-96d1-b6a41aa61398\") " pod="openshift-ingress/e2e-inf-b-0ec7c3-openshift-default-55d6d964f-79bl9"
Jul 07 00:26:15.171664 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:26:15.171603    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/67ddb01d-bedf-46a7-96d1-b6a41aa61398-workload-socket\") pod \"e2e-inf-b-0ec7c3-openshift-default-55d6d964f-79bl9\" (UID: \"67ddb01d-bedf-46a7-96d1-b6a41aa61398\") " pod="openshift-ingress/e2e-inf-b-0ec7c3-openshift-default-55d6d964f-79bl9"
Jul 07 00:26:15.171664 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:26:15.171638    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/67ddb01d-bedf-46a7-96d1-b6a41aa61398-istio-data\") pod \"e2e-inf-b-0ec7c3-openshift-default-55d6d964f-79bl9\" (UID: \"67ddb01d-bedf-46a7-96d1-b6a41aa61398\") " pod="openshift-ingress/e2e-inf-b-0ec7c3-openshift-default-55d6d964f-79bl9"
Jul 07 00:26:15.171755 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:26:15.171694    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/67ddb01d-bedf-46a7-96d1-b6a41aa61398-workload-certs\") pod \"e2e-inf-b-0ec7c3-openshift-default-55d6d964f-79bl9\" (UID: \"67ddb01d-bedf-46a7-96d1-b6a41aa61398\") " pod="openshift-ingress/e2e-inf-b-0ec7c3-openshift-default-55d6d964f-79bl9"
Jul 07 00:26:15.171858 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:26:15.171839    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/67ddb01d-bedf-46a7-96d1-b6a41aa61398-credential-socket\") pod \"e2e-inf-b-0ec7c3-openshift-default-55d6d964f-79bl9\" (UID: \"67ddb01d-bedf-46a7-96d1-b6a41aa61398\") " pod="openshift-ingress/e2e-inf-b-0ec7c3-openshift-default-55d6d964f-79bl9"
Jul 07 00:26:15.172306 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:26:15.172256    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/67ddb01d-bedf-46a7-96d1-b6a41aa61398-istiod-ca-cert\") pod \"e2e-inf-b-0ec7c3-openshift-default-55d6d964f-79bl9\" (UID: \"67ddb01d-bedf-46a7-96d1-b6a41aa61398\") " pod="openshift-ingress/e2e-inf-b-0ec7c3-openshift-default-55d6d964f-79bl9"
Jul 07 00:26:15.173458 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:26:15.173428    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/67ddb01d-bedf-46a7-96d1-b6a41aa61398-istio-envoy\") pod \"e2e-inf-b-0ec7c3-openshift-default-55d6d964f-79bl9\" (UID: \"67ddb01d-bedf-46a7-96d1-b6a41aa61398\") " pod="openshift-ingress/e2e-inf-b-0ec7c3-openshift-default-55d6d964f-79bl9"
Jul 07 00:26:15.173734 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:26:15.173718    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/67ddb01d-bedf-46a7-96d1-b6a41aa61398-istio-podinfo\") pod \"e2e-inf-b-0ec7c3-openshift-default-55d6d964f-79bl9\" (UID: \"67ddb01d-bedf-46a7-96d1-b6a41aa61398\") " pod="openshift-ingress/e2e-inf-b-0ec7c3-openshift-default-55d6d964f-79bl9"
Jul 07 00:26:15.179130 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:26:15.179064    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/67ddb01d-bedf-46a7-96d1-b6a41aa61398-istio-token\") pod \"e2e-inf-b-0ec7c3-openshift-default-55d6d964f-79bl9\" (UID: \"67ddb01d-bedf-46a7-96d1-b6a41aa61398\") " pod="openshift-ingress/e2e-inf-b-0ec7c3-openshift-default-55d6d964f-79bl9"
Jul 07 00:26:15.179393 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:26:15.179376    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7dw4l\" (UniqueName: \"kubernetes.io/projected/67ddb01d-bedf-46a7-96d1-b6a41aa61398-kube-api-access-7dw4l\") pod \"e2e-inf-b-0ec7c3-openshift-default-55d6d964f-79bl9\" (UID: \"67ddb01d-bedf-46a7-96d1-b6a41aa61398\") " pod="openshift-ingress/e2e-inf-b-0ec7c3-openshift-default-55d6d964f-79bl9"
Jul 07 00:26:15.239357 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:26:15.239320    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-0ec7c3-openshift-default-55d6d964f-79bl9"
Jul 07 00:26:15.384724 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:26:15.384698    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-0ec7c3-openshift-default-55d6d964f-79bl9"]
Jul 07 00:26:15.386990 ip-10-0-129-23 kubenswrapper[2578]: W0707 00:26:15.386957    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67ddb01d_bedf_46a7_96d1_b6a41aa61398.slice/crio-44f094156ac1fa336942ca4a3e3a0d2e4f31fab49f75d12af1e4a267fd4b4893 WatchSource:0}: Error finding container 44f094156ac1fa336942ca4a3e3a0d2e4f31fab49f75d12af1e4a267fd4b4893: Status 404 returned error can't find the container with id 44f094156ac1fa336942ca4a3e3a0d2e4f31fab49f75d12af1e4a267fd4b4893
Jul 07 00:26:15.771653 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:26:15.771617    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-0ec7c3-openshift-default-55d6d964f-79bl9" event={"ID":"67ddb01d-bedf-46a7-96d1-b6a41aa61398","Type":"ContainerStarted","Data":"44f094156ac1fa336942ca4a3e3a0d2e4f31fab49f75d12af1e4a267fd4b4893"}
Jul 07 00:26:18.046050 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:26:18.046017    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892172Ki","pods":"250"}
Jul 07 00:26:18.046325 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:26:18.046098    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892172Ki","pods":"250"}
Jul 07 00:26:18.046325 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:26:18.046133    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892172Ki","pods":"250"}
Jul 07 00:26:18.791386 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:26:18.791344    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-0ec7c3-openshift-default-55d6d964f-79bl9" event={"ID":"67ddb01d-bedf-46a7-96d1-b6a41aa61398","Type":"ContainerStarted","Data":"2f25668edd1789ec8732aa4aa40789cdfd7e43b95dfc7abd837dcfe6a761bca4"}
Jul 07 00:26:18.811499 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:26:18.811446    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-0ec7c3-openshift-default-55d6d964f-79bl9" podStartSLOduration=2.154928424 podStartE2EDuration="4.811425765s" totalImagesPullingTime="2.656497341s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 00:26:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 00:26:18.810387581 +0000 UTC m=+1844.921461384" watchObservedRunningTime="2026-07-07 00:26:18.811425765 +0000 UTC m=+1844.922499569"
Jul 07 00:26:19.239696 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:26:19.239660    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-0ec7c3-openshift-default-55d6d964f-79bl9"
Jul 07 00:26:19.244565 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:26:19.244536    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-0ec7c3-openshift-default-55d6d964f-79bl9"
Jul 07 00:26:19.797077 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:26:19.797044    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-0ec7c3-openshift-default-55d6d964f-79bl9"
Jul 07 00:26:19.798081 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:26:19.798063    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-0ec7c3-openshift-default-55d6d964f-79bl9"
Jul 07 00:26:35.309700 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:26:35.308727    2578 patch_prober.go:28] interesting pod/e2e-inf-b-0ec7c3-openshift-default-55d6d964f-79bl9 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": read tcp 10.132.0.2:41678->10.132.0.53:15021: read: connection reset by peer" start-of-body=
Jul 07 00:26:35.309700 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:26:35.308856    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-0ec7c3-openshift-default-55d6d964f-79bl9" podUID="67ddb01d-bedf-46a7-96d1-b6a41aa61398" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": read tcp 10.132.0.2:41678->10.132.0.53:15021: read: connection reset by peer"
Jul 07 00:26:35.881499 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:26:35.881463    2578 generic.go:356] "Generic (PLEG): container finished" podID="67ddb01d-bedf-46a7-96d1-b6a41aa61398" containerID="2f25668edd1789ec8732aa4aa40789cdfd7e43b95dfc7abd837dcfe6a761bca4" exitCode=0
Jul 07 00:26:35.881675 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:26:35.881541    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-0ec7c3-openshift-default-55d6d964f-79bl9" event={"ID":"67ddb01d-bedf-46a7-96d1-b6a41aa61398","Type":"ContainerDied","Data":"2f25668edd1789ec8732aa4aa40789cdfd7e43b95dfc7abd837dcfe6a761bca4"}
Jul 07 00:26:35.881972 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:26:35.881959    2578 scope.go:117] "RemoveContainer" containerID="2f25668edd1789ec8732aa4aa40789cdfd7e43b95dfc7abd837dcfe6a761bca4"
Jul 07 00:26:35.883872 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:26:35.883842    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892172Ki","pods":"250"}
Jul 07 00:26:35.883952 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:26:35.883910    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892172Ki","pods":"250"}
Jul 07 00:26:35.883999 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:26:35.883960    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892172Ki","pods":"250"}
Jul 07 00:26:36.892014 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:26:36.891062    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-0ec7c3-openshift-default-55d6d964f-79bl9" event={"ID":"67ddb01d-bedf-46a7-96d1-b6a41aa61398","Type":"ContainerStarted","Data":"8e4d3f27200a46ddef34ec1f905025b6d7007eb4d3c66f5d5ec72b6ec42eb82d"}
Jul 07 00:26:37.239538 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:26:37.239501    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-0ec7c3-openshift-default-55d6d964f-79bl9"
Jul 07 00:26:37.239729 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:26:37.239704    2578 patch_prober.go:28] interesting pod/e2e-inf-b-0ec7c3-openshift-default-55d6d964f-79bl9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body=
Jul 07 00:26:37.239782 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:26:37.239749    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-0ec7c3-openshift-default-55d6d964f-79bl9" podUID="67ddb01d-bedf-46a7-96d1-b6a41aa61398" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused"
Jul 07 00:26:38.240303 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:26:38.240254    2578 patch_prober.go:28] interesting pod/e2e-inf-b-0ec7c3-openshift-default-55d6d964f-79bl9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body=
Jul 07 00:26:38.240727 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:26:38.240355    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-0ec7c3-openshift-default-55d6d964f-79bl9" podUID="67ddb01d-bedf-46a7-96d1-b6a41aa61398" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused"
Jul 07 00:26:39.239758 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:26:39.239722    2578 patch_prober.go:28] interesting pod/e2e-inf-b-0ec7c3-openshift-default-55d6d964f-79bl9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body=
Jul 07 00:26:39.239983 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:26:39.239787    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-0ec7c3-openshift-default-55d6d964f-79bl9" podUID="67ddb01d-bedf-46a7-96d1-b6a41aa61398" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused"
Jul 07 00:26:40.240723 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:26:40.240678    2578 patch_prober.go:28] interesting pod/e2e-inf-b-0ec7c3-openshift-default-55d6d964f-79bl9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body=
Jul 07 00:26:40.241208 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:26:40.240754    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-0ec7c3-openshift-default-55d6d964f-79bl9" podUID="67ddb01d-bedf-46a7-96d1-b6a41aa61398" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused"
Jul 07 00:26:41.243300 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:26:41.243257    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-0ec7c3-openshift-default-55d6d964f-79bl9"
Jul 07 00:26:41.243782 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:26:41.243557    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-0ec7c3-openshift-default-55d6d964f-79bl9"
Jul 07 00:26:41.244384 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:26:41.244359    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-0ec7c3-openshift-default-55d6d964f-79bl9"
Jul 07 00:28:04.304192 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:28:04.304158    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-0ec7c3-openshift-default-55d6d964f-79bl9"]
Jul 07 00:28:04.304649 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:28:04.304434    2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-0ec7c3-openshift-default-55d6d964f-79bl9" podUID="67ddb01d-bedf-46a7-96d1-b6a41aa61398" containerName="istio-proxy" containerID="cri-o://8e4d3f27200a46ddef34ec1f905025b6d7007eb4d3c66f5d5ec72b6ec42eb82d" gracePeriod=30
Jul 07 00:28:09.604090 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:28:09.604068    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-0ec7c3-openshift-default-55d6d964f-79bl9"
Jul 07 00:28:09.751512 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:28:09.751485    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/67ddb01d-bedf-46a7-96d1-b6a41aa61398-istio-podinfo\") pod \"67ddb01d-bedf-46a7-96d1-b6a41aa61398\" (UID: \"67ddb01d-bedf-46a7-96d1-b6a41aa61398\") "
Jul 07 00:28:09.751694 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:28:09.751540    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/67ddb01d-bedf-46a7-96d1-b6a41aa61398-credential-socket\") pod \"67ddb01d-bedf-46a7-96d1-b6a41aa61398\" (UID: \"67ddb01d-bedf-46a7-96d1-b6a41aa61398\") "
Jul 07 00:28:09.751694 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:28:09.751571    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/67ddb01d-bedf-46a7-96d1-b6a41aa61398-istio-envoy\") pod \"67ddb01d-bedf-46a7-96d1-b6a41aa61398\" (UID: \"67ddb01d-bedf-46a7-96d1-b6a41aa61398\") "
Jul 07 00:28:09.751694 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:28:09.751629    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/67ddb01d-bedf-46a7-96d1-b6a41aa61398-istio-data\") pod \"67ddb01d-bedf-46a7-96d1-b6a41aa61398\" (UID: \"67ddb01d-bedf-46a7-96d1-b6a41aa61398\") "
Jul 07 00:28:09.751694 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:28:09.751674    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/67ddb01d-bedf-46a7-96d1-b6a41aa61398-workload-certs\") pod \"67ddb01d-bedf-46a7-96d1-b6a41aa61398\" (UID: \"67ddb01d-bedf-46a7-96d1-b6a41aa61398\") "
Jul 07 00:28:09.751920 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:28:09.751700    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/67ddb01d-bedf-46a7-96d1-b6a41aa61398-istiod-ca-cert\") pod \"67ddb01d-bedf-46a7-96d1-b6a41aa61398\" (UID: \"67ddb01d-bedf-46a7-96d1-b6a41aa61398\") "
Jul 07 00:28:09.751920 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:28:09.751746    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/67ddb01d-bedf-46a7-96d1-b6a41aa61398-istio-token\") pod \"67ddb01d-bedf-46a7-96d1-b6a41aa61398\" (UID: \"67ddb01d-bedf-46a7-96d1-b6a41aa61398\") "
Jul 07 00:28:09.751920 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:28:09.751785    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/67ddb01d-bedf-46a7-96d1-b6a41aa61398-workload-socket\") pod \"67ddb01d-bedf-46a7-96d1-b6a41aa61398\" (UID: \"67ddb01d-bedf-46a7-96d1-b6a41aa61398\") "
Jul 07 00:28:09.751920 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:28:09.751818    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7dw4l\" (UniqueName: \"kubernetes.io/projected/67ddb01d-bedf-46a7-96d1-b6a41aa61398-kube-api-access-7dw4l\") pod \"67ddb01d-bedf-46a7-96d1-b6a41aa61398\" (UID: \"67ddb01d-bedf-46a7-96d1-b6a41aa61398\") "
Jul 07 00:28:09.751920 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:28:09.751871    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/67ddb01d-bedf-46a7-96d1-b6a41aa61398-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "67ddb01d-bedf-46a7-96d1-b6a41aa61398" (UID: "67ddb01d-bedf-46a7-96d1-b6a41aa61398"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 00:28:09.752182 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:28:09.751988    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/67ddb01d-bedf-46a7-96d1-b6a41aa61398-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "67ddb01d-bedf-46a7-96d1-b6a41aa61398" (UID: "67ddb01d-bedf-46a7-96d1-b6a41aa61398"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 00:28:09.752182 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:28:09.752150    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/67ddb01d-bedf-46a7-96d1-b6a41aa61398-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "67ddb01d-bedf-46a7-96d1-b6a41aa61398" (UID: "67ddb01d-bedf-46a7-96d1-b6a41aa61398"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 00:28:09.752182 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:28:09.752175    2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/67ddb01d-bedf-46a7-96d1-b6a41aa61398-workload-certs\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Jul 07 00:28:09.752436 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:28:09.752197    2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/67ddb01d-bedf-46a7-96d1-b6a41aa61398-credential-socket\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Jul 07 00:28:09.752500 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:28:09.752426    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/67ddb01d-bedf-46a7-96d1-b6a41aa61398-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "67ddb01d-bedf-46a7-96d1-b6a41aa61398" (UID: "67ddb01d-bedf-46a7-96d1-b6a41aa61398"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 00:28:09.752500 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:28:09.752464    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/67ddb01d-bedf-46a7-96d1-b6a41aa61398-istio-data" (OuterVolumeSpecName: "istio-data") pod "67ddb01d-bedf-46a7-96d1-b6a41aa61398" (UID: "67ddb01d-bedf-46a7-96d1-b6a41aa61398"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 00:28:09.753913 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:28:09.753886    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/67ddb01d-bedf-46a7-96d1-b6a41aa61398-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "67ddb01d-bedf-46a7-96d1-b6a41aa61398" (UID: "67ddb01d-bedf-46a7-96d1-b6a41aa61398"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 00:28:09.754105 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:28:09.754086    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/67ddb01d-bedf-46a7-96d1-b6a41aa61398-istio-token" (OuterVolumeSpecName: "istio-token") pod "67ddb01d-bedf-46a7-96d1-b6a41aa61398" (UID: "67ddb01d-bedf-46a7-96d1-b6a41aa61398"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 00:28:09.754325 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:28:09.754299    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/67ddb01d-bedf-46a7-96d1-b6a41aa61398-kube-api-access-7dw4l" (OuterVolumeSpecName: "kube-api-access-7dw4l") pod "67ddb01d-bedf-46a7-96d1-b6a41aa61398" (UID: "67ddb01d-bedf-46a7-96d1-b6a41aa61398"). InnerVolumeSpecName "kube-api-access-7dw4l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 00:28:09.754433 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:28:09.754412    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/67ddb01d-bedf-46a7-96d1-b6a41aa61398-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "67ddb01d-bedf-46a7-96d1-b6a41aa61398" (UID: "67ddb01d-bedf-46a7-96d1-b6a41aa61398"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 07 00:28:09.853208 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:28:09.853060    2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/67ddb01d-bedf-46a7-96d1-b6a41aa61398-istio-podinfo\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Jul 07 00:28:09.853208 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:28:09.853103    2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/67ddb01d-bedf-46a7-96d1-b6a41aa61398-istio-envoy\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Jul 07 00:28:09.853208 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:28:09.853118    2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/67ddb01d-bedf-46a7-96d1-b6a41aa61398-istio-data\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Jul 07 00:28:09.853208 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:28:09.853132    2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/67ddb01d-bedf-46a7-96d1-b6a41aa61398-istiod-ca-cert\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Jul 07 00:28:09.853208 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:28:09.853144    2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/67ddb01d-bedf-46a7-96d1-b6a41aa61398-istio-token\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Jul 07 00:28:09.853208 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:28:09.853157    2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/67ddb01d-bedf-46a7-96d1-b6a41aa61398-workload-socket\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Jul 07 00:28:09.853208 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:28:09.853168    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7dw4l\" (UniqueName: \"kubernetes.io/projected/67ddb01d-bedf-46a7-96d1-b6a41aa61398-kube-api-access-7dw4l\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Jul 07 00:28:10.394539 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:28:10.394505    2578 generic.go:356] "Generic (PLEG): container finished" podID="67ddb01d-bedf-46a7-96d1-b6a41aa61398" containerID="8e4d3f27200a46ddef34ec1f905025b6d7007eb4d3c66f5d5ec72b6ec42eb82d" exitCode=0
Jul 07 00:28:10.394725 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:28:10.394562    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-0ec7c3-openshift-default-55d6d964f-79bl9"
Jul 07 00:28:10.394725 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:28:10.394590    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-0ec7c3-openshift-default-55d6d964f-79bl9" event={"ID":"67ddb01d-bedf-46a7-96d1-b6a41aa61398","Type":"ContainerDied","Data":"8e4d3f27200a46ddef34ec1f905025b6d7007eb4d3c66f5d5ec72b6ec42eb82d"}
Jul 07 00:28:10.394725 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:28:10.394637    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-0ec7c3-openshift-default-55d6d964f-79bl9" event={"ID":"67ddb01d-bedf-46a7-96d1-b6a41aa61398","Type":"ContainerDied","Data":"44f094156ac1fa336942ca4a3e3a0d2e4f31fab49f75d12af1e4a267fd4b4893"}
Jul 07 00:28:10.394725 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:28:10.394659    2578 scope.go:117] "RemoveContainer" containerID="8e4d3f27200a46ddef34ec1f905025b6d7007eb4d3c66f5d5ec72b6ec42eb82d"
Jul 07 00:28:10.405020 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:28:10.405004    2578 scope.go:117] "RemoveContainer" containerID="2f25668edd1789ec8732aa4aa40789cdfd7e43b95dfc7abd837dcfe6a761bca4"
Jul 07 00:28:10.413217 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:28:10.413203    2578 scope.go:117] "RemoveContainer" containerID="8e4d3f27200a46ddef34ec1f905025b6d7007eb4d3c66f5d5ec72b6ec42eb82d"
Jul 07 00:28:10.413471 ip-10-0-129-23 kubenswrapper[2578]: E0707 00:28:10.413451    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8e4d3f27200a46ddef34ec1f905025b6d7007eb4d3c66f5d5ec72b6ec42eb82d\": container with ID starting with 8e4d3f27200a46ddef34ec1f905025b6d7007eb4d3c66f5d5ec72b6ec42eb82d not found: ID does not exist" containerID="8e4d3f27200a46ddef34ec1f905025b6d7007eb4d3c66f5d5ec72b6ec42eb82d"
Jul 07 00:28:10.413550 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:28:10.413478    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8e4d3f27200a46ddef34ec1f905025b6d7007eb4d3c66f5d5ec72b6ec42eb82d"} err="failed to get container status \"8e4d3f27200a46ddef34ec1f905025b6d7007eb4d3c66f5d5ec72b6ec42eb82d\": rpc error: code = NotFound desc = could not find container \"8e4d3f27200a46ddef34ec1f905025b6d7007eb4d3c66f5d5ec72b6ec42eb82d\": container with ID starting with 8e4d3f27200a46ddef34ec1f905025b6d7007eb4d3c66f5d5ec72b6ec42eb82d not found: ID does not exist"
Jul 07 00:28:10.413550 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:28:10.413494    2578 scope.go:117] "RemoveContainer" containerID="2f25668edd1789ec8732aa4aa40789cdfd7e43b95dfc7abd837dcfe6a761bca4"
Jul 07 00:28:10.413710 ip-10-0-129-23 kubenswrapper[2578]: E0707 00:28:10.413696    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2f25668edd1789ec8732aa4aa40789cdfd7e43b95dfc7abd837dcfe6a761bca4\": container with ID starting with 2f25668edd1789ec8732aa4aa40789cdfd7e43b95dfc7abd837dcfe6a761bca4 not found: ID does not exist" containerID="2f25668edd1789ec8732aa4aa40789cdfd7e43b95dfc7abd837dcfe6a761bca4"
Jul 07 00:28:10.413753 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:28:10.413713    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2f25668edd1789ec8732aa4aa40789cdfd7e43b95dfc7abd837dcfe6a761bca4"} err="failed to get container status \"2f25668edd1789ec8732aa4aa40789cdfd7e43b95dfc7abd837dcfe6a761bca4\": rpc error: code = NotFound desc = could not find container \"2f25668edd1789ec8732aa4aa40789cdfd7e43b95dfc7abd837dcfe6a761bca4\": container with ID starting with 2f25668edd1789ec8732aa4aa40789cdfd7e43b95dfc7abd837dcfe6a761bca4 not found: ID does not exist"
Jul 07 00:28:10.418528 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:28:10.418507    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-0ec7c3-openshift-default-55d6d964f-79bl9"]
Jul 07 00:28:10.422971 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:28:10.422954    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-0ec7c3-openshift-default-55d6d964f-79bl9"]
Jul 07 00:28:12.391256 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:28:12.391226    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="67ddb01d-bedf-46a7-96d1-b6a41aa61398" path="/var/lib/kubelet/pods/67ddb01d-bedf-46a7-96d1-b6a41aa61398/volumes"
Jul 07 00:28:13.559977 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:28:13.559941    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-295217-openshift-default-79478c4677-zs6xf"]
Jul 07 00:28:13.560652 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:28:13.560610    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="67ddb01d-bedf-46a7-96d1-b6a41aa61398" containerName="istio-proxy"
Jul 07 00:28:13.560652 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:28:13.560655    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="67ddb01d-bedf-46a7-96d1-b6a41aa61398" containerName="istio-proxy"
Jul 07 00:28:13.560846 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:28:13.560670    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="67ddb01d-bedf-46a7-96d1-b6a41aa61398" containerName="istio-proxy"
Jul 07 00:28:13.560846 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:28:13.560678    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="67ddb01d-bedf-46a7-96d1-b6a41aa61398" containerName="istio-proxy"
Jul 07 00:28:13.560846 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:28:13.560837    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="67ddb01d-bedf-46a7-96d1-b6a41aa61398" containerName="istio-proxy"
Jul 07 00:28:13.564336 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:28:13.564317    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-295217-openshift-default-79478c4677-zs6xf"
Jul 07 00:28:13.567308 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:28:13.567257    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-295217-openshift-default-dockercfg-fszqk\""
Jul 07 00:28:13.567522 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:28:13.567509    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 07 00:28:13.576571 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:28:13.576548    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-295217-openshift-default-79478c4677-zs6xf"]
Jul 07 00:28:13.681486 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:28:13.681447    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d577fce3-f99d-4dc1-9c29-cb6288c0758b-workload-certs\") pod \"e2e-api-b-295217-openshift-default-79478c4677-zs6xf\" (UID: \"d577fce3-f99d-4dc1-9c29-cb6288c0758b\") " pod="openshift-ingress/e2e-api-b-295217-openshift-default-79478c4677-zs6xf"
Jul 07 00:28:13.681645 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:28:13.681512    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d577fce3-f99d-4dc1-9c29-cb6288c0758b-istio-envoy\") pod \"e2e-api-b-295217-openshift-default-79478c4677-zs6xf\" (UID: \"d577fce3-f99d-4dc1-9c29-cb6288c0758b\") " pod="openshift-ingress/e2e-api-b-295217-openshift-default-79478c4677-zs6xf"
Jul 07 00:28:13.681645 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:28:13.681557    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d577fce3-f99d-4dc1-9c29-cb6288c0758b-workload-socket\") pod \"e2e-api-b-295217-openshift-default-79478c4677-zs6xf\" (UID: \"d577fce3-f99d-4dc1-9c29-cb6288c0758b\") " pod="openshift-ingress/e2e-api-b-295217-openshift-default-79478c4677-zs6xf"
Jul 07 00:28:13.681645 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:28:13.681606    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d577fce3-f99d-4dc1-9c29-cb6288c0758b-istiod-ca-cert\") pod \"e2e-api-b-295217-openshift-default-79478c4677-zs6xf\" (UID: \"d577fce3-f99d-4dc1-9c29-cb6288c0758b\") " pod="openshift-ingress/e2e-api-b-295217-openshift-default-79478c4677-zs6xf"
Jul 07 00:28:13.681645 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:28:13.681631    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d577fce3-f99d-4dc1-9c29-cb6288c0758b-istio-podinfo\") pod \"e2e-api-b-295217-openshift-default-79478c4677-zs6xf\" (UID: \"d577fce3-f99d-4dc1-9c29-cb6288c0758b\") " pod="openshift-ingress/e2e-api-b-295217-openshift-default-79478c4677-zs6xf"
Jul 07 00:28:13.681822 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:28:13.681657    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d577fce3-f99d-4dc1-9c29-cb6288c0758b-credential-socket\") pod \"e2e-api-b-295217-openshift-default-79478c4677-zs6xf\" (UID: \"d577fce3-f99d-4dc1-9c29-cb6288c0758b\") " pod="openshift-ingress/e2e-api-b-295217-openshift-default-79478c4677-zs6xf"
Jul 07 00:28:13.681822 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:28:13.681733    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ntql4\" (UniqueName: \"kubernetes.io/projected/d577fce3-f99d-4dc1-9c29-cb6288c0758b-kube-api-access-ntql4\") pod \"e2e-api-b-295217-openshift-default-79478c4677-zs6xf\" (UID: \"d577fce3-f99d-4dc1-9c29-cb6288c0758b\") " pod="openshift-ingress/e2e-api-b-295217-openshift-default-79478c4677-zs6xf"
Jul 07 00:28:13.681822 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:28:13.681806    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d577fce3-f99d-4dc1-9c29-cb6288c0758b-istio-token\") pod \"e2e-api-b-295217-openshift-default-79478c4677-zs6xf\" (UID: \"d577fce3-f99d-4dc1-9c29-cb6288c0758b\") " pod="openshift-ingress/e2e-api-b-295217-openshift-default-79478c4677-zs6xf"
Jul 07 00:28:13.681936 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:28:13.681872    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d577fce3-f99d-4dc1-9c29-cb6288c0758b-istio-data\") pod \"e2e-api-b-295217-openshift-default-79478c4677-zs6xf\" (UID: \"d577fce3-f99d-4dc1-9c29-cb6288c0758b\") " pod="openshift-ingress/e2e-api-b-295217-openshift-default-79478c4677-zs6xf"
Jul 07 00:28:13.782536 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:28:13.782505    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d577fce3-f99d-4dc1-9c29-cb6288c0758b-istio-data\") pod \"e2e-api-b-295217-openshift-default-79478c4677-zs6xf\" (UID: \"d577fce3-f99d-4dc1-9c29-cb6288c0758b\") " pod="openshift-ingress/e2e-api-b-295217-openshift-default-79478c4677-zs6xf"
Jul 07 00:28:13.782689 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:28:13.782545    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d577fce3-f99d-4dc1-9c29-cb6288c0758b-workload-certs\") pod \"e2e-api-b-295217-openshift-default-79478c4677-zs6xf\" (UID: \"d577fce3-f99d-4dc1-9c29-cb6288c0758b\") " pod="openshift-ingress/e2e-api-b-295217-openshift-default-79478c4677-zs6xf"
Jul 07 00:28:13.782689 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:28:13.782580    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d577fce3-f99d-4dc1-9c29-cb6288c0758b-istio-envoy\") pod \"e2e-api-b-295217-openshift-default-79478c4677-zs6xf\" (UID: \"d577fce3-f99d-4dc1-9c29-cb6288c0758b\") " pod="openshift-ingress/e2e-api-b-295217-openshift-default-79478c4677-zs6xf"
Jul 07 00:28:13.782689 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:28:13.782599    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d577fce3-f99d-4dc1-9c29-cb6288c0758b-workload-socket\") pod \"e2e-api-b-295217-openshift-default-79478c4677-zs6xf\" (UID: \"d577fce3-f99d-4dc1-9c29-cb6288c0758b\") " pod="openshift-ingress/e2e-api-b-295217-openshift-default-79478c4677-zs6xf"
Jul 07 00:28:13.782689 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:28:13.782622    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d577fce3-f99d-4dc1-9c29-cb6288c0758b-istiod-ca-cert\") pod \"e2e-api-b-295217-openshift-default-79478c4677-zs6xf\" (UID: \"d577fce3-f99d-4dc1-9c29-cb6288c0758b\") " pod="openshift-ingress/e2e-api-b-295217-openshift-default-79478c4677-zs6xf"
Jul 07 00:28:13.782689 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:28:13.782638    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d577fce3-f99d-4dc1-9c29-cb6288c0758b-istio-podinfo\") pod \"e2e-api-b-295217-openshift-default-79478c4677-zs6xf\" (UID: \"d577fce3-f99d-4dc1-9c29-cb6288c0758b\") " pod="openshift-ingress/e2e-api-b-295217-openshift-default-79478c4677-zs6xf"
Jul 07 00:28:13.782689 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:28:13.782655    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d577fce3-f99d-4dc1-9c29-cb6288c0758b-credential-socket\") pod \"e2e-api-b-295217-openshift-default-79478c4677-zs6xf\" (UID: \"d577fce3-f99d-4dc1-9c29-cb6288c0758b\") " pod="openshift-ingress/e2e-api-b-295217-openshift-default-79478c4677-zs6xf"
Jul 07 00:28:13.782689 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:28:13.782673    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ntql4\" (UniqueName: \"kubernetes.io/projected/d577fce3-f99d-4dc1-9c29-cb6288c0758b-kube-api-access-ntql4\") pod \"e2e-api-b-295217-openshift-default-79478c4677-zs6xf\" (UID: \"d577fce3-f99d-4dc1-9c29-cb6288c0758b\") " pod="openshift-ingress/e2e-api-b-295217-openshift-default-79478c4677-zs6xf"
Jul 07 00:28:13.783065 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:28:13.782695    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d577fce3-f99d-4dc1-9c29-cb6288c0758b-istio-token\") pod \"e2e-api-b-295217-openshift-default-79478c4677-zs6xf\" (UID: \"d577fce3-f99d-4dc1-9c29-cb6288c0758b\") " pod="openshift-ingress/e2e-api-b-295217-openshift-default-79478c4677-zs6xf"
Jul 07 00:28:13.783065 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:28:13.782938    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d577fce3-f99d-4dc1-9c29-cb6288c0758b-workload-certs\") pod \"e2e-api-b-295217-openshift-default-79478c4677-zs6xf\" (UID: \"d577fce3-f99d-4dc1-9c29-cb6288c0758b\") " pod="openshift-ingress/e2e-api-b-295217-openshift-default-79478c4677-zs6xf"
Jul 07 00:28:13.783065 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:28:13.782968    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d577fce3-f99d-4dc1-9c29-cb6288c0758b-istio-data\") pod \"e2e-api-b-295217-openshift-default-79478c4677-zs6xf\" (UID: \"d577fce3-f99d-4dc1-9c29-cb6288c0758b\") " pod="openshift-ingress/e2e-api-b-295217-openshift-default-79478c4677-zs6xf"
Jul 07 00:28:13.783184 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:28:13.783077    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d577fce3-f99d-4dc1-9c29-cb6288c0758b-workload-socket\") pod \"e2e-api-b-295217-openshift-default-79478c4677-zs6xf\" (UID: \"d577fce3-f99d-4dc1-9c29-cb6288c0758b\") " pod="openshift-ingress/e2e-api-b-295217-openshift-default-79478c4677-zs6xf"
Jul 07 00:28:13.783184 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:28:13.783119    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d577fce3-f99d-4dc1-9c29-cb6288c0758b-credential-socket\") pod \"e2e-api-b-295217-openshift-default-79478c4677-zs6xf\" (UID: \"d577fce3-f99d-4dc1-9c29-cb6288c0758b\") " pod="openshift-ingress/e2e-api-b-295217-openshift-default-79478c4677-zs6xf"
Jul 07 00:28:13.783594 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:28:13.783572    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d577fce3-f99d-4dc1-9c29-cb6288c0758b-istiod-ca-cert\") pod \"e2e-api-b-295217-openshift-default-79478c4677-zs6xf\" (UID: \"d577fce3-f99d-4dc1-9c29-cb6288c0758b\") " pod="openshift-ingress/e2e-api-b-295217-openshift-default-79478c4677-zs6xf"
Jul 07 00:28:13.785087 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:28:13.785039    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d577fce3-f99d-4dc1-9c29-cb6288c0758b-istio-envoy\") pod \"e2e-api-b-295217-openshift-default-79478c4677-zs6xf\" (UID: \"d577fce3-f99d-4dc1-9c29-cb6288c0758b\") " pod="openshift-ingress/e2e-api-b-295217-openshift-default-79478c4677-zs6xf"
Jul 07 00:28:13.785520 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:28:13.785500    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d577fce3-f99d-4dc1-9c29-cb6288c0758b-istio-podinfo\") pod \"e2e-api-b-295217-openshift-default-79478c4677-zs6xf\" (UID: \"d577fce3-f99d-4dc1-9c29-cb6288c0758b\") " pod="openshift-ingress/e2e-api-b-295217-openshift-default-79478c4677-zs6xf"
Jul 07 00:28:13.791344 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:28:13.791324    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d577fce3-f99d-4dc1-9c29-cb6288c0758b-istio-token\") pod \"e2e-api-b-295217-openshift-default-79478c4677-zs6xf\" (UID: \"d577fce3-f99d-4dc1-9c29-cb6288c0758b\") " pod="openshift-ingress/e2e-api-b-295217-openshift-default-79478c4677-zs6xf"
Jul 07 00:28:13.791742 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:28:13.791722    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ntql4\" (UniqueName: \"kubernetes.io/projected/d577fce3-f99d-4dc1-9c29-cb6288c0758b-kube-api-access-ntql4\") pod \"e2e-api-b-295217-openshift-default-79478c4677-zs6xf\" (UID: \"d577fce3-f99d-4dc1-9c29-cb6288c0758b\") " pod="openshift-ingress/e2e-api-b-295217-openshift-default-79478c4677-zs6xf"
Jul 07 00:28:13.877319 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:28:13.877226    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-295217-openshift-default-79478c4677-zs6xf"
Jul 07 00:28:14.018976 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:28:14.018951    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-295217-openshift-default-79478c4677-zs6xf"]
Jul 07 00:28:14.021245 ip-10-0-129-23 kubenswrapper[2578]: W0707 00:28:14.021212    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd577fce3_f99d_4dc1_9c29_cb6288c0758b.slice/crio-9213c14a340971f50258ad1dd89e27fb6091916642c4db62143d3d6cf808fede WatchSource:0}: Error finding container 9213c14a340971f50258ad1dd89e27fb6091916642c4db62143d3d6cf808fede: Status 404 returned error can't find the container with id 9213c14a340971f50258ad1dd89e27fb6091916642c4db62143d3d6cf808fede
Jul 07 00:28:14.023469 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:28:14.023440    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892172Ki","pods":"250"}
Jul 07 00:28:14.023566 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:28:14.023516    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892172Ki","pods":"250"}
Jul 07 00:28:14.023566 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:28:14.023560    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892172Ki","pods":"250"}
Jul 07 00:28:14.416763 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:28:14.416730    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-295217-openshift-default-79478c4677-zs6xf" event={"ID":"d577fce3-f99d-4dc1-9c29-cb6288c0758b","Type":"ContainerStarted","Data":"046d02e88a0dc203c9bb6fba5104d6028450fb9f1dd97a7a34335c0834e6eafb"}
Jul 07 00:28:14.416924 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:28:14.416775    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-295217-openshift-default-79478c4677-zs6xf" event={"ID":"d577fce3-f99d-4dc1-9c29-cb6288c0758b","Type":"ContainerStarted","Data":"9213c14a340971f50258ad1dd89e27fb6091916642c4db62143d3d6cf808fede"}
Jul 07 00:28:14.441033 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:28:14.440981    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-295217-openshift-default-79478c4677-zs6xf" podStartSLOduration=1.4409617479999999 podStartE2EDuration="1.440961748s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 00:28:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 00:28:14.437271948 +0000 UTC m=+1960.548345753" watchObservedRunningTime="2026-07-07 00:28:14.440961748 +0000 UTC m=+1960.552035555"
Jul 07 00:28:14.877355 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:28:14.877273    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-295217-openshift-default-79478c4677-zs6xf"
Jul 07 00:28:15.883294 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:28:15.883249    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-295217-openshift-default-79478c4677-zs6xf"
Jul 07 00:28:16.427210 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:28:16.427178    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-295217-openshift-default-79478c4677-zs6xf"
Jul 07 00:28:16.428449 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:28:16.428428    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-295217-openshift-default-79478c4677-zs6xf"
Jul 07 00:28:29.492852 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:28:29.492769    2578 generic.go:356] "Generic (PLEG): container finished" podID="d577fce3-f99d-4dc1-9c29-cb6288c0758b" containerID="046d02e88a0dc203c9bb6fba5104d6028450fb9f1dd97a7a34335c0834e6eafb" exitCode=0
Jul 07 00:28:29.492852 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:28:29.492824    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-295217-openshift-default-79478c4677-zs6xf" event={"ID":"d577fce3-f99d-4dc1-9c29-cb6288c0758b","Type":"ContainerDied","Data":"046d02e88a0dc203c9bb6fba5104d6028450fb9f1dd97a7a34335c0834e6eafb"}
Jul 07 00:28:29.493607 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:28:29.493194    2578 scope.go:117] "RemoveContainer" containerID="046d02e88a0dc203c9bb6fba5104d6028450fb9f1dd97a7a34335c0834e6eafb"
Jul 07 00:28:29.494209 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:28:29.494180    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892172Ki","pods":"250"}
Jul 07 00:28:29.494344 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:28:29.494245    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892172Ki","pods":"250"}
Jul 07 00:28:29.494344 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:28:29.494293    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892172Ki","pods":"250"}
Jul 07 00:28:30.503747 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:28:30.503698    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-295217-openshift-default-79478c4677-zs6xf" event={"ID":"d577fce3-f99d-4dc1-9c29-cb6288c0758b","Type":"ContainerStarted","Data":"a95b272eb9b779836197b9f13932aceac9292b4622cd96b70dbba27f22e8ddf3"}
Jul 07 00:28:30.877773 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:28:30.877684    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-295217-openshift-default-79478c4677-zs6xf"
Jul 07 00:28:30.878846 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:28:30.878823    2578 patch_prober.go:28] interesting pod/e2e-api-b-295217-openshift-default-79478c4677-zs6xf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Jul 07 00:28:30.878958 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:28:30.878889    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-295217-openshift-default-79478c4677-zs6xf" podUID="d577fce3-f99d-4dc1-9c29-cb6288c0758b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Jul 07 00:28:31.428031 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:28:31.427996    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-295217-openshift-default-79478c4677-zs6xf"
Jul 07 00:28:31.878220 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:28:31.878123    2578 patch_prober.go:28] interesting pod/e2e-api-b-295217-openshift-default-79478c4677-zs6xf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Jul 07 00:28:31.878220 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:28:31.878212    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-295217-openshift-default-79478c4677-zs6xf" podUID="d577fce3-f99d-4dc1-9c29-cb6288c0758b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Jul 07 00:28:32.878006 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:28:32.877973    2578 patch_prober.go:28] interesting pod/e2e-api-b-295217-openshift-default-79478c4677-zs6xf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Jul 07 00:28:32.878176 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:28:32.878024    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-295217-openshift-default-79478c4677-zs6xf" podUID="d577fce3-f99d-4dc1-9c29-cb6288c0758b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Jul 07 00:28:33.877993 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:28:33.877952    2578 patch_prober.go:28] interesting pod/e2e-api-b-295217-openshift-default-79478c4677-zs6xf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Jul 07 00:28:33.878406 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:28:33.878011    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-295217-openshift-default-79478c4677-zs6xf" podUID="d577fce3-f99d-4dc1-9c29-cb6288c0758b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Jul 07 00:28:34.881651 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:28:34.881563    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-295217-openshift-default-79478c4677-zs6xf"
Jul 07 00:28:34.882637 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:28:34.882609    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-295217-openshift-default-79478c4677-zs6xf"
Jul 07 00:28:42.681189 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:28:42.681155    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-295217-openshift-default-79478c4677-zs6xf"]
Jul 07 00:28:42.681622 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:28:42.681392    2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-295217-openshift-default-79478c4677-zs6xf" podUID="d577fce3-f99d-4dc1-9c29-cb6288c0758b" containerName="istio-proxy" containerID="cri-o://a95b272eb9b779836197b9f13932aceac9292b4622cd96b70dbba27f22e8ddf3" gracePeriod=30
Jul 07 00:28:47.959752 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:28:47.959715    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-295217-openshift-default-79478c4677-zs6xf"
Jul 07 00:28:47.999075 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:28:47.999045    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d577fce3-f99d-4dc1-9c29-cb6288c0758b-istiod-ca-cert\") pod \"d577fce3-f99d-4dc1-9c29-cb6288c0758b\" (UID: \"d577fce3-f99d-4dc1-9c29-cb6288c0758b\") "
Jul 07 00:28:47.999265 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:28:47.999093    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d577fce3-f99d-4dc1-9c29-cb6288c0758b-istio-podinfo\") pod \"d577fce3-f99d-4dc1-9c29-cb6288c0758b\" (UID: \"d577fce3-f99d-4dc1-9c29-cb6288c0758b\") "
Jul 07 00:28:47.999265 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:28:47.999118    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d577fce3-f99d-4dc1-9c29-cb6288c0758b-workload-certs\") pod \"d577fce3-f99d-4dc1-9c29-cb6288c0758b\" (UID: \"d577fce3-f99d-4dc1-9c29-cb6288c0758b\") "
Jul 07 00:28:47.999265 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:28:47.999133    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d577fce3-f99d-4dc1-9c29-cb6288c0758b-credential-socket\") pod \"d577fce3-f99d-4dc1-9c29-cb6288c0758b\" (UID: \"d577fce3-f99d-4dc1-9c29-cb6288c0758b\") "
Jul 07 00:28:47.999265 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:28:47.999175    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d577fce3-f99d-4dc1-9c29-cb6288c0758b-istio-token\") pod \"d577fce3-f99d-4dc1-9c29-cb6288c0758b\" (UID: \"d577fce3-f99d-4dc1-9c29-cb6288c0758b\") "
Jul 07 00:28:47.999265 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:28:47.999199    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d577fce3-f99d-4dc1-9c29-cb6288c0758b-workload-socket\") pod \"d577fce3-f99d-4dc1-9c29-cb6288c0758b\" (UID: \"d577fce3-f99d-4dc1-9c29-cb6288c0758b\") "
Jul 07 00:28:47.999265 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:28:47.999235    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d577fce3-f99d-4dc1-9c29-cb6288c0758b-istio-data\") pod \"d577fce3-f99d-4dc1-9c29-cb6288c0758b\" (UID: \"d577fce3-f99d-4dc1-9c29-cb6288c0758b\") "
Jul 07 00:28:47.999620 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:28:47.999271    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d577fce3-f99d-4dc1-9c29-cb6288c0758b-istio-envoy\") pod \"d577fce3-f99d-4dc1-9c29-cb6288c0758b\" (UID: \"d577fce3-f99d-4dc1-9c29-cb6288c0758b\") "
Jul 07 00:28:47.999620 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:28:47.999367    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ntql4\" (UniqueName: \"kubernetes.io/projected/d577fce3-f99d-4dc1-9c29-cb6288c0758b-kube-api-access-ntql4\") pod \"d577fce3-f99d-4dc1-9c29-cb6288c0758b\" (UID: \"d577fce3-f99d-4dc1-9c29-cb6288c0758b\") "
Jul 07 00:28:47.999620 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:28:47.999540    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d577fce3-f99d-4dc1-9c29-cb6288c0758b-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "d577fce3-f99d-4dc1-9c29-cb6288c0758b" (UID: "d577fce3-f99d-4dc1-9c29-cb6288c0758b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 00:28:47.999620 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:28:47.999578    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d577fce3-f99d-4dc1-9c29-cb6288c0758b-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "d577fce3-f99d-4dc1-9c29-cb6288c0758b" (UID: "d577fce3-f99d-4dc1-9c29-cb6288c0758b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 00:28:47.999834 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:28:47.999659    2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d577fce3-f99d-4dc1-9c29-cb6288c0758b-istiod-ca-cert\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Jul 07 00:28:47.999834 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:28:47.999676    2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d577fce3-f99d-4dc1-9c29-cb6288c0758b-credential-socket\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Jul 07 00:28:47.999834 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:28:47.999760    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d577fce3-f99d-4dc1-9c29-cb6288c0758b-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "d577fce3-f99d-4dc1-9c29-cb6288c0758b" (UID: "d577fce3-f99d-4dc1-9c29-cb6288c0758b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 00:28:47.999834 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:28:47.999779    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d577fce3-f99d-4dc1-9c29-cb6288c0758b-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "d577fce3-f99d-4dc1-9c29-cb6288c0758b" (UID: "d577fce3-f99d-4dc1-9c29-cb6288c0758b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 00:28:48.000508 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:28:48.000459    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d577fce3-f99d-4dc1-9c29-cb6288c0758b-istio-data" (OuterVolumeSpecName: "istio-data") pod "d577fce3-f99d-4dc1-9c29-cb6288c0758b" (UID: "d577fce3-f99d-4dc1-9c29-cb6288c0758b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 00:28:48.001805 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:28:48.001784    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d577fce3-f99d-4dc1-9c29-cb6288c0758b-kube-api-access-ntql4" (OuterVolumeSpecName: "kube-api-access-ntql4") pod "d577fce3-f99d-4dc1-9c29-cb6288c0758b" (UID: "d577fce3-f99d-4dc1-9c29-cb6288c0758b"). InnerVolumeSpecName "kube-api-access-ntql4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 00:28:48.001805 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:28:48.001784    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d577fce3-f99d-4dc1-9c29-cb6288c0758b-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "d577fce3-f99d-4dc1-9c29-cb6288c0758b" (UID: "d577fce3-f99d-4dc1-9c29-cb6288c0758b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 00:28:48.002216 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:28:48.002188    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d577fce3-f99d-4dc1-9c29-cb6288c0758b-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "d577fce3-f99d-4dc1-9c29-cb6288c0758b" (UID: "d577fce3-f99d-4dc1-9c29-cb6288c0758b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 07 00:28:48.002216 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:28:48.002194    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d577fce3-f99d-4dc1-9c29-cb6288c0758b-istio-token" (OuterVolumeSpecName: "istio-token") pod "d577fce3-f99d-4dc1-9c29-cb6288c0758b" (UID: "d577fce3-f99d-4dc1-9c29-cb6288c0758b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 00:28:48.100917 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:28:48.100888    2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d577fce3-f99d-4dc1-9c29-cb6288c0758b-istio-token\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Jul 07 00:28:48.100917 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:28:48.100917    2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d577fce3-f99d-4dc1-9c29-cb6288c0758b-workload-socket\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Jul 07 00:28:48.100917 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:28:48.100925    2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d577fce3-f99d-4dc1-9c29-cb6288c0758b-istio-data\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Jul 07 00:28:48.101156 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:28:48.100933    2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d577fce3-f99d-4dc1-9c29-cb6288c0758b-istio-envoy\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Jul 07 00:28:48.101156 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:28:48.100943    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ntql4\" (UniqueName: \"kubernetes.io/projected/d577fce3-f99d-4dc1-9c29-cb6288c0758b-kube-api-access-ntql4\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Jul 07 00:28:48.101156 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:28:48.100951    2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d577fce3-f99d-4dc1-9c29-cb6288c0758b-istio-podinfo\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Jul 07 00:28:48.101156 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:28:48.100959    2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d577fce3-f99d-4dc1-9c29-cb6288c0758b-workload-certs\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Jul 07 00:28:48.606528 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:28:48.606493    2578 generic.go:356] "Generic (PLEG): container finished" podID="d577fce3-f99d-4dc1-9c29-cb6288c0758b" containerID="a95b272eb9b779836197b9f13932aceac9292b4622cd96b70dbba27f22e8ddf3" exitCode=0
Jul 07 00:28:48.606694 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:28:48.606543    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-295217-openshift-default-79478c4677-zs6xf"
Jul 07 00:28:48.606694 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:28:48.606566    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-295217-openshift-default-79478c4677-zs6xf" event={"ID":"d577fce3-f99d-4dc1-9c29-cb6288c0758b","Type":"ContainerDied","Data":"a95b272eb9b779836197b9f13932aceac9292b4622cd96b70dbba27f22e8ddf3"}
Jul 07 00:28:48.606694 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:28:48.606608    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-295217-openshift-default-79478c4677-zs6xf" event={"ID":"d577fce3-f99d-4dc1-9c29-cb6288c0758b","Type":"ContainerDied","Data":"9213c14a340971f50258ad1dd89e27fb6091916642c4db62143d3d6cf808fede"}
Jul 07 00:28:48.606694 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:28:48.606631    2578 scope.go:117] "RemoveContainer" containerID="a95b272eb9b779836197b9f13932aceac9292b4622cd96b70dbba27f22e8ddf3"
Jul 07 00:28:48.615467 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:28:48.615447    2578 scope.go:117] "RemoveContainer" containerID="046d02e88a0dc203c9bb6fba5104d6028450fb9f1dd97a7a34335c0834e6eafb"
Jul 07 00:28:48.624109 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:28:48.624080    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-295217-openshift-default-79478c4677-zs6xf"]
Jul 07 00:28:48.624727 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:28:48.624707    2578 scope.go:117] "RemoveContainer" containerID="a95b272eb9b779836197b9f13932aceac9292b4622cd96b70dbba27f22e8ddf3"
Jul 07 00:28:48.625057 ip-10-0-129-23 kubenswrapper[2578]: E0707 00:28:48.625029    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a95b272eb9b779836197b9f13932aceac9292b4622cd96b70dbba27f22e8ddf3\": container with ID starting with a95b272eb9b779836197b9f13932aceac9292b4622cd96b70dbba27f22e8ddf3 not found: ID does not exist" containerID="a95b272eb9b779836197b9f13932aceac9292b4622cd96b70dbba27f22e8ddf3"
Jul 07 00:28:48.625165 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:28:48.625067    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a95b272eb9b779836197b9f13932aceac9292b4622cd96b70dbba27f22e8ddf3"} err="failed to get container status \"a95b272eb9b779836197b9f13932aceac9292b4622cd96b70dbba27f22e8ddf3\": rpc error: code = NotFound desc = could not find container \"a95b272eb9b779836197b9f13932aceac9292b4622cd96b70dbba27f22e8ddf3\": container with ID starting with a95b272eb9b779836197b9f13932aceac9292b4622cd96b70dbba27f22e8ddf3 not found: ID does not exist"
Jul 07 00:28:48.625165 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:28:48.625104    2578 scope.go:117] "RemoveContainer" containerID="046d02e88a0dc203c9bb6fba5104d6028450fb9f1dd97a7a34335c0834e6eafb"
Jul 07 00:28:48.626425 ip-10-0-129-23 kubenswrapper[2578]: E0707 00:28:48.625746    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"046d02e88a0dc203c9bb6fba5104d6028450fb9f1dd97a7a34335c0834e6eafb\": container with ID starting with 046d02e88a0dc203c9bb6fba5104d6028450fb9f1dd97a7a34335c0834e6eafb not found: ID does not exist" containerID="046d02e88a0dc203c9bb6fba5104d6028450fb9f1dd97a7a34335c0834e6eafb"
Jul 07 00:28:48.626651 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:28:48.625784    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"046d02e88a0dc203c9bb6fba5104d6028450fb9f1dd97a7a34335c0834e6eafb"} err="failed to get container status \"046d02e88a0dc203c9bb6fba5104d6028450fb9f1dd97a7a34335c0834e6eafb\": rpc error: code = NotFound desc = could not find container \"046d02e88a0dc203c9bb6fba5104d6028450fb9f1dd97a7a34335c0834e6eafb\": container with ID starting with 046d02e88a0dc203c9bb6fba5104d6028450fb9f1dd97a7a34335c0834e6eafb not found: ID does not exist"
Jul 07 00:28:48.629916 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:28:48.629889    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-295217-openshift-default-79478c4677-zs6xf"]
Jul 07 00:28:50.391348 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:28:50.391313    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d577fce3-f99d-4dc1-9c29-cb6288c0758b" path="/var/lib/kubelet/pods/d577fce3-f99d-4dc1-9c29-cb6288c0758b/volumes"
Jul 07 00:28:51.677873 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:28:51.677839    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-4e3cf5-openshift-default-5f475db9f-dmxq2"]
Jul 07 00:28:51.678938 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:28:51.678909    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d577fce3-f99d-4dc1-9c29-cb6288c0758b" containerName="istio-proxy"
Jul 07 00:28:51.678938 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:28:51.678934    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="d577fce3-f99d-4dc1-9c29-cb6288c0758b" containerName="istio-proxy"
Jul 07 00:28:51.679123 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:28:51.678959    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d577fce3-f99d-4dc1-9c29-cb6288c0758b" containerName="istio-proxy"
Jul 07 00:28:51.679123 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:28:51.678967    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="d577fce3-f99d-4dc1-9c29-cb6288c0758b" containerName="istio-proxy"
Jul 07 00:28:51.679123 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:28:51.679061    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="d577fce3-f99d-4dc1-9c29-cb6288c0758b" containerName="istio-proxy"
Jul 07 00:28:51.679123 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:28:51.679074    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="d577fce3-f99d-4dc1-9c29-cb6288c0758b" containerName="istio-proxy"
Jul 07 00:28:51.679123 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:28:51.679087    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="67ddb01d-bedf-46a7-96d1-b6a41aa61398" containerName="istio-proxy"
Jul 07 00:28:51.684254 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:28:51.684232    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-4e3cf5-openshift-default-5f475db9f-dmxq2"
Jul 07 00:28:51.687219 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:28:51.687198    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 07 00:28:51.687489 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:28:51.687213    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-4e3cf5-openshift-default-dockercfg-6w5zq\""
Jul 07 00:28:51.693817 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:28:51.693790    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-4e3cf5-openshift-default-5f475db9f-dmxq2"]
Jul 07 00:28:51.731374 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:28:51.731343    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0042a321-f6ae-4b0d-8011-10ed1f6cf904-workload-certs\") pod \"e2e-shared-b-4e3cf5-openshift-default-5f475db9f-dmxq2\" (UID: \"0042a321-f6ae-4b0d-8011-10ed1f6cf904\") " pod="openshift-ingress/e2e-shared-b-4e3cf5-openshift-default-5f475db9f-dmxq2"
Jul 07 00:28:51.731526 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:28:51.731406    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0042a321-f6ae-4b0d-8011-10ed1f6cf904-istio-envoy\") pod \"e2e-shared-b-4e3cf5-openshift-default-5f475db9f-dmxq2\" (UID: \"0042a321-f6ae-4b0d-8011-10ed1f6cf904\") " pod="openshift-ingress/e2e-shared-b-4e3cf5-openshift-default-5f475db9f-dmxq2"
Jul 07 00:28:51.731526 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:28:51.731472    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0042a321-f6ae-4b0d-8011-10ed1f6cf904-istio-podinfo\") pod \"e2e-shared-b-4e3cf5-openshift-default-5f475db9f-dmxq2\" (UID: \"0042a321-f6ae-4b0d-8011-10ed1f6cf904\") " pod="openshift-ingress/e2e-shared-b-4e3cf5-openshift-default-5f475db9f-dmxq2"
Jul 07 00:28:51.731526 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:28:51.731512    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0042a321-f6ae-4b0d-8011-10ed1f6cf904-istiod-ca-cert\") pod \"e2e-shared-b-4e3cf5-openshift-default-5f475db9f-dmxq2\" (UID: \"0042a321-f6ae-4b0d-8011-10ed1f6cf904\") " pod="openshift-ingress/e2e-shared-b-4e3cf5-openshift-default-5f475db9f-dmxq2"
Jul 07 00:28:51.731634 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:28:51.731610    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0042a321-f6ae-4b0d-8011-10ed1f6cf904-workload-socket\") pod \"e2e-shared-b-4e3cf5-openshift-default-5f475db9f-dmxq2\" (UID: \"0042a321-f6ae-4b0d-8011-10ed1f6cf904\") " pod="openshift-ingress/e2e-shared-b-4e3cf5-openshift-default-5f475db9f-dmxq2"
Jul 07 00:28:51.731671 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:28:51.731632    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0042a321-f6ae-4b0d-8011-10ed1f6cf904-istio-token\") pod \"e2e-shared-b-4e3cf5-openshift-default-5f475db9f-dmxq2\" (UID: \"0042a321-f6ae-4b0d-8011-10ed1f6cf904\") " pod="openshift-ingress/e2e-shared-b-4e3cf5-openshift-default-5f475db9f-dmxq2"
Jul 07 00:28:51.731671 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:28:51.731651    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lbm98\" (UniqueName: \"kubernetes.io/projected/0042a321-f6ae-4b0d-8011-10ed1f6cf904-kube-api-access-lbm98\") pod \"e2e-shared-b-4e3cf5-openshift-default-5f475db9f-dmxq2\" (UID: \"0042a321-f6ae-4b0d-8011-10ed1f6cf904\") " pod="openshift-ingress/e2e-shared-b-4e3cf5-openshift-default-5f475db9f-dmxq2"
Jul 07 00:28:51.731736 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:28:51.731672    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0042a321-f6ae-4b0d-8011-10ed1f6cf904-credential-socket\") pod \"e2e-shared-b-4e3cf5-openshift-default-5f475db9f-dmxq2\" (UID: \"0042a321-f6ae-4b0d-8011-10ed1f6cf904\") " pod="openshift-ingress/e2e-shared-b-4e3cf5-openshift-default-5f475db9f-dmxq2"
Jul 07 00:28:51.731736 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:28:51.731686    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0042a321-f6ae-4b0d-8011-10ed1f6cf904-istio-data\") pod \"e2e-shared-b-4e3cf5-openshift-default-5f475db9f-dmxq2\" (UID: \"0042a321-f6ae-4b0d-8011-10ed1f6cf904\") " pod="openshift-ingress/e2e-shared-b-4e3cf5-openshift-default-5f475db9f-dmxq2"
Jul 07 00:28:51.832786 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:28:51.832744    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0042a321-f6ae-4b0d-8011-10ed1f6cf904-istio-envoy\") pod \"e2e-shared-b-4e3cf5-openshift-default-5f475db9f-dmxq2\" (UID: \"0042a321-f6ae-4b0d-8011-10ed1f6cf904\") " pod="openshift-ingress/e2e-shared-b-4e3cf5-openshift-default-5f475db9f-dmxq2"
Jul 07 00:28:51.832786 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:28:51.832784    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0042a321-f6ae-4b0d-8011-10ed1f6cf904-istio-podinfo\") pod \"e2e-shared-b-4e3cf5-openshift-default-5f475db9f-dmxq2\" (UID: \"0042a321-f6ae-4b0d-8011-10ed1f6cf904\") " pod="openshift-ingress/e2e-shared-b-4e3cf5-openshift-default-5f475db9f-dmxq2"
Jul 07 00:28:51.833038 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:28:51.832812    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0042a321-f6ae-4b0d-8011-10ed1f6cf904-istiod-ca-cert\") pod \"e2e-shared-b-4e3cf5-openshift-default-5f475db9f-dmxq2\" (UID: \"0042a321-f6ae-4b0d-8011-10ed1f6cf904\") " pod="openshift-ingress/e2e-shared-b-4e3cf5-openshift-default-5f475db9f-dmxq2"
Jul 07 00:28:51.833038 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:28:51.832873    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0042a321-f6ae-4b0d-8011-10ed1f6cf904-workload-socket\") pod \"e2e-shared-b-4e3cf5-openshift-default-5f475db9f-dmxq2\" (UID: \"0042a321-f6ae-4b0d-8011-10ed1f6cf904\") " pod="openshift-ingress/e2e-shared-b-4e3cf5-openshift-default-5f475db9f-dmxq2"
Jul 07 00:28:51.833038 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:28:51.832890    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0042a321-f6ae-4b0d-8011-10ed1f6cf904-istio-token\") pod \"e2e-shared-b-4e3cf5-openshift-default-5f475db9f-dmxq2\" (UID: \"0042a321-f6ae-4b0d-8011-10ed1f6cf904\") " pod="openshift-ingress/e2e-shared-b-4e3cf5-openshift-default-5f475db9f-dmxq2"
Jul 07 00:28:51.833038 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:28:51.832915    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lbm98\" (UniqueName: \"kubernetes.io/projected/0042a321-f6ae-4b0d-8011-10ed1f6cf904-kube-api-access-lbm98\") pod \"e2e-shared-b-4e3cf5-openshift-default-5f475db9f-dmxq2\" (UID: \"0042a321-f6ae-4b0d-8011-10ed1f6cf904\") " pod="openshift-ingress/e2e-shared-b-4e3cf5-openshift-default-5f475db9f-dmxq2"
Jul 07 00:28:51.833038 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:28:51.832947    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0042a321-f6ae-4b0d-8011-10ed1f6cf904-credential-socket\") pod \"e2e-shared-b-4e3cf5-openshift-default-5f475db9f-dmxq2\" (UID: \"0042a321-f6ae-4b0d-8011-10ed1f6cf904\") " pod="openshift-ingress/e2e-shared-b-4e3cf5-openshift-default-5f475db9f-dmxq2"
Jul 07 00:28:51.833038 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:28:51.832973    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0042a321-f6ae-4b0d-8011-10ed1f6cf904-istio-data\") pod \"e2e-shared-b-4e3cf5-openshift-default-5f475db9f-dmxq2\" (UID: \"0042a321-f6ae-4b0d-8011-10ed1f6cf904\") " pod="openshift-ingress/e2e-shared-b-4e3cf5-openshift-default-5f475db9f-dmxq2"
Jul 07 00:28:51.833038 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:28:51.832999    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0042a321-f6ae-4b0d-8011-10ed1f6cf904-workload-certs\") pod \"e2e-shared-b-4e3cf5-openshift-default-5f475db9f-dmxq2\" (UID: \"0042a321-f6ae-4b0d-8011-10ed1f6cf904\") " pod="openshift-ingress/e2e-shared-b-4e3cf5-openshift-default-5f475db9f-dmxq2"
Jul 07 00:28:51.833405 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:28:51.833324    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0042a321-f6ae-4b0d-8011-10ed1f6cf904-workload-socket\") pod \"e2e-shared-b-4e3cf5-openshift-default-5f475db9f-dmxq2\" (UID: \"0042a321-f6ae-4b0d-8011-10ed1f6cf904\") " pod="openshift-ingress/e2e-shared-b-4e3cf5-openshift-default-5f475db9f-dmxq2"
Jul 07 00:28:51.833466 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:28:51.833402    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0042a321-f6ae-4b0d-8011-10ed1f6cf904-credential-socket\") pod \"e2e-shared-b-4e3cf5-openshift-default-5f475db9f-dmxq2\" (UID: \"0042a321-f6ae-4b0d-8011-10ed1f6cf904\") " pod="openshift-ingress/e2e-shared-b-4e3cf5-openshift-default-5f475db9f-dmxq2"
Jul 07 00:28:51.833466 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:28:51.833420    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0042a321-f6ae-4b0d-8011-10ed1f6cf904-workload-certs\") pod \"e2e-shared-b-4e3cf5-openshift-default-5f475db9f-dmxq2\" (UID: \"0042a321-f6ae-4b0d-8011-10ed1f6cf904\") " pod="openshift-ingress/e2e-shared-b-4e3cf5-openshift-default-5f475db9f-dmxq2"
Jul 07 00:28:51.833572 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:28:51.833486    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0042a321-f6ae-4b0d-8011-10ed1f6cf904-istio-data\") pod \"e2e-shared-b-4e3cf5-openshift-default-5f475db9f-dmxq2\" (UID: \"0042a321-f6ae-4b0d-8011-10ed1f6cf904\") " pod="openshift-ingress/e2e-shared-b-4e3cf5-openshift-default-5f475db9f-dmxq2"
Jul 07 00:28:51.833941 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:28:51.833919    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0042a321-f6ae-4b0d-8011-10ed1f6cf904-istiod-ca-cert\") pod \"e2e-shared-b-4e3cf5-openshift-default-5f475db9f-dmxq2\" (UID: \"0042a321-f6ae-4b0d-8011-10ed1f6cf904\") " pod="openshift-ingress/e2e-shared-b-4e3cf5-openshift-default-5f475db9f-dmxq2"
Jul 07 00:28:51.835987 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:28:51.835962    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0042a321-f6ae-4b0d-8011-10ed1f6cf904-istio-envoy\") pod \"e2e-shared-b-4e3cf5-openshift-default-5f475db9f-dmxq2\" (UID: \"0042a321-f6ae-4b0d-8011-10ed1f6cf904\") " pod="openshift-ingress/e2e-shared-b-4e3cf5-openshift-default-5f475db9f-dmxq2"
Jul 07 00:28:51.836106 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:28:51.836080    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0042a321-f6ae-4b0d-8011-10ed1f6cf904-istio-podinfo\") pod \"e2e-shared-b-4e3cf5-openshift-default-5f475db9f-dmxq2\" (UID: \"0042a321-f6ae-4b0d-8011-10ed1f6cf904\") " pod="openshift-ingress/e2e-shared-b-4e3cf5-openshift-default-5f475db9f-dmxq2"
Jul 07 00:28:51.840716 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:28:51.840693    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0042a321-f6ae-4b0d-8011-10ed1f6cf904-istio-token\") pod \"e2e-shared-b-4e3cf5-openshift-default-5f475db9f-dmxq2\" (UID: \"0042a321-f6ae-4b0d-8011-10ed1f6cf904\") " pod="openshift-ingress/e2e-shared-b-4e3cf5-openshift-default-5f475db9f-dmxq2"
Jul 07 00:28:51.841456 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:28:51.841435    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lbm98\" (UniqueName: \"kubernetes.io/projected/0042a321-f6ae-4b0d-8011-10ed1f6cf904-kube-api-access-lbm98\") pod \"e2e-shared-b-4e3cf5-openshift-default-5f475db9f-dmxq2\" (UID: \"0042a321-f6ae-4b0d-8011-10ed1f6cf904\") " pod="openshift-ingress/e2e-shared-b-4e3cf5-openshift-default-5f475db9f-dmxq2"
Jul 07 00:28:51.997716 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:28:51.997613    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-4e3cf5-openshift-default-5f475db9f-dmxq2"
Jul 07 00:28:52.156123 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:28:52.156093    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-4e3cf5-openshift-default-5f475db9f-dmxq2"]
Jul 07 00:28:52.158652 ip-10-0-129-23 kubenswrapper[2578]: W0707 00:28:52.158628    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0042a321_f6ae_4b0d_8011_10ed1f6cf904.slice/crio-87b4163517d72cfe3952dbed4a75c281148d0592f1036af509e20d0a16b732e0 WatchSource:0}: Error finding container 87b4163517d72cfe3952dbed4a75c281148d0592f1036af509e20d0a16b732e0: Status 404 returned error can't find the container with id 87b4163517d72cfe3952dbed4a75c281148d0592f1036af509e20d0a16b732e0
Jul 07 00:28:52.161114 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:28:52.161083    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892172Ki","pods":"250"}
Jul 07 00:28:52.161219 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:28:52.161163    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892172Ki","pods":"250"}
Jul 07 00:28:52.161219 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:28:52.161209    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892172Ki","pods":"250"}
Jul 07 00:28:52.629777 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:28:52.629735    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-4e3cf5-openshift-default-5f475db9f-dmxq2" event={"ID":"0042a321-f6ae-4b0d-8011-10ed1f6cf904","Type":"ContainerStarted","Data":"9c5bc72aa020c14f6236cf7575ce283d5c4342210107f17619418c0227fbf3d6"}
Jul 07 00:28:52.630026 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:28:52.629788    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-4e3cf5-openshift-default-5f475db9f-dmxq2" event={"ID":"0042a321-f6ae-4b0d-8011-10ed1f6cf904","Type":"ContainerStarted","Data":"87b4163517d72cfe3952dbed4a75c281148d0592f1036af509e20d0a16b732e0"}
Jul 07 00:28:52.653101 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:28:52.653051    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-4e3cf5-openshift-default-5f475db9f-dmxq2" podStartSLOduration=1.653036084 podStartE2EDuration="1.653036084s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 00:28:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 00:28:52.649817149 +0000 UTC m=+1998.760890954" watchObservedRunningTime="2026-07-07 00:28:52.653036084 +0000 UTC m=+1998.764109887"
Jul 07 00:28:52.998742 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:28:52.998707    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-4e3cf5-openshift-default-5f475db9f-dmxq2"
Jul 07 00:28:54.003299 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:28:54.003249    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-4e3cf5-openshift-default-5f475db9f-dmxq2"
Jul 07 00:28:54.640420 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:28:54.640392    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-4e3cf5-openshift-default-5f475db9f-dmxq2"
Jul 07 00:28:54.641568 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:28:54.641543    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-4e3cf5-openshift-default-5f475db9f-dmxq2"
Jul 07 00:29:08.716231 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:29:08.716194    2578 generic.go:356] "Generic (PLEG): container finished" podID="0042a321-f6ae-4b0d-8011-10ed1f6cf904" containerID="9c5bc72aa020c14f6236cf7575ce283d5c4342210107f17619418c0227fbf3d6" exitCode=0
Jul 07 00:29:08.716677 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:29:08.716266    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-4e3cf5-openshift-default-5f475db9f-dmxq2" event={"ID":"0042a321-f6ae-4b0d-8011-10ed1f6cf904","Type":"ContainerDied","Data":"9c5bc72aa020c14f6236cf7575ce283d5c4342210107f17619418c0227fbf3d6"}
Jul 07 00:29:08.716677 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:29:08.716629    2578 scope.go:117] "RemoveContainer" containerID="9c5bc72aa020c14f6236cf7575ce283d5c4342210107f17619418c0227fbf3d6"
Jul 07 00:29:08.723822 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:29:08.718089    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892172Ki","pods":"250"}
Jul 07 00:29:08.723822 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:29:08.718258    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892172Ki","pods":"250"}
Jul 07 00:29:08.723822 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:29:08.718374    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892172Ki","pods":"250"}
Jul 07 00:29:09.640309 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:29:09.640257    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-4e3cf5-openshift-default-5f475db9f-dmxq2"
Jul 07 00:29:09.727168 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:29:09.727106    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-4e3cf5-openshift-default-5f475db9f-dmxq2" event={"ID":"0042a321-f6ae-4b0d-8011-10ed1f6cf904","Type":"ContainerStarted","Data":"58efbf33776b9546b9407e82af9824a3b6db2abf6e7d8fd076aab014756ceaee"}
Jul 07 00:29:09.997894 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:29:09.997852    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-4e3cf5-openshift-default-5f475db9f-dmxq2"
Jul 07 00:29:09.999305 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:29:09.999254    2578 patch_prober.go:28] interesting pod/e2e-shared-b-4e3cf5-openshift-default-5f475db9f-dmxq2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body=
Jul 07 00:29:09.999465 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:29:09.999352    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-4e3cf5-openshift-default-5f475db9f-dmxq2" podUID="0042a321-f6ae-4b0d-8011-10ed1f6cf904" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused"
Jul 07 00:29:10.998817 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:29:10.998781    2578 patch_prober.go:28] interesting pod/e2e-shared-b-4e3cf5-openshift-default-5f475db9f-dmxq2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body=
Jul 07 00:29:10.999481 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:29:10.999429    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-4e3cf5-openshift-default-5f475db9f-dmxq2" podUID="0042a321-f6ae-4b0d-8011-10ed1f6cf904" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused"
Jul 07 00:29:11.998238 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:29:11.998196    2578 patch_prober.go:28] interesting pod/e2e-shared-b-4e3cf5-openshift-default-5f475db9f-dmxq2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body=
Jul 07 00:29:11.998571 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:29:11.998538    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-4e3cf5-openshift-default-5f475db9f-dmxq2" podUID="0042a321-f6ae-4b0d-8011-10ed1f6cf904" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused"
Jul 07 00:29:12.998184 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:29:12.998151    2578 patch_prober.go:28] interesting pod/e2e-shared-b-4e3cf5-openshift-default-5f475db9f-dmxq2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body=
Jul 07 00:29:12.998884 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:29:12.998855    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-4e3cf5-openshift-default-5f475db9f-dmxq2" podUID="0042a321-f6ae-4b0d-8011-10ed1f6cf904" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused"
Jul 07 00:29:14.001537 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:29:14.001510    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-4e3cf5-openshift-default-5f475db9f-dmxq2"
Jul 07 00:29:14.002035 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:29:14.002016    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-4e3cf5-openshift-default-5f475db9f-dmxq2"
Jul 07 00:29:14.002575 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:29:14.002558    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-4e3cf5-openshift-default-5f475db9f-dmxq2"
Jul 07 00:30:00.148131 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:30:00.148055    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-b-4e3cf5-29723070-tkrbj"]
Jul 07 00:30:00.151815 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:30:00.151800    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-4e3cf5-29723070-tkrbj"
Jul 07 00:30:00.156261 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:30:00.156237    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-drsk8\""
Jul 07 00:30:00.158169 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:30:00.158148    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29723070-lr52f"]
Jul 07 00:30:00.161538 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:30:00.161523    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29723070-lr52f"
Jul 07 00:30:00.171194 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:30:00.171164    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-a-8714ac-29723070-jtflw"]
Jul 07 00:30:00.178868 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:30:00.178844    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-b-4e3cf5-29723070-tkrbj"]
Jul 07 00:30:00.179077 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:30:00.178944    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29723070-lr52f"]
Jul 07 00:30:00.179077 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:30:00.179030    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-8714ac-29723070-jtflw"
Jul 07 00:30:00.191401 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:30:00.191380    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-a-8714ac-29723070-jtflw"]
Jul 07 00:30:00.207457 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:30:00.207435    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ch8qz\" (UniqueName: \"kubernetes.io/projected/1cb9c176-f91f-47c8-ae3d-97f507bbde0c-kube-api-access-ch8qz\") pod \"maas-api-key-cleanup-e2e-shared-b-4e3cf5-29723070-tkrbj\" (UID: \"1cb9c176-f91f-47c8-ae3d-97f507bbde0c\") " pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-4e3cf5-29723070-tkrbj"
Jul 07 00:30:00.207603 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:30:00.207581    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qzbpk\" (UniqueName: \"kubernetes.io/projected/876b3398-b382-438c-95e3-43a321d77a51-kube-api-access-qzbpk\") pod \"maas-api-key-cleanup-29723070-lr52f\" (UID: \"876b3398-b382-438c-95e3-43a321d77a51\") " pod="opendatahub/maas-api-key-cleanup-29723070-lr52f"
Jul 07 00:30:00.308835 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:30:00.308810    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qzbpk\" (UniqueName: \"kubernetes.io/projected/876b3398-b382-438c-95e3-43a321d77a51-kube-api-access-qzbpk\") pod \"maas-api-key-cleanup-29723070-lr52f\" (UID: \"876b3398-b382-438c-95e3-43a321d77a51\") " pod="opendatahub/maas-api-key-cleanup-29723070-lr52f"
Jul 07 00:30:00.308933 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:30:00.308845    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zlmxq\" (UniqueName: \"kubernetes.io/projected/b49a9a73-4d86-42fc-938b-3015c13857c9-kube-api-access-zlmxq\") pod \"maas-api-key-cleanup-e2e-shared-a-8714ac-29723070-jtflw\" (UID: \"b49a9a73-4d86-42fc-938b-3015c13857c9\") " pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-8714ac-29723070-jtflw"
Jul 07 00:30:00.308933 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:30:00.308889    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ch8qz\" (UniqueName: \"kubernetes.io/projected/1cb9c176-f91f-47c8-ae3d-97f507bbde0c-kube-api-access-ch8qz\") pod \"maas-api-key-cleanup-e2e-shared-b-4e3cf5-29723070-tkrbj\" (UID: \"1cb9c176-f91f-47c8-ae3d-97f507bbde0c\") " pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-4e3cf5-29723070-tkrbj"
Jul 07 00:30:00.318025 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:30:00.317999    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ch8qz\" (UniqueName: \"kubernetes.io/projected/1cb9c176-f91f-47c8-ae3d-97f507bbde0c-kube-api-access-ch8qz\") pod \"maas-api-key-cleanup-e2e-shared-b-4e3cf5-29723070-tkrbj\" (UID: \"1cb9c176-f91f-47c8-ae3d-97f507bbde0c\") " pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-4e3cf5-29723070-tkrbj"
Jul 07 00:30:00.318178 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:30:00.318160    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qzbpk\" (UniqueName: \"kubernetes.io/projected/876b3398-b382-438c-95e3-43a321d77a51-kube-api-access-qzbpk\") pod \"maas-api-key-cleanup-29723070-lr52f\" (UID: \"876b3398-b382-438c-95e3-43a321d77a51\") " pod="opendatahub/maas-api-key-cleanup-29723070-lr52f"
Jul 07 00:30:00.410187 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:30:00.410165    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zlmxq\" (UniqueName: \"kubernetes.io/projected/b49a9a73-4d86-42fc-938b-3015c13857c9-kube-api-access-zlmxq\") pod \"maas-api-key-cleanup-e2e-shared-a-8714ac-29723070-jtflw\" (UID: \"b49a9a73-4d86-42fc-938b-3015c13857c9\") " pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-8714ac-29723070-jtflw"
Jul 07 00:30:00.419253 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:30:00.419226    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zlmxq\" (UniqueName: \"kubernetes.io/projected/b49a9a73-4d86-42fc-938b-3015c13857c9-kube-api-access-zlmxq\") pod \"maas-api-key-cleanup-e2e-shared-a-8714ac-29723070-jtflw\" (UID: \"b49a9a73-4d86-42fc-938b-3015c13857c9\") " pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-8714ac-29723070-jtflw"
Jul 07 00:30:00.462630 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:30:00.462613    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-4e3cf5-29723070-tkrbj"
Jul 07 00:30:00.477507 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:30:00.477489    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29723070-lr52f"
Jul 07 00:30:00.488478 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:30:00.488403    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-8714ac-29723070-jtflw"
Jul 07 00:30:00.623753 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:30:00.623650    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-b-4e3cf5-29723070-tkrbj"]
Jul 07 00:30:00.627574 ip-10-0-129-23 kubenswrapper[2578]: W0707 00:30:00.626995    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1cb9c176_f91f_47c8_ae3d_97f507bbde0c.slice/crio-170177c679d381919c2e420c791d14774744bb544245607e2a2ab1fd558939fe WatchSource:0}: Error finding container 170177c679d381919c2e420c791d14774744bb544245607e2a2ab1fd558939fe: Status 404 returned error can't find the container with id 170177c679d381919c2e420c791d14774744bb544245607e2a2ab1fd558939fe
Jul 07 00:30:00.682885 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:30:00.682861    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-a-8714ac-29723070-jtflw"]
Jul 07 00:30:00.684401 ip-10-0-129-23 kubenswrapper[2578]: W0707 00:30:00.684375    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb49a9a73_4d86_42fc_938b_3015c13857c9.slice/crio-f84be9edf24abe59a18ac598a693b65254bdac662fa3826a5e35cceacadf993b WatchSource:0}: Error finding container f84be9edf24abe59a18ac598a693b65254bdac662fa3826a5e35cceacadf993b: Status 404 returned error can't find the container with id f84be9edf24abe59a18ac598a693b65254bdac662fa3826a5e35cceacadf993b
Jul 07 00:30:00.860565 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:30:00.860540    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29723070-lr52f"]
Jul 07 00:30:00.886441 ip-10-0-129-23 kubenswrapper[2578]: W0707 00:30:00.886409    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod876b3398_b382_438c_95e3_43a321d77a51.slice/crio-6dce84ec7fae57326b6ae1fbb30b72a17761741487661c6c1423ab6299af26a7 WatchSource:0}: Error finding container 6dce84ec7fae57326b6ae1fbb30b72a17761741487661c6c1423ab6299af26a7: Status 404 returned error can't find the container with id 6dce84ec7fae57326b6ae1fbb30b72a17761741487661c6c1423ab6299af26a7
Jul 07 00:30:00.991573 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:30:00.991541    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-4e3cf5-29723070-tkrbj" event={"ID":"1cb9c176-f91f-47c8-ae3d-97f507bbde0c","Type":"ContainerStarted","Data":"65f2a127e46eaf2be081e14dd7cc12dbab81fd2683c09d0b1a323db324ab6d0a"}
Jul 07 00:30:00.991732 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:30:00.991602    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-4e3cf5-29723070-tkrbj" event={"ID":"1cb9c176-f91f-47c8-ae3d-97f507bbde0c","Type":"ContainerStarted","Data":"170177c679d381919c2e420c791d14774744bb544245607e2a2ab1fd558939fe"}
Jul 07 00:30:00.992696 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:30:00.992671    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-8714ac-29723070-jtflw" event={"ID":"b49a9a73-4d86-42fc-938b-3015c13857c9","Type":"ContainerStarted","Data":"f84be9edf24abe59a18ac598a693b65254bdac662fa3826a5e35cceacadf993b"}
Jul 07 00:30:00.993955 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:30:00.993846    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29723070-lr52f" event={"ID":"876b3398-b382-438c-95e3-43a321d77a51","Type":"ContainerStarted","Data":"6dce84ec7fae57326b6ae1fbb30b72a17761741487661c6c1423ab6299af26a7"}
Jul 07 00:30:01.006032 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:30:01.005986    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-4e3cf5-29723070-tkrbj" podStartSLOduration=1.005968284 podStartE2EDuration="1.005968284s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 00:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 00:30:01.005354646 +0000 UTC m=+2067.116428451" watchObservedRunningTime="2026-07-07 00:30:01.005968284 +0000 UTC m=+2067.117042088"
Jul 07 00:30:02.000265 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:30:02.000234    2578 generic.go:356] "Generic (PLEG): container finished" podID="b49a9a73-4d86-42fc-938b-3015c13857c9" containerID="4d915c4284266b74d95e38639e9d0adc673d49956e7670b4d66873029e9969c4" exitCode=0
Jul 07 00:30:02.000634 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:30:02.000326    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-8714ac-29723070-jtflw" event={"ID":"b49a9a73-4d86-42fc-938b-3015c13857c9","Type":"ContainerDied","Data":"4d915c4284266b74d95e38639e9d0adc673d49956e7670b4d66873029e9969c4"}
Jul 07 00:30:02.001846 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:30:02.001824    2578 generic.go:356] "Generic (PLEG): container finished" podID="876b3398-b382-438c-95e3-43a321d77a51" containerID="e2e7e9b1748e8da9a6ac25aa539cf66ce2571903d9af8c6bf9f2cff24568595d" exitCode=0
Jul 07 00:30:02.001955 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:30:02.001904    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29723070-lr52f" event={"ID":"876b3398-b382-438c-95e3-43a321d77a51","Type":"ContainerDied","Data":"e2e7e9b1748e8da9a6ac25aa539cf66ce2571903d9af8c6bf9f2cff24568595d"}
Jul 07 00:30:02.003501 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:30:02.003475    2578 generic.go:356] "Generic (PLEG): container finished" podID="1cb9c176-f91f-47c8-ae3d-97f507bbde0c" containerID="65f2a127e46eaf2be081e14dd7cc12dbab81fd2683c09d0b1a323db324ab6d0a" exitCode=0
Jul 07 00:30:02.003595 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:30:02.003544    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-4e3cf5-29723070-tkrbj" event={"ID":"1cb9c176-f91f-47c8-ae3d-97f507bbde0c","Type":"ContainerDied","Data":"65f2a127e46eaf2be081e14dd7cc12dbab81fd2683c09d0b1a323db324ab6d0a"}
Jul 07 00:30:03.168509 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:30:03.168483    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29723070-lr52f"
Jul 07 00:30:03.179675 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:30:03.179649    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-8714ac-29723070-jtflw"
Jul 07 00:30:03.208126 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:30:03.208103    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-4e3cf5-29723070-tkrbj"
Jul 07 00:30:03.235838 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:30:03.235813    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zlmxq\" (UniqueName: \"kubernetes.io/projected/b49a9a73-4d86-42fc-938b-3015c13857c9-kube-api-access-zlmxq\") pod \"b49a9a73-4d86-42fc-938b-3015c13857c9\" (UID: \"b49a9a73-4d86-42fc-938b-3015c13857c9\") "
Jul 07 00:30:03.235988 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:30:03.235871    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qzbpk\" (UniqueName: \"kubernetes.io/projected/876b3398-b382-438c-95e3-43a321d77a51-kube-api-access-qzbpk\") pod \"876b3398-b382-438c-95e3-43a321d77a51\" (UID: \"876b3398-b382-438c-95e3-43a321d77a51\") "
Jul 07 00:30:03.238023 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:30:03.237995    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/876b3398-b382-438c-95e3-43a321d77a51-kube-api-access-qzbpk" (OuterVolumeSpecName: "kube-api-access-qzbpk") pod "876b3398-b382-438c-95e3-43a321d77a51" (UID: "876b3398-b382-438c-95e3-43a321d77a51"). InnerVolumeSpecName "kube-api-access-qzbpk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 00:30:03.238023 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:30:03.238011    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b49a9a73-4d86-42fc-938b-3015c13857c9-kube-api-access-zlmxq" (OuterVolumeSpecName: "kube-api-access-zlmxq") pod "b49a9a73-4d86-42fc-938b-3015c13857c9" (UID: "b49a9a73-4d86-42fc-938b-3015c13857c9"). InnerVolumeSpecName "kube-api-access-zlmxq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 00:30:03.337177 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:30:03.337084    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ch8qz\" (UniqueName: \"kubernetes.io/projected/1cb9c176-f91f-47c8-ae3d-97f507bbde0c-kube-api-access-ch8qz\") pod \"1cb9c176-f91f-47c8-ae3d-97f507bbde0c\" (UID: \"1cb9c176-f91f-47c8-ae3d-97f507bbde0c\") "
Jul 07 00:30:03.337346 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:30:03.337330    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zlmxq\" (UniqueName: \"kubernetes.io/projected/b49a9a73-4d86-42fc-938b-3015c13857c9-kube-api-access-zlmxq\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Jul 07 00:30:03.337425 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:30:03.337358    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qzbpk\" (UniqueName: \"kubernetes.io/projected/876b3398-b382-438c-95e3-43a321d77a51-kube-api-access-qzbpk\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Jul 07 00:30:03.339241 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:30:03.339215    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1cb9c176-f91f-47c8-ae3d-97f507bbde0c-kube-api-access-ch8qz" (OuterVolumeSpecName: "kube-api-access-ch8qz") pod "1cb9c176-f91f-47c8-ae3d-97f507bbde0c" (UID: "1cb9c176-f91f-47c8-ae3d-97f507bbde0c"). InnerVolumeSpecName "kube-api-access-ch8qz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 00:30:03.437882 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:30:03.437852    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ch8qz\" (UniqueName: \"kubernetes.io/projected/1cb9c176-f91f-47c8-ae3d-97f507bbde0c-kube-api-access-ch8qz\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Jul 07 00:30:04.016597 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:30:04.016566    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-8714ac-29723070-jtflw"
Jul 07 00:30:04.016783 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:30:04.016560    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-8714ac-29723070-jtflw" event={"ID":"b49a9a73-4d86-42fc-938b-3015c13857c9","Type":"ContainerDied","Data":"f84be9edf24abe59a18ac598a693b65254bdac662fa3826a5e35cceacadf993b"}
Jul 07 00:30:04.016783 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:30:04.016704    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f84be9edf24abe59a18ac598a693b65254bdac662fa3826a5e35cceacadf993b"
Jul 07 00:30:04.017944 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:30:04.017926    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29723070-lr52f"
Jul 07 00:30:04.018059 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:30:04.017967    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29723070-lr52f" event={"ID":"876b3398-b382-438c-95e3-43a321d77a51","Type":"ContainerDied","Data":"6dce84ec7fae57326b6ae1fbb30b72a17761741487661c6c1423ab6299af26a7"}
Jul 07 00:30:04.018059 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:30:04.018013    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6dce84ec7fae57326b6ae1fbb30b72a17761741487661c6c1423ab6299af26a7"
Jul 07 00:30:04.019362 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:30:04.019331    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-4e3cf5-29723070-tkrbj" event={"ID":"1cb9c176-f91f-47c8-ae3d-97f507bbde0c","Type":"ContainerDied","Data":"170177c679d381919c2e420c791d14774744bb544245607e2a2ab1fd558939fe"}
Jul 07 00:30:04.019448 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:30:04.019376    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="170177c679d381919c2e420c791d14774744bb544245607e2a2ab1fd558939fe"
Jul 07 00:30:04.019448 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:30:04.019391    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-4e3cf5-29723070-tkrbj"
Jul 07 00:30:34.498940 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:30:34.498913    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-7gjwb_1116f765-1ebd-4c12-9ebb-ed7b7760391c/console-operator/1.log"
Jul 07 00:30:34.503356 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:30:34.503325    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jfngf_aba6ad45-845e-4916-8cf1-b8c76da93308/ovn-acl-logging/0.log"
Jul 07 00:30:34.505389 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:30:34.505364    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-7gjwb_1116f765-1ebd-4c12-9ebb-ed7b7760391c/console-operator/1.log"
Jul 07 00:30:34.509598 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:30:34.509582    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jfngf_aba6ad45-845e-4916-8cf1-b8c76da93308/ovn-acl-logging/0.log"
Jul 07 00:34:52.371803 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:34:52.371767    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-a-8714ac-29723070-jtflw"]
Jul 07 00:34:52.377561 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:34:52.377530    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-a-8714ac-29723070-jtflw"]
Jul 07 00:34:52.391889 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:34:52.391864    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b49a9a73-4d86-42fc-938b-3015c13857c9" path="/var/lib/kubelet/pods/b49a9a73-4d86-42fc-938b-3015c13857c9/volumes"
Jul 07 00:35:34.538001 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:35:34.537977    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-7gjwb_1116f765-1ebd-4c12-9ebb-ed7b7760391c/console-operator/1.log"
Jul 07 00:35:34.542337 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:35:34.542317    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jfngf_aba6ad45-845e-4916-8cf1-b8c76da93308/ovn-acl-logging/0.log"
Jul 07 00:35:34.545232 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:35:34.545216    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-7gjwb_1116f765-1ebd-4c12-9ebb-ed7b7760391c/console-operator/1.log"
Jul 07 00:35:34.548576 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:35:34.548560    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jfngf_aba6ad45-845e-4916-8cf1-b8c76da93308/ovn-acl-logging/0.log"
Jul 07 00:35:35.357603 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:35:35.357570    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-b-4e3cf5-29723070-tkrbj"]
Jul 07 00:35:35.363759 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:35:35.363734    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-b-4e3cf5-29723070-tkrbj"]
Jul 07 00:35:36.391543 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:35:36.391507    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1cb9c176-f91f-47c8-ae3d-97f507bbde0c" path="/var/lib/kubelet/pods/1cb9c176-f91f-47c8-ae3d-97f507bbde0c/volumes"
Jul 07 00:35:41.162588 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:35:41.162558    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-4e3cf5-openshift-default-5f475db9f-dmxq2"]
Jul 07 00:35:41.163063 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:35:41.162834    2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-4e3cf5-openshift-default-5f475db9f-dmxq2" podUID="0042a321-f6ae-4b0d-8011-10ed1f6cf904" containerName="istio-proxy" containerID="cri-o://58efbf33776b9546b9407e82af9824a3b6db2abf6e7d8fd076aab014756ceaee" gracePeriod=30
Jul 07 00:35:41.880171 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:35:41.880141    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5d947bf65f-x68c7_ff3ba37a-518f-4809-b5a9-bea66923d0d8/authorino/0.log"
Jul 07 00:35:44.004807 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:35:44.004772    2578 patch_prober.go:28] interesting pod/e2e-shared-b-4e3cf5-openshift-default-5f475db9f-dmxq2 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 07 00:35:44.005167 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:35:44.004830    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-4e3cf5-openshift-default-5f475db9f-dmxq2" podUID="0042a321-f6ae-4b0d-8011-10ed1f6cf904" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 07 00:35:46.435818 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:35:46.435756    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-4e3cf5-openshift-default-5f475db9f-dmxq2"
Jul 07 00:35:46.469232 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:35:46.469207    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-wvtzc_7135e168-178f-4853-bbf5-3b276fe3d092/manager/0.log"
Jul 07 00:35:46.617836 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:35:46.617811    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0042a321-f6ae-4b0d-8011-10ed1f6cf904-workload-certs\") pod \"0042a321-f6ae-4b0d-8011-10ed1f6cf904\" (UID: \"0042a321-f6ae-4b0d-8011-10ed1f6cf904\") "
Jul 07 00:35:46.617974 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:35:46.617850    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0042a321-f6ae-4b0d-8011-10ed1f6cf904-istiod-ca-cert\") pod \"0042a321-f6ae-4b0d-8011-10ed1f6cf904\" (UID: \"0042a321-f6ae-4b0d-8011-10ed1f6cf904\") "
Jul 07 00:35:46.617974 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:35:46.617872    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0042a321-f6ae-4b0d-8011-10ed1f6cf904-istio-token\") pod \"0042a321-f6ae-4b0d-8011-10ed1f6cf904\" (UID: \"0042a321-f6ae-4b0d-8011-10ed1f6cf904\") "
Jul 07 00:35:46.617974 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:35:46.617896    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lbm98\" (UniqueName: \"kubernetes.io/projected/0042a321-f6ae-4b0d-8011-10ed1f6cf904-kube-api-access-lbm98\") pod \"0042a321-f6ae-4b0d-8011-10ed1f6cf904\" (UID: \"0042a321-f6ae-4b0d-8011-10ed1f6cf904\") "
Jul 07 00:35:46.617974 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:35:46.617957    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0042a321-f6ae-4b0d-8011-10ed1f6cf904-workload-socket\") pod \"0042a321-f6ae-4b0d-8011-10ed1f6cf904\" (UID: \"0042a321-f6ae-4b0d-8011-10ed1f6cf904\") "
Jul 07 00:35:46.618193 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:35:46.618000    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0042a321-f6ae-4b0d-8011-10ed1f6cf904-credential-socket\") pod \"0042a321-f6ae-4b0d-8011-10ed1f6cf904\" (UID: \"0042a321-f6ae-4b0d-8011-10ed1f6cf904\") "
Jul 07 00:35:46.618193 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:35:46.618032    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0042a321-f6ae-4b0d-8011-10ed1f6cf904-istio-envoy\") pod \"0042a321-f6ae-4b0d-8011-10ed1f6cf904\" (UID: \"0042a321-f6ae-4b0d-8011-10ed1f6cf904\") "
Jul 07 00:35:46.618193 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:35:46.618071    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0042a321-f6ae-4b0d-8011-10ed1f6cf904-istio-podinfo\") pod \"0042a321-f6ae-4b0d-8011-10ed1f6cf904\" (UID: \"0042a321-f6ae-4b0d-8011-10ed1f6cf904\") "
Jul 07 00:35:46.618193 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:35:46.618114    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0042a321-f6ae-4b0d-8011-10ed1f6cf904-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "0042a321-f6ae-4b0d-8011-10ed1f6cf904" (UID: "0042a321-f6ae-4b0d-8011-10ed1f6cf904"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 00:35:46.618193 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:35:46.618136    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0042a321-f6ae-4b0d-8011-10ed1f6cf904-istio-data\") pod \"0042a321-f6ae-4b0d-8011-10ed1f6cf904\" (UID: \"0042a321-f6ae-4b0d-8011-10ed1f6cf904\") "
Jul 07 00:35:46.618525 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:35:46.618198    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0042a321-f6ae-4b0d-8011-10ed1f6cf904-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "0042a321-f6ae-4b0d-8011-10ed1f6cf904" (UID: "0042a321-f6ae-4b0d-8011-10ed1f6cf904"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 00:35:46.618580 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:35:46.618530    2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0042a321-f6ae-4b0d-8011-10ed1f6cf904-workload-certs\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Jul 07 00:35:46.618580 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:35:46.618549    2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0042a321-f6ae-4b0d-8011-10ed1f6cf904-istiod-ca-cert\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Jul 07 00:35:46.618580 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:35:46.618552    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0042a321-f6ae-4b0d-8011-10ed1f6cf904-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "0042a321-f6ae-4b0d-8011-10ed1f6cf904" (UID: "0042a321-f6ae-4b0d-8011-10ed1f6cf904"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 00:35:46.618731 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:35:46.618374    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0042a321-f6ae-4b0d-8011-10ed1f6cf904-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "0042a321-f6ae-4b0d-8011-10ed1f6cf904" (UID: "0042a321-f6ae-4b0d-8011-10ed1f6cf904"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 00:35:46.618988 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:35:46.618966    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0042a321-f6ae-4b0d-8011-10ed1f6cf904-istio-data" (OuterVolumeSpecName: "istio-data") pod "0042a321-f6ae-4b0d-8011-10ed1f6cf904" (UID: "0042a321-f6ae-4b0d-8011-10ed1f6cf904"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 00:35:46.620417 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:35:46.620393    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0042a321-f6ae-4b0d-8011-10ed1f6cf904-kube-api-access-lbm98" (OuterVolumeSpecName: "kube-api-access-lbm98") pod "0042a321-f6ae-4b0d-8011-10ed1f6cf904" (UID: "0042a321-f6ae-4b0d-8011-10ed1f6cf904"). InnerVolumeSpecName "kube-api-access-lbm98". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 00:35:46.620505 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:35:46.620432    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/0042a321-f6ae-4b0d-8011-10ed1f6cf904-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "0042a321-f6ae-4b0d-8011-10ed1f6cf904" (UID: "0042a321-f6ae-4b0d-8011-10ed1f6cf904"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 07 00:35:46.620636 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:35:46.620594    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0042a321-f6ae-4b0d-8011-10ed1f6cf904-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "0042a321-f6ae-4b0d-8011-10ed1f6cf904" (UID: "0042a321-f6ae-4b0d-8011-10ed1f6cf904"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 00:35:46.620749 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:35:46.620695    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0042a321-f6ae-4b0d-8011-10ed1f6cf904-istio-token" (OuterVolumeSpecName: "istio-token") pod "0042a321-f6ae-4b0d-8011-10ed1f6cf904" (UID: "0042a321-f6ae-4b0d-8011-10ed1f6cf904"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 00:35:46.719870 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:35:46.719814    2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0042a321-f6ae-4b0d-8011-10ed1f6cf904-istio-data\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Jul 07 00:35:46.719870 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:35:46.719835    2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0042a321-f6ae-4b0d-8011-10ed1f6cf904-istio-token\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Jul 07 00:35:46.719870 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:35:46.719844    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lbm98\" (UniqueName: \"kubernetes.io/projected/0042a321-f6ae-4b0d-8011-10ed1f6cf904-kube-api-access-lbm98\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Jul 07 00:35:46.719870 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:35:46.719854    2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0042a321-f6ae-4b0d-8011-10ed1f6cf904-workload-socket\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Jul 07 00:35:46.719870 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:35:46.719862    2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0042a321-f6ae-4b0d-8011-10ed1f6cf904-credential-socket\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Jul 07 00:35:46.719870 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:35:46.719870    2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0042a321-f6ae-4b0d-8011-10ed1f6cf904-istio-envoy\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Jul 07 00:35:46.720160 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:35:46.719877    2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0042a321-f6ae-4b0d-8011-10ed1f6cf904-istio-podinfo\") on node \"ip-10-0-129-23.ec2.internal\" DevicePath \"\""
Jul 07 00:35:46.793853 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:35:46.793829    2578 generic.go:356] "Generic (PLEG): container finished" podID="0042a321-f6ae-4b0d-8011-10ed1f6cf904" containerID="58efbf33776b9546b9407e82af9824a3b6db2abf6e7d8fd076aab014756ceaee" exitCode=0
Jul 07 00:35:46.793978 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:35:46.793885    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-4e3cf5-openshift-default-5f475db9f-dmxq2"
Jul 07 00:35:46.793978 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:35:46.793886    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-4e3cf5-openshift-default-5f475db9f-dmxq2" event={"ID":"0042a321-f6ae-4b0d-8011-10ed1f6cf904","Type":"ContainerDied","Data":"58efbf33776b9546b9407e82af9824a3b6db2abf6e7d8fd076aab014756ceaee"}
Jul 07 00:35:46.793978 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:35:46.793955    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-4e3cf5-openshift-default-5f475db9f-dmxq2" event={"ID":"0042a321-f6ae-4b0d-8011-10ed1f6cf904","Type":"ContainerDied","Data":"87b4163517d72cfe3952dbed4a75c281148d0592f1036af509e20d0a16b732e0"}
Jul 07 00:35:46.794148 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:35:46.793985    2578 scope.go:117] "RemoveContainer" containerID="58efbf33776b9546b9407e82af9824a3b6db2abf6e7d8fd076aab014756ceaee"
Jul 07 00:35:46.803725 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:35:46.803711    2578 scope.go:117] "RemoveContainer" containerID="9c5bc72aa020c14f6236cf7575ce283d5c4342210107f17619418c0227fbf3d6"
Jul 07 00:35:46.811568 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:35:46.811553    2578 scope.go:117] "RemoveContainer" containerID="58efbf33776b9546b9407e82af9824a3b6db2abf6e7d8fd076aab014756ceaee"
Jul 07 00:35:46.811798 ip-10-0-129-23 kubenswrapper[2578]: E0707 00:35:46.811779    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"58efbf33776b9546b9407e82af9824a3b6db2abf6e7d8fd076aab014756ceaee\": container with ID starting with 58efbf33776b9546b9407e82af9824a3b6db2abf6e7d8fd076aab014756ceaee not found: ID does not exist" containerID="58efbf33776b9546b9407e82af9824a3b6db2abf6e7d8fd076aab014756ceaee"
Jul 07 00:35:46.811857 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:35:46.811804    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"58efbf33776b9546b9407e82af9824a3b6db2abf6e7d8fd076aab014756ceaee"} err="failed to get container status \"58efbf33776b9546b9407e82af9824a3b6db2abf6e7d8fd076aab014756ceaee\": rpc error: code = NotFound desc = could not find container \"58efbf33776b9546b9407e82af9824a3b6db2abf6e7d8fd076aab014756ceaee\": container with ID starting with 58efbf33776b9546b9407e82af9824a3b6db2abf6e7d8fd076aab014756ceaee not found: ID does not exist"
Jul 07 00:35:46.811857 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:35:46.811822    2578 scope.go:117] "RemoveContainer" containerID="9c5bc72aa020c14f6236cf7575ce283d5c4342210107f17619418c0227fbf3d6"
Jul 07 00:35:46.812060 ip-10-0-129-23 kubenswrapper[2578]: E0707 00:35:46.812043    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9c5bc72aa020c14f6236cf7575ce283d5c4342210107f17619418c0227fbf3d6\": container with ID starting with 9c5bc72aa020c14f6236cf7575ce283d5c4342210107f17619418c0227fbf3d6 not found: ID does not exist" containerID="9c5bc72aa020c14f6236cf7575ce283d5c4342210107f17619418c0227fbf3d6"
Jul 07 00:35:46.812100 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:35:46.812066    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9c5bc72aa020c14f6236cf7575ce283d5c4342210107f17619418c0227fbf3d6"} err="failed to get container status \"9c5bc72aa020c14f6236cf7575ce283d5c4342210107f17619418c0227fbf3d6\": rpc error: code = NotFound desc = could not find container \"9c5bc72aa020c14f6236cf7575ce283d5c4342210107f17619418c0227fbf3d6\": container with ID starting with 9c5bc72aa020c14f6236cf7575ce283d5c4342210107f17619418c0227fbf3d6 not found: ID does not exist"
Jul 07 00:35:46.815998 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:35:46.815978    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-4e3cf5-openshift-default-5f475db9f-dmxq2"]
Jul 07 00:35:46.819396 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:35:46.819376    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-4e3cf5-openshift-default-5f475db9f-dmxq2"]
Jul 07 00:35:46.837803 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:35:46.837784    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29723055-h7qmq_d1981b93-40dd-447c-b685-f69866ad555a/cleanup/0.log"
Jul 07 00:35:46.946929 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:35:46.946900    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29723070-lr52f_876b3398-b382-438c-95e3-43a321d77a51/cleanup/0.log"
Jul 07 00:35:47.193325 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:35:47.193276    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-d45td_bcf0d312-3c6f-4957-a89f-5a42f0006234/server/0.log"
Jul 07 00:35:47.314840 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:35:47.314808    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-tzspq_63651ffc-300b-4230-9312-ade865fc5899/manager/0.log"
Jul 07 00:35:47.559132 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:35:47.559061    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7c7bd8fcf-klksd_47e6beea-776b-4056-b752-be71200243f0/copy-manifests/0.log"
Jul 07 00:35:47.571311 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:35:47.571274    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7c7bd8fcf-klksd_47e6beea-776b-4056-b752-be71200243f0/manager/0.log"
Jul 07 00:35:47.828365 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:35:47.828263    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-s89xw_6fea54f1-781a-4801-85e8-12bef29fb813/postgres/0.log"
Jul 07 00:35:48.390702 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:35:48.390670    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0042a321-f6ae-4b0d-8011-10ed1f6cf904" path="/var/lib/kubelet/pods/0042a321-f6ae-4b0d-8011-10ed1f6cf904/volumes"
Jul 07 00:35:49.139332 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:35:49.139307    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5d947bf65f-x68c7_ff3ba37a-518f-4809-b5a9-bea66923d0d8/authorino/0.log"
Jul 07 00:35:49.252465 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:35:49.252437    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-b94qb_6bd24b30-85df-4a48-83ed-9e16227218b2/manager/0.log"
Jul 07 00:35:49.367639 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:35:49.367613    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-mrsp7_b9748d6e-0ead-4547-850e-1bf9702e6ae6/manager/0.log"
Jul 07 00:35:49.597439 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:35:49.597412    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-cl88r_47f95e09-5bf3-4a3e-a14b-af8c2b283342/registry-server/0.log"
Jul 07 00:35:49.720864 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:35:49.720837    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-7rbdd_3b5ca87a-58b0-4523-ac4b-c49abeb73229/manager/0.log"
Jul 07 00:35:49.943715 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:35:49.943687    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-8spt2_30f3c9fc-59c8-438c-8916-65f5643fdc17/manager/0.log"
Jul 07 00:35:50.654842 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:35:50.654794    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6b5dbc58cc-wkjrt_d017afd4-b38e-4958-b388-fda5b252cceb/kube-auth-proxy/0.log"
Jul 07 00:35:51.032725 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:35:51.032644    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-7d9nx_9e105368-9b09-41df-8ae9-30432841931f/payload-processing/0.log"
Jul 07 00:35:51.144791 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:35:51.144761    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-ff7bb96c-8p6lk_0aaa04d0-1e6e-42c1-887b-bb6b96c8ea4a/router/0.log"
Jul 07 00:35:51.599043 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:35:51.599016    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-skxq9_543fcf9f-27d0-486e-ac37-3413ba2a4275/main/0.log"
Jul 07 00:35:55.885875 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:35:55.885802    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-5sg4w/must-gather-wm2gl"]
Jul 07 00:35:55.886219 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:35:55.886152    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0042a321-f6ae-4b0d-8011-10ed1f6cf904" containerName="istio-proxy"
Jul 07 00:35:55.886219 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:35:55.886162    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="0042a321-f6ae-4b0d-8011-10ed1f6cf904" containerName="istio-proxy"
Jul 07 00:35:55.886219 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:35:55.886170    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="876b3398-b382-438c-95e3-43a321d77a51" containerName="cleanup"
Jul 07 00:35:55.886219 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:35:55.886175    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="876b3398-b382-438c-95e3-43a321d77a51" containerName="cleanup"
Jul 07 00:35:55.886219 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:35:55.886194    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b49a9a73-4d86-42fc-938b-3015c13857c9" containerName="cleanup"
Jul 07 00:35:55.886219 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:35:55.886199    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="b49a9a73-4d86-42fc-938b-3015c13857c9" containerName="cleanup"
Jul 07 00:35:55.886219 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:35:55.886214    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1cb9c176-f91f-47c8-ae3d-97f507bbde0c" containerName="cleanup"
Jul 07 00:35:55.886219 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:35:55.886219    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="1cb9c176-f91f-47c8-ae3d-97f507bbde0c" containerName="cleanup"
Jul 07 00:35:55.886510 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:35:55.886277    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="0042a321-f6ae-4b0d-8011-10ed1f6cf904" containerName="istio-proxy"
Jul 07 00:35:55.886510 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:35:55.886301    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="b49a9a73-4d86-42fc-938b-3015c13857c9" containerName="cleanup"
Jul 07 00:35:55.886510 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:35:55.886310    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="1cb9c176-f91f-47c8-ae3d-97f507bbde0c" containerName="cleanup"
Jul 07 00:35:55.886510 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:35:55.886319    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="876b3398-b382-438c-95e3-43a321d77a51" containerName="cleanup"
Jul 07 00:35:55.886510 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:35:55.886328    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="0042a321-f6ae-4b0d-8011-10ed1f6cf904" containerName="istio-proxy"
Jul 07 00:35:55.886510 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:35:55.886403    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0042a321-f6ae-4b0d-8011-10ed1f6cf904" containerName="istio-proxy"
Jul 07 00:35:55.886510 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:35:55.886409    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="0042a321-f6ae-4b0d-8011-10ed1f6cf904" containerName="istio-proxy"
Jul 07 00:35:55.891104 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:35:55.891085    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-5sg4w/must-gather-wm2gl"
Jul 07 00:35:55.893721 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:35:55.893694    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-5sg4w\"/\"openshift-service-ca.crt\""
Jul 07 00:35:55.894822 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:35:55.894798    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-5sg4w\"/\"default-dockercfg-h2ksb\""
Jul 07 00:35:55.894983 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:35:55.894873    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-5sg4w\"/\"kube-root-ca.crt\""
Jul 07 00:35:55.898085 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:35:55.898063    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-5sg4w/must-gather-wm2gl"]
Jul 07 00:35:56.090931 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:35:56.090901    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r7lkc\" (UniqueName: \"kubernetes.io/projected/01138048-7055-4bc1-be30-005739800a8a-kube-api-access-r7lkc\") pod \"must-gather-wm2gl\" (UID: \"01138048-7055-4bc1-be30-005739800a8a\") " pod="openshift-must-gather-5sg4w/must-gather-wm2gl"
Jul 07 00:35:56.091122 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:35:56.091039    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/01138048-7055-4bc1-be30-005739800a8a-must-gather-output\") pod \"must-gather-wm2gl\" (UID: \"01138048-7055-4bc1-be30-005739800a8a\") " pod="openshift-must-gather-5sg4w/must-gather-wm2gl"
Jul 07 00:35:56.191921 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:35:56.191891    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/01138048-7055-4bc1-be30-005739800a8a-must-gather-output\") pod \"must-gather-wm2gl\" (UID: \"01138048-7055-4bc1-be30-005739800a8a\") " pod="openshift-must-gather-5sg4w/must-gather-wm2gl"
Jul 07 00:35:56.192098 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:35:56.191933    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r7lkc\" (UniqueName: \"kubernetes.io/projected/01138048-7055-4bc1-be30-005739800a8a-kube-api-access-r7lkc\") pod \"must-gather-wm2gl\" (UID: \"01138048-7055-4bc1-be30-005739800a8a\") " pod="openshift-must-gather-5sg4w/must-gather-wm2gl"
Jul 07 00:35:56.192218 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:35:56.192196    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/01138048-7055-4bc1-be30-005739800a8a-must-gather-output\") pod \"must-gather-wm2gl\" (UID: \"01138048-7055-4bc1-be30-005739800a8a\") " pod="openshift-must-gather-5sg4w/must-gather-wm2gl"
Jul 07 00:35:56.201168 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:35:56.201145    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r7lkc\" (UniqueName: \"kubernetes.io/projected/01138048-7055-4bc1-be30-005739800a8a-kube-api-access-r7lkc\") pod \"must-gather-wm2gl\" (UID: \"01138048-7055-4bc1-be30-005739800a8a\") " pod="openshift-must-gather-5sg4w/must-gather-wm2gl"
Jul 07 00:35:56.501278 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:35:56.501216    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-5sg4w/must-gather-wm2gl"
Jul 07 00:35:56.631267 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:35:56.631242    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-5sg4w/must-gather-wm2gl"]
Jul 07 00:35:56.633174 ip-10-0-129-23 kubenswrapper[2578]: W0707 00:35:56.633131    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod01138048_7055_4bc1_be30_005739800a8a.slice/crio-ff9eba7d858b408bd5fefa7d9ff9f7ecd805664ac4879eea6642d2ab71cf7763 WatchSource:0}: Error finding container ff9eba7d858b408bd5fefa7d9ff9f7ecd805664ac4879eea6642d2ab71cf7763: Status 404 returned error can't find the container with id ff9eba7d858b408bd5fefa7d9ff9f7ecd805664ac4879eea6642d2ab71cf7763
Jul 07 00:35:56.635099 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:35:56.635081    2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 07 00:35:56.852614 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:35:56.852532    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-5sg4w/must-gather-wm2gl" event={"ID":"01138048-7055-4bc1-be30-005739800a8a","Type":"ContainerStarted","Data":"ff9eba7d858b408bd5fefa7d9ff9f7ecd805664ac4879eea6642d2ab71cf7763"}
Jul 07 00:35:57.863570 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:35:57.863537    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-5sg4w/must-gather-wm2gl" event={"ID":"01138048-7055-4bc1-be30-005739800a8a","Type":"ContainerStarted","Data":"98bcc96b87d99ee15ccbc52139d563562baea17d72d8086956eec0f7cb93d73b"}
Jul 07 00:35:57.863570 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:35:57.863578    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-5sg4w/must-gather-wm2gl" event={"ID":"01138048-7055-4bc1-be30-005739800a8a","Type":"ContainerStarted","Data":"f886844fe1ac73a424dd4d6a61ad99a57e1222e711b726818b32608e53018643"}
Jul 07 00:35:57.880880 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:35:57.880818    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-5sg4w/must-gather-wm2gl" podStartSLOduration=2.172191582 podStartE2EDuration="2.880797898s" totalImagesPullingTime="708.606316ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 00:35:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 00:35:57.878440961 +0000 UTC m=+2423.989514768" watchObservedRunningTime="2026-07-07 00:35:57.880797898 +0000 UTC m=+2423.991871702"
Jul 07 00:35:58.910948 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:35:58.910921    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-cm65t_f6ae72be-9753-46d1-a665-c2124741a26a/global-pull-secret-syncer/0.log"
Jul 07 00:35:59.054594 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:35:59.054546    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-dfsn2_9a5fa453-505c-4742-86da-db343c8d36af/konnectivity-agent/0.log"
Jul 07 00:35:59.109179 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:35:59.109147    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-129-23.ec2.internal_dac848c666487bcdf1b079d63eb47623/haproxy/0.log"
Jul 07 00:36:04.490237 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:36:04.490118    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5d947bf65f-x68c7_ff3ba37a-518f-4809-b5a9-bea66923d0d8/authorino/0.log"
Jul 07 00:36:04.519277 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:36:04.519199    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-b94qb_6bd24b30-85df-4a48-83ed-9e16227218b2/manager/0.log"
Jul 07 00:36:04.552105 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:36:04.552057    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-mrsp7_b9748d6e-0ead-4547-850e-1bf9702e6ae6/manager/0.log"
Jul 07 00:36:04.634556 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:36:04.633457    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-cl88r_47f95e09-5bf3-4a3e-a14b-af8c2b283342/registry-server/0.log"
Jul 07 00:36:04.773368 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:36:04.772971    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-7rbdd_3b5ca87a-58b0-4523-ac4b-c49abeb73229/manager/0.log"
Jul 07 00:36:04.889041 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:36:04.889008    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-8spt2_30f3c9fc-59c8-438c-8916-65f5643fdc17/manager/0.log"
Jul 07 00:36:06.722362 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:36:06.722326    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-64786d9cbb-rzrpw_2a199158-37fe-4467-ae56-2268721f790e/cluster-monitoring-operator/0.log"
Jul 07 00:36:06.883466 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:36:06.883416    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9hvm9_7be84f64-e9a8-4eff-9a80-034b9a7947cd/node-exporter/0.log"
Jul 07 00:36:06.905648 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:36:06.905589    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9hvm9_7be84f64-e9a8-4eff-9a80-034b9a7947cd/kube-rbac-proxy/0.log"
Jul 07 00:36:06.928016 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:36:06.927992    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9hvm9_7be84f64-e9a8-4eff-9a80-034b9a7947cd/init-textfile/0.log"
Jul 07 00:36:07.406041 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:36:07.406001    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-d559d66d5-c2f55_5d6117b2-b79e-4997-852a-df0db2d07b6b/prometheus-operator-admission-webhook/0.log"
Jul 07 00:36:08.807029 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:36:08.807001    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6bffdf9778-f2xzn_7631f141-62e9-410a-ba79-c1bdcad24e4e/networking-console-plugin/0.log"
Jul 07 00:36:08.889663 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:36:08.889629    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-5sg4w/perf-node-gather-daemonset-dxgpx"]
Jul 07 00:36:08.896912 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:36:08.896888    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-5sg4w/perf-node-gather-daemonset-dxgpx"
Jul 07 00:36:08.902914 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:36:08.902889    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-5sg4w/perf-node-gather-daemonset-dxgpx"]
Jul 07 00:36:09.027155 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:36:09.027117    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/17a8d67f-64fc-4844-9e7a-636e8f97da5f-lib-modules\") pod \"perf-node-gather-daemonset-dxgpx\" (UID: \"17a8d67f-64fc-4844-9e7a-636e8f97da5f\") " pod="openshift-must-gather-5sg4w/perf-node-gather-daemonset-dxgpx"
Jul 07 00:36:09.027155 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:36:09.027160    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/17a8d67f-64fc-4844-9e7a-636e8f97da5f-proc\") pod \"perf-node-gather-daemonset-dxgpx\" (UID: \"17a8d67f-64fc-4844-9e7a-636e8f97da5f\") " pod="openshift-must-gather-5sg4w/perf-node-gather-daemonset-dxgpx"
Jul 07 00:36:09.027412 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:36:09.027297    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/17a8d67f-64fc-4844-9e7a-636e8f97da5f-sys\") pod \"perf-node-gather-daemonset-dxgpx\" (UID: \"17a8d67f-64fc-4844-9e7a-636e8f97da5f\") " pod="openshift-must-gather-5sg4w/perf-node-gather-daemonset-dxgpx"
Jul 07 00:36:09.027412 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:36:09.027345    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/17a8d67f-64fc-4844-9e7a-636e8f97da5f-podres\") pod \"perf-node-gather-daemonset-dxgpx\" (UID: \"17a8d67f-64fc-4844-9e7a-636e8f97da5f\") " pod="openshift-must-gather-5sg4w/perf-node-gather-daemonset-dxgpx"
Jul 07 00:36:09.027412 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:36:09.027374    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xx4jm\" (UniqueName: \"kubernetes.io/projected/17a8d67f-64fc-4844-9e7a-636e8f97da5f-kube-api-access-xx4jm\") pod \"perf-node-gather-daemonset-dxgpx\" (UID: \"17a8d67f-64fc-4844-9e7a-636e8f97da5f\") " pod="openshift-must-gather-5sg4w/perf-node-gather-daemonset-dxgpx"
Jul 07 00:36:09.128486 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:36:09.128399    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/17a8d67f-64fc-4844-9e7a-636e8f97da5f-sys\") pod \"perf-node-gather-daemonset-dxgpx\" (UID: \"17a8d67f-64fc-4844-9e7a-636e8f97da5f\") " pod="openshift-must-gather-5sg4w/perf-node-gather-daemonset-dxgpx"
Jul 07 00:36:09.128723 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:36:09.128705    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/17a8d67f-64fc-4844-9e7a-636e8f97da5f-podres\") pod \"perf-node-gather-daemonset-dxgpx\" (UID: \"17a8d67f-64fc-4844-9e7a-636e8f97da5f\") " pod="openshift-must-gather-5sg4w/perf-node-gather-daemonset-dxgpx"
Jul 07 00:36:09.128987 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:36:09.128971    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xx4jm\" (UniqueName: \"kubernetes.io/projected/17a8d67f-64fc-4844-9e7a-636e8f97da5f-kube-api-access-xx4jm\") pod \"perf-node-gather-daemonset-dxgpx\" (UID: \"17a8d67f-64fc-4844-9e7a-636e8f97da5f\") " pod="openshift-must-gather-5sg4w/perf-node-gather-daemonset-dxgpx"
Jul 07 00:36:09.129524 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:36:09.129501    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/17a8d67f-64fc-4844-9e7a-636e8f97da5f-lib-modules\") pod \"perf-node-gather-daemonset-dxgpx\" (UID: \"17a8d67f-64fc-4844-9e7a-636e8f97da5f\") " pod="openshift-must-gather-5sg4w/perf-node-gather-daemonset-dxgpx"
Jul 07 00:36:09.129801 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:36:09.129785    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/17a8d67f-64fc-4844-9e7a-636e8f97da5f-proc\") pod \"perf-node-gather-daemonset-dxgpx\" (UID: \"17a8d67f-64fc-4844-9e7a-636e8f97da5f\") " pod="openshift-must-gather-5sg4w/perf-node-gather-daemonset-dxgpx"
Jul 07 00:36:09.129975 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:36:09.128925    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/17a8d67f-64fc-4844-9e7a-636e8f97da5f-podres\") pod \"perf-node-gather-daemonset-dxgpx\" (UID: \"17a8d67f-64fc-4844-9e7a-636e8f97da5f\") " pod="openshift-must-gather-5sg4w/perf-node-gather-daemonset-dxgpx"
Jul 07 00:36:09.130067 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:36:09.129746    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/17a8d67f-64fc-4844-9e7a-636e8f97da5f-lib-modules\") pod \"perf-node-gather-daemonset-dxgpx\" (UID: \"17a8d67f-64fc-4844-9e7a-636e8f97da5f\") " pod="openshift-must-gather-5sg4w/perf-node-gather-daemonset-dxgpx"
Jul 07 00:36:09.130220 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:36:09.128552    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/17a8d67f-64fc-4844-9e7a-636e8f97da5f-sys\") pod \"perf-node-gather-daemonset-dxgpx\" (UID: \"17a8d67f-64fc-4844-9e7a-636e8f97da5f\") " pod="openshift-must-gather-5sg4w/perf-node-gather-daemonset-dxgpx"
Jul 07 00:36:09.130343 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:36:09.130183    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/17a8d67f-64fc-4844-9e7a-636e8f97da5f-proc\") pod \"perf-node-gather-daemonset-dxgpx\" (UID: \"17a8d67f-64fc-4844-9e7a-636e8f97da5f\") " pod="openshift-must-gather-5sg4w/perf-node-gather-daemonset-dxgpx"
Jul 07 00:36:09.137963 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:36:09.137915    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xx4jm\" (UniqueName: \"kubernetes.io/projected/17a8d67f-64fc-4844-9e7a-636e8f97da5f-kube-api-access-xx4jm\") pod \"perf-node-gather-daemonset-dxgpx\" (UID: \"17a8d67f-64fc-4844-9e7a-636e8f97da5f\") " pod="openshift-must-gather-5sg4w/perf-node-gather-daemonset-dxgpx"
Jul 07 00:36:09.217266 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:36:09.216996    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-5sg4w/perf-node-gather-daemonset-dxgpx"
Jul 07 00:36:09.412252 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:36:09.411473    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-5sg4w/perf-node-gather-daemonset-dxgpx"]
Jul 07 00:36:09.464550 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:36:09.464524    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-7gjwb_1116f765-1ebd-4c12-9ebb-ed7b7760391c/console-operator/1.log"
Jul 07 00:36:09.468648 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:36:09.468600    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-7gjwb_1116f765-1ebd-4c12-9ebb-ed7b7760391c/console-operator/2.log"
Jul 07 00:36:09.971370 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:36:09.971335    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-5sg4w/perf-node-gather-daemonset-dxgpx" event={"ID":"17a8d67f-64fc-4844-9e7a-636e8f97da5f","Type":"ContainerStarted","Data":"3e2c9123d101f5c2c356f14be0b4dcc93840ca1517bef09c8ebc59ac605f1773"}
Jul 07 00:36:09.971791 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:36:09.971396    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-5sg4w/perf-node-gather-daemonset-dxgpx" event={"ID":"17a8d67f-64fc-4844-9e7a-636e8f97da5f","Type":"ContainerStarted","Data":"cfe54651bd145dc8bbda249ed5d0eb5c63b93c2caaa90daae32407df2238ca8a"}
Jul 07 00:36:09.971791 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:36:09.971420    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-5sg4w/perf-node-gather-daemonset-dxgpx"
Jul 07 00:36:09.987621 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:36:09.987576    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-5sg4w/perf-node-gather-daemonset-dxgpx" podStartSLOduration=1.987563194 podStartE2EDuration="1.987563194s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 00:36:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 00:36:09.986373009 +0000 UTC m=+2436.097446826" watchObservedRunningTime="2026-07-07 00:36:09.987563194 +0000 UTC m=+2436.098636998"
Jul 07 00:36:10.012864 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:36:10.012826    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-685bfb5f64-kfp7s_dddc07aa-a6dc-45a8-b146-ee4dba7686eb/download-server/0.log"
Jul 07 00:36:10.603071 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:36:10.603039    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-5d456fdbcd-k2rvp_eef5edeb-c57a-4632-8215-ced4738392a8/volume-data-source-validator/0.log"
Jul 07 00:36:11.592971 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:36:11.592944    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-g7n6m_dd5b072f-a02f-482e-abd1-5dd590d0a93c/dns/0.log"
Jul 07 00:36:11.613432 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:36:11.613407    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-g7n6m_dd5b072f-a02f-482e-abd1-5dd590d0a93c/kube-rbac-proxy/0.log"
Jul 07 00:36:11.734300 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:36:11.734240    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-2h2rk_66f64c88-7770-4613-81c2-97f105d345e5/dns-node-resolver/0.log"
Jul 07 00:36:12.379492 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:36:12.379465    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-qndzw_df4215f7-4f0d-4ba1-b66d-b8902a323531/node-ca/0.log"
Jul 07 00:36:13.467810 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:36:13.467776    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6b5dbc58cc-wkjrt_d017afd4-b38e-4958-b388-fda5b252cceb/kube-auth-proxy/0.log"
Jul 07 00:36:13.616816 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:36:13.616787    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-7d9nx_9e105368-9b09-41df-8ae9-30432841931f/payload-processing/0.log"
Jul 07 00:36:13.640867 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:36:13.640835    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-ff7bb96c-8p6lk_0aaa04d0-1e6e-42c1-887b-bb6b96c8ea4a/router/0.log"
Jul 07 00:36:14.345427 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:36:14.345392    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-d7x6n_f5691201-8c3c-4bd5-8fbb-41e8ddd87e4e/serve-healthcheck-canary/0.log"
Jul 07 00:36:14.821027 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:36:14.821000    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5c847dcfc4-jvf67_38b01eb6-03b7-4fe6-803c-e7cfb4d355a9/insights-operator/0.log"
Jul 07 00:36:14.821561 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:36:14.821547    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5c847dcfc4-jvf67_38b01eb6-03b7-4fe6-803c-e7cfb4d355a9/insights-operator/1.log"
Jul 07 00:36:14.842914 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:36:14.842887    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-cbpw8_79aa8feb-3527-409b-b097-35ce8c0ea0ef/kube-rbac-proxy/0.log"
Jul 07 00:36:14.864338 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:36:14.864310    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-cbpw8_79aa8feb-3527-409b-b097-35ce8c0ea0ef/exporter/0.log"
Jul 07 00:36:14.885934 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:36:14.885905    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-cbpw8_79aa8feb-3527-409b-b097-35ce8c0ea0ef/extractor/0.log"
Jul 07 00:36:15.990908 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:36:15.990882    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-5sg4w/perf-node-gather-daemonset-dxgpx"
Jul 07 00:36:17.169116 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:36:17.169088    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-wvtzc_7135e168-178f-4853-bbf5-3b276fe3d092/manager/0.log"
Jul 07 00:36:17.467760 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:36:17.467685    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29723055-h7qmq_d1981b93-40dd-447c-b685-f69866ad555a/cleanup/0.log"
Jul 07 00:36:17.495802 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:36:17.495768    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29723070-lr52f_876b3398-b382-438c-95e3-43a321d77a51/cleanup/0.log"
Jul 07 00:36:17.628040 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:36:17.628012    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-d45td_bcf0d312-3c6f-4957-a89f-5a42f0006234/server/0.log"
Jul 07 00:36:17.714016 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:36:17.713982    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-tzspq_63651ffc-300b-4230-9312-ade865fc5899/manager/0.log"
Jul 07 00:36:17.872956 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:36:17.872926    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7c7bd8fcf-klksd_47e6beea-776b-4056-b752-be71200243f0/manager/0.log"
Jul 07 00:36:17.889215 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:36:17.889182    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7c7bd8fcf-klksd_47e6beea-776b-4056-b752-be71200243f0/copy-manifests/0.log"
Jul 07 00:36:17.982670 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:36:17.982644    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-s89xw_6fea54f1-781a-4801-85e8-12bef29fb813/postgres/0.log"
Jul 07 00:36:19.310078 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:36:19.310051    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6b5dbc58cc-wkjrt_d017afd4-b38e-4958-b388-fda5b252cceb/kube-auth-proxy/0.log"
Jul 07 00:36:19.436633 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:36:19.436597    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-7d9nx_9e105368-9b09-41df-8ae9-30432841931f/payload-processing/0.log"
Jul 07 00:36:19.451249 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:36:19.451227    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-ff7bb96c-8p6lk_0aaa04d0-1e6e-42c1-887b-bb6b96c8ea4a/router/0.log"
Jul 07 00:36:20.872262 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:36:20.872224    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6b5dbc58cc-wkjrt_d017afd4-b38e-4958-b388-fda5b252cceb/kube-auth-proxy/0.log"
Jul 07 00:36:20.990247 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:36:20.990221    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-7d9nx_9e105368-9b09-41df-8ae9-30432841931f/payload-processing/0.log"
Jul 07 00:36:21.003977 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:36:21.003952    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-ff7bb96c-8p6lk_0aaa04d0-1e6e-42c1-887b-bb6b96c8ea4a/router/0.log"
Jul 07 00:36:24.184382 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:36:24.184359    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-j4xfg_73d747b8-0e1f-42be-842a-bfd851b03297/migrator/0.log"
Jul 07 00:36:24.205406 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:36:24.205380    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-j4xfg_73d747b8-0e1f-42be-842a-bfd851b03297/graceful-termination/0.log"
Jul 07 00:36:24.533055 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:36:24.532991    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-846bf668f7-fzzq2_dff531e0-34c6-4281-8705-149154c350e7/kube-storage-version-migrator-operator/1.log"
Jul 07 00:36:24.533795 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:36:24.533776    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-846bf668f7-fzzq2_dff531e0-34c6-4281-8705-149154c350e7/kube-storage-version-migrator-operator/0.log"
Jul 07 00:36:25.636974 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:36:25.636946    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kmhhp_b9a2aa01-bfc8-40f8-b4d7-962428e95667/kube-multus-additional-cni-plugins/0.log"
Jul 07 00:36:25.657637 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:36:25.657613    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kmhhp_b9a2aa01-bfc8-40f8-b4d7-962428e95667/egress-router-binary-copy/0.log"
Jul 07 00:36:25.678307 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:36:25.678262    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kmhhp_b9a2aa01-bfc8-40f8-b4d7-962428e95667/cni-plugins/0.log"
Jul 07 00:36:25.699378 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:36:25.699356    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kmhhp_b9a2aa01-bfc8-40f8-b4d7-962428e95667/bond-cni-plugin/0.log"
Jul 07 00:36:25.720441 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:36:25.720415    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kmhhp_b9a2aa01-bfc8-40f8-b4d7-962428e95667/routeoverride-cni/0.log"
Jul 07 00:36:25.742866 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:36:25.742845    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kmhhp_b9a2aa01-bfc8-40f8-b4d7-962428e95667/whereabouts-cni-bincopy/0.log"
Jul 07 00:36:25.763989 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:36:25.763967    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kmhhp_b9a2aa01-bfc8-40f8-b4d7-962428e95667/whereabouts-cni/0.log"
Jul 07 00:36:25.959606 ip-10-0-129-23 kubenswrapper[2578]: I0707 00:36:25.959566    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-gk9q8_3afd5761-b4ad-4002-b9e7-d646b63d53f0/kube-multus/0.log"