Jul 02 23:10:13.866556 ip-10-0-135-187 systemd[1]: Starting Kubernetes Kubelet...
Jul 02 23:10:14.241107 ip-10-0-135-187 kubenswrapper[2580]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 02 23:10:14.241107 ip-10-0-135-187 kubenswrapper[2580]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 02 23:10:14.241107 ip-10-0-135-187 kubenswrapper[2580]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 02 23:10:14.241107 ip-10-0-135-187 kubenswrapper[2580]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 02 23:10:14.241107 ip-10-0-135-187 kubenswrapper[2580]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 02 23:10:14.241762 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.241172    2580 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 02 23:10:14.244998 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.244983    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 02 23:10:14.244998 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.244998    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 02 23:10:14.245066 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.245002    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 02 23:10:14.245066 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.245005    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 02 23:10:14.245066 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.245010    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 02 23:10:14.245066 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.245018    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 02 23:10:14.245066 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.245022    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 02 23:10:14.245066 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.245025    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 02 23:10:14.245066 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.245028    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 02 23:10:14.245066 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.245031    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 02 23:10:14.245066 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.245034    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 02 23:10:14.245066 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.245036    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 02 23:10:14.245066 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.245039    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 02 23:10:14.245066 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.245042    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 02 23:10:14.245066 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.245044    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 02 23:10:14.245066 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.245047    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 02 23:10:14.245066 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.245049    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 02 23:10:14.245066 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.245052    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 02 23:10:14.245066 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.245055    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 02 23:10:14.245066 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.245057    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 02 23:10:14.245066 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.245059    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 02 23:10:14.245648 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.245062    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 02 23:10:14.245648 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.245064    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 02 23:10:14.245648 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.245067    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 02 23:10:14.245648 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.245070    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 02 23:10:14.245648 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.245073    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 02 23:10:14.245648 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.245076    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 02 23:10:14.245648 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.245078    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 02 23:10:14.245648 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.245081    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 02 23:10:14.245648 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.245085    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 02 23:10:14.245648 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.245088    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 02 23:10:14.245648 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.245091    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 02 23:10:14.245648 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.245094    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 02 23:10:14.245648 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.245096    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 02 23:10:14.245648 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.245099    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 02 23:10:14.245648 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.245101    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 02 23:10:14.245648 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.245103    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 02 23:10:14.245648 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.245106    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 02 23:10:14.245648 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.245109    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 02 23:10:14.245648 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.245111    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 02 23:10:14.246370 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.245113    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 02 23:10:14.246370 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.245116    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 02 23:10:14.246370 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.245118    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 02 23:10:14.246370 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.245121    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 02 23:10:14.246370 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.245123    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 02 23:10:14.246370 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.245126    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 02 23:10:14.246370 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.245128    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 02 23:10:14.246370 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.245131    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 02 23:10:14.246370 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.245133    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 02 23:10:14.246370 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.245135    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 02 23:10:14.246370 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.245138    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 02 23:10:14.246370 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.245141    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 02 23:10:14.246370 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.245144    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 02 23:10:14.246370 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.245147    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 02 23:10:14.246370 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.245150    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 02 23:10:14.246370 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.245153    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 02 23:10:14.246370 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.245156    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 02 23:10:14.246370 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.245158    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 02 23:10:14.246370 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.245162    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 02 23:10:14.246370 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.245165    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 02 23:10:14.246971 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.245169    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 02 23:10:14.246971 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.245171    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 02 23:10:14.246971 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.245174    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 02 23:10:14.246971 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.245176    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 02 23:10:14.246971 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.245179    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 02 23:10:14.246971 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.245181    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 02 23:10:14.246971 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.245184    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 02 23:10:14.246971 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.245186    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 02 23:10:14.246971 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.245188    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 02 23:10:14.246971 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.245191    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 02 23:10:14.246971 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.245194    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 02 23:10:14.246971 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.245197    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 02 23:10:14.246971 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.245200    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 02 23:10:14.246971 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.245203    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 02 23:10:14.246971 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.245205    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 02 23:10:14.246971 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.245208    2580 feature_gate.go:328] unrecognized feature gate: Example
Jul 02 23:10:14.246971 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.245210    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 02 23:10:14.246971 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.245213    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 02 23:10:14.246971 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.245215    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 02 23:10:14.246971 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.245218    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 02 23:10:14.247466 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.245220    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 02 23:10:14.247466 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.245223    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 02 23:10:14.247466 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.245225    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 02 23:10:14.247466 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.245227    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 02 23:10:14.247466 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.245230    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 02 23:10:14.247466 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.245232    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 02 23:10:14.247466 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.245235    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 02 23:10:14.247466 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.245238    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 02 23:10:14.247466 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.245253    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 02 23:10:14.247466 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.245256    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 02 23:10:14.247466 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.245258    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 02 23:10:14.247466 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.245261    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 02 23:10:14.247466 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.245264    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 02 23:10:14.247466 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.245266    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 02 23:10:14.247466 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.245269    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 02 23:10:14.247466 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.245271    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 02 23:10:14.247466 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.245274    2580 feature_gate.go:328] unrecognized feature gate: Example2
Jul 02 23:10:14.247466 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.245277    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 02 23:10:14.247466 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.245280    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 02 23:10:14.247466 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.247339    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 02 23:10:14.247948 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.247349    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 02 23:10:14.247948 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.247352    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 02 23:10:14.247948 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.247355    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 02 23:10:14.247948 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.247357    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 02 23:10:14.247948 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.247361    2580 feature_gate.go:328] unrecognized feature gate: Example2
Jul 02 23:10:14.247948 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.247364    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 02 23:10:14.247948 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.247367    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 02 23:10:14.247948 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.247370    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 02 23:10:14.247948 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.247372    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 02 23:10:14.247948 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.247375    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 02 23:10:14.247948 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.247377    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 02 23:10:14.247948 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.247380    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 02 23:10:14.247948 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.247382    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 02 23:10:14.247948 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.247386    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 02 23:10:14.247948 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.247388    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 02 23:10:14.247948 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.247391    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 02 23:10:14.247948 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.247394    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 02 23:10:14.247948 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.247396    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 02 23:10:14.247948 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.247400    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 02 23:10:14.247948 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.247402    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 02 23:10:14.248494 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.247405    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 02 23:10:14.248494 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.247407    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 02 23:10:14.248494 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.247410    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 02 23:10:14.248494 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.247413    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 02 23:10:14.248494 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.247415    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 02 23:10:14.248494 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.247418    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 02 23:10:14.248494 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.247420    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 02 23:10:14.248494 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.247423    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 02 23:10:14.248494 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.247425    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 02 23:10:14.248494 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.247428    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 02 23:10:14.248494 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.247430    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 02 23:10:14.248494 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.247433    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 02 23:10:14.248494 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.247436    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 02 23:10:14.248494 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.247438    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 02 23:10:14.248494 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.247441    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 02 23:10:14.248494 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.247443    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 02 23:10:14.248494 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.247446    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 02 23:10:14.248494 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.247448    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 02 23:10:14.248494 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.247451    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 02 23:10:14.248955 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.247453    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 02 23:10:14.248955 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.247456    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 02 23:10:14.248955 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.247458    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 02 23:10:14.248955 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.247461    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 02 23:10:14.248955 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.247463    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 02 23:10:14.248955 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.247466    2580 feature_gate.go:328] unrecognized feature gate: Example
Jul 02 23:10:14.248955 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.247469    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 02 23:10:14.248955 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.247472    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 02 23:10:14.248955 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.247475    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 02 23:10:14.248955 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.247477    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 02 23:10:14.248955 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.247481    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 02 23:10:14.248955 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.247485    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 02 23:10:14.248955 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.247487    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 02 23:10:14.248955 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.247490    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 02 23:10:14.248955 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.247492    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 02 23:10:14.248955 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.247495    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 02 23:10:14.248955 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.247498    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 02 23:10:14.248955 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.247500    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 02 23:10:14.248955 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.247504    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 02 23:10:14.248955 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.247508    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 02 23:10:14.249465 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.247512    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 02 23:10:14.249465 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.247515    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 02 23:10:14.249465 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.247518    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 02 23:10:14.249465 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.247521    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 02 23:10:14.249465 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.247524    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 02 23:10:14.249465 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.247527    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 02 23:10:14.249465 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.247529    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 02 23:10:14.249465 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.247531    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 02 23:10:14.249465 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.247534    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 02 23:10:14.249465 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.247537    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 02 23:10:14.249465 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.247539    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 02 23:10:14.249465 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.247542    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 02 23:10:14.249465 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.247544    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 02 23:10:14.249465 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.247547    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 02 23:10:14.249465 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.247549    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 02 23:10:14.249465 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.247551    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 02 23:10:14.249465 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.247554    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 02 23:10:14.249465 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.247557    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 02 23:10:14.249465 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.247561    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 02 23:10:14.250018 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.247564    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 02 23:10:14.250018 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.247566    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 02 23:10:14.250018 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.247569    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 02 23:10:14.250018 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.247572    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 02 23:10:14.250018 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.247576    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 02 23:10:14.250018 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.247578    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 02 23:10:14.250018 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.247581    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 02 23:10:14.250018 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.247584    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 02 23:10:14.250018 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.247587    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 02 23:10:14.250018 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.247589    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 02 23:10:14.250018 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.247592    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 02 23:10:14.250018 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.247594    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 02 23:10:14.250018 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.247597    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 02 23:10:14.250018 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.247600    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 02 23:10:14.250018 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.247603    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 02 23:10:14.250018 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.247608    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 02 23:10:14.250018 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.247611    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 02 23:10:14.250018 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.247614    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 02 23:10:14.250018 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.247617    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 02 23:10:14.250488 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.247620    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 02 23:10:14.250488 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.248027    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 02 23:10:14.250488 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.248033    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 02 23:10:14.250488 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.248036    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 02 23:10:14.250488 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.248039    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 02 23:10:14.250488 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.248042    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 02 23:10:14.250488 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.248045    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 02 23:10:14.250488 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.248048    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 02 23:10:14.250488 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.248051    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 02 23:10:14.250488 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.248054    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 02 23:10:14.250488 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.248056    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 02 23:10:14.250488 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.248060    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 02 23:10:14.250488 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.248063    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 02 23:10:14.250488 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.248066    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 02 23:10:14.250488 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.248069    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 02 23:10:14.250488 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.248072    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 02 23:10:14.250488 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.248074    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 02 23:10:14.250488 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.248078    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 02 23:10:14.250488 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.248080    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 02 23:10:14.250488 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.248083    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 02 23:10:14.250968 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.248086    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 02 23:10:14.250968 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.248088    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 02 23:10:14.250968 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.248091    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 02 23:10:14.250968 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.248093    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 02 23:10:14.250968 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.248096    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 02 23:10:14.250968 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.248098    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 02 23:10:14.250968 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.248101    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 02 23:10:14.250968 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.248103    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 02 23:10:14.250968 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.248105    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 02 23:10:14.250968 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.248108    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 02 23:10:14.250968 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.248110    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 02 23:10:14.250968 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.248113    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 02 23:10:14.250968 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.248115    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 02 23:10:14.250968 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.248118    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 02 23:10:14.250968 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.248120    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 02 23:10:14.250968 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.248124    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 02 23:10:14.250968 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.248128    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 02 23:10:14.250968 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.248131    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 02 23:10:14.250968 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.248133    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 02 23:10:14.251443 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.248136    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 02 23:10:14.251443 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.248139    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 02 23:10:14.251443 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.248141    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 02 23:10:14.251443 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.248144    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 02 23:10:14.251443 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.248146    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 02 23:10:14.251443 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.248150    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 02 23:10:14.251443 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.248152    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 02 23:10:14.251443 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.248155    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 02 23:10:14.251443 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.248157    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 02 23:10:14.251443 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.248161    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 02 23:10:14.251443 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.248163    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 02 23:10:14.251443 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.248166    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 02 23:10:14.251443 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.248169    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 02 23:10:14.251443 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.248171    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 02 23:10:14.251443 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.248173    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 02 23:10:14.251443 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.248176    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 02 23:10:14.251443 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.248179    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 02 23:10:14.251443 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.248181    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 02 23:10:14.251443 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.248184    2580 feature_gate.go:328] unrecognized feature gate: Example
Jul 02 23:10:14.251443 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.248186    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 02 23:10:14.251922 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.248189    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 02 23:10:14.251922 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.248191    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 02 23:10:14.251922 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.248194    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 02 23:10:14.251922 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.248196    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 02 23:10:14.251922 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.248198    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 02 23:10:14.251922 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.248201    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 02 23:10:14.251922 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.248204    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 02 23:10:14.251922 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.248206    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 02 23:10:14.251922 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.248209    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 02 23:10:14.251922 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.248211    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 02 23:10:14.251922 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.248214    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 02 23:10:14.251922 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.248217    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 02 23:10:14.251922 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.248219    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 02 23:10:14.251922 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.248222    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 02 23:10:14.251922 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.248224    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 02 23:10:14.251922 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.248227    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 02 23:10:14.251922 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.248230    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 02 23:10:14.251922 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.248233    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 02 23:10:14.251922 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.248238    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 02 23:10:14.251922 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.248256    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 02 23:10:14.252410 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.248260    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 02 23:10:14.252410 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.248264    2580 feature_gate.go:328] unrecognized feature gate: Example2
Jul 02 23:10:14.252410 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.248267    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 02 23:10:14.252410 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.248270    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 02 23:10:14.252410 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.248273    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 02 23:10:14.252410 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.248276    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 02 23:10:14.252410 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.248279    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 02 23:10:14.252410 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.248282    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 02 23:10:14.252410 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.248285    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 02 23:10:14.252410 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.248287    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 02 23:10:14.252410 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.248290    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 02 23:10:14.252410 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.248293    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 02 23:10:14.252410 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.248296    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 02 23:10:14.252410 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.248298    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 02 23:10:14.252410 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.248301    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 02 23:10:14.252410 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.248303    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 02 23:10:14.252410 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.248306    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 02 23:10:14.252410 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.248308    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 02 23:10:14.252410 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.248310    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 02 23:10:14.252410 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.248313    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 02 23:10:14.252874 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.248315    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 02 23:10:14.252874 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.248387    2580 flags.go:64] FLAG: --address="0.0.0.0"
Jul 02 23:10:14.252874 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.248395    2580 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 02 23:10:14.252874 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.248401    2580 flags.go:64] FLAG: --anonymous-auth="true"
Jul 02 23:10:14.252874 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.248406    2580 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 02 23:10:14.252874 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.248410    2580 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 02 23:10:14.252874 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.248413    2580 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 02 23:10:14.252874 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.248418    2580 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 02 23:10:14.252874 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.248425    2580 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 02 23:10:14.252874 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.248428    2580 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 02 23:10:14.252874 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.248431    2580 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 02 23:10:14.252874 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.248435    2580 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 02 23:10:14.252874 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.248438    2580 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 02 23:10:14.252874 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.248441    2580 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 02 23:10:14.252874 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.248444    2580 flags.go:64] FLAG: --cgroup-root=""
Jul 02 23:10:14.252874 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.248447    2580 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 02 23:10:14.252874 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.248450    2580 flags.go:64] FLAG: --client-ca-file=""
Jul 02 23:10:14.252874 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.248454    2580 flags.go:64] FLAG: --cloud-provider="external"
Jul 02 23:10:14.252874 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.248457    2580 flags.go:64] FLAG: --cluster-dns="[]"
Jul 02 23:10:14.252874 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.248461    2580 flags.go:64] FLAG: --cluster-domain=""
Jul 02 23:10:14.252874 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.248464    2580 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 02 23:10:14.252874 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.248467    2580 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 02 23:10:14.252874 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.248470    2580 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 02 23:10:14.252874 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.248473    2580 flags.go:64] FLAG: --container-log-max-files="5"
Jul 02 23:10:14.253505 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.248476    2580 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 02 23:10:14.253505 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.248479    2580 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 02 23:10:14.253505 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.248482    2580 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 02 23:10:14.253505 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.248485    2580 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 02 23:10:14.253505 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.248488    2580 flags.go:64] FLAG: --contention-profiling="false"
Jul 02 23:10:14.253505 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.248491    2580 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 02 23:10:14.253505 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.248494    2580 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 02 23:10:14.253505 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.248497    2580 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 02 23:10:14.253505 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.248500    2580 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 02 23:10:14.253505 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.248507    2580 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 02 23:10:14.253505 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.248510    2580 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 02 23:10:14.253505 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.248513    2580 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 02 23:10:14.253505 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.248516    2580 flags.go:64] FLAG: --enable-load-reader="false"
Jul 02 23:10:14.253505 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.248518    2580 flags.go:64] FLAG: --enable-server="true"
Jul 02 23:10:14.253505 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.248521    2580 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 02 23:10:14.253505 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.248526    2580 flags.go:64] FLAG: --event-burst="100"
Jul 02 23:10:14.253505 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.248530    2580 flags.go:64] FLAG: --event-qps="50"
Jul 02 23:10:14.253505 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.248533    2580 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 02 23:10:14.253505 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.248536    2580 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 02 23:10:14.253505 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.248539    2580 flags.go:64] FLAG: --eviction-hard=""
Jul 02 23:10:14.253505 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.248543    2580 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 02 23:10:14.253505 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.248546    2580 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 02 23:10:14.253505 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.248549    2580 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 02 23:10:14.253505 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.248552    2580 flags.go:64] FLAG: --eviction-soft=""
Jul 02 23:10:14.253505 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.248555    2580 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 02 23:10:14.254108 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.248558    2580 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 02 23:10:14.254108 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.248561    2580 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 02 23:10:14.254108 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.248564    2580 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 02 23:10:14.254108 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.248567    2580 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 02 23:10:14.254108 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.248570    2580 flags.go:64] FLAG: --fail-swap-on="true"
Jul 02 23:10:14.254108 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.248573    2580 flags.go:64] FLAG: --feature-gates=""
Jul 02 23:10:14.254108 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.248576    2580 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 02 23:10:14.254108 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.248580    2580 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 02 23:10:14.254108 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.248583    2580 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 02 23:10:14.254108 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.248585    2580 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 02 23:10:14.254108 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.248589    2580 flags.go:64] FLAG: --healthz-port="10248"
Jul 02 23:10:14.254108 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.248591    2580 flags.go:64] FLAG: --help="false"
Jul 02 23:10:14.254108 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.248594    2580 flags.go:64] FLAG: --hostname-override="ip-10-0-135-187.ec2.internal"
Jul 02 23:10:14.254108 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.248597    2580 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 02 23:10:14.254108 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.248600    2580 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 02 23:10:14.254108 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.248603    2580 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 02 23:10:14.254108 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.248606    2580 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 02 23:10:14.254108 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.248609    2580 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 02 23:10:14.254108 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.248612    2580 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 02 23:10:14.254108 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.248615    2580 flags.go:64] FLAG: --image-service-endpoint=""
Jul 02 23:10:14.254108 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.248617    2580 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 02 23:10:14.254108 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.248620    2580 flags.go:64] FLAG: --kube-api-burst="100"
Jul 02 23:10:14.254108 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.248623    2580 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 02 23:10:14.254719 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.248627    2580 flags.go:64] FLAG: --kube-api-qps="50"
Jul 02 23:10:14.254719 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.248630    2580 flags.go:64] FLAG: --kube-reserved=""
Jul 02 23:10:14.254719 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.248633    2580 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 02 23:10:14.254719 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.248636    2580 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 02 23:10:14.254719 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.248639    2580 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 02 23:10:14.254719 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.248642    2580 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 02 23:10:14.254719 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.248644    2580 flags.go:64] FLAG: --lock-file=""
Jul 02 23:10:14.254719 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.248647    2580 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 02 23:10:14.254719 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.248650    2580 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 02 23:10:14.254719 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.248653    2580 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 02 23:10:14.254719 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.248658    2580 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 02 23:10:14.254719 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.248661    2580 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 02 23:10:14.254719 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.248664    2580 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 02 23:10:14.254719 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.248666    2580 flags.go:64] FLAG: --logging-format="text"
Jul 02 23:10:14.254719 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.248669    2580 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 02 23:10:14.254719 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.248673    2580 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 02 23:10:14.254719 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.248676    2580 flags.go:64] FLAG: --manifest-url=""
Jul 02 23:10:14.254719 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.248678    2580 flags.go:64] FLAG: --manifest-url-header=""
Jul 02 23:10:14.254719 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.248683    2580 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 02 23:10:14.254719 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.248685    2580 flags.go:64] FLAG: --max-open-files="1000000"
Jul 02 23:10:14.254719 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.248690    2580 flags.go:64] FLAG: --max-pods="110"
Jul 02 23:10:14.254719 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.248693    2580 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 02 23:10:14.254719 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.248695    2580 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 02 23:10:14.254719 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.248698    2580 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 02 23:10:14.254719 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.248701    2580 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 02 23:10:14.255340 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.248704    2580 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 02 23:10:14.255340 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.248707    2580 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 02 23:10:14.255340 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.248710    2580 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 02 23:10:14.255340 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.248716    2580 flags.go:64] FLAG: --node-status-max-images="50"
Jul 02 23:10:14.255340 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.248719    2580 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 02 23:10:14.255340 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.248722    2580 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 02 23:10:14.255340 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.248726    2580 flags.go:64] FLAG: --pod-cidr=""
Jul 02 23:10:14.255340 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.248729    2580 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5"
Jul 02 23:10:14.255340 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.248735    2580 flags.go:64] FLAG: --pod-manifest-path=""
Jul 02 23:10:14.255340 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.248738    2580 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 02 23:10:14.255340 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.248740    2580 flags.go:64] FLAG: --pods-per-core="0"
Jul 02 23:10:14.255340 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.248744    2580 flags.go:64] FLAG: --port="10250"
Jul 02 23:10:14.255340 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.248747    2580 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 02 23:10:14.255340 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.248750    2580 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0c9c9ddcdd1935c1f"
Jul 02 23:10:14.255340 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.248753    2580 flags.go:64] FLAG: --qos-reserved=""
Jul 02 23:10:14.255340 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.248755    2580 flags.go:64] FLAG: --read-only-port="10255"
Jul 02 23:10:14.255340 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.248758    2580 flags.go:64] FLAG: --register-node="true"
Jul 02 23:10:14.255340 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.248761    2580 flags.go:64] FLAG: --register-with-taints=""
Jul 02 23:10:14.255340 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.248765    2580 flags.go:64] FLAG: --registry-burst="10"
Jul 02 23:10:14.255340 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.248768    2580 flags.go:64] FLAG: --registry-qps="5"
Jul 02 23:10:14.255340 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.248771    2580 flags.go:64] FLAG: --reserved-cpus=""
Jul 02 23:10:14.255340 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.248773    2580 flags.go:64] FLAG: --reserved-memory=""
Jul 02 23:10:14.255340 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.248777    2580 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 02 23:10:14.255340 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.248780    2580 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 02 23:10:14.255340 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.248783    2580 flags.go:64] FLAG: --rotate-certificates="false"
Jul 02 23:10:14.255955 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.248786    2580 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 02 23:10:14.255955 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.248788    2580 flags.go:64] FLAG: --runonce="false"
Jul 02 23:10:14.255955 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.248791    2580 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 02 23:10:14.255955 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.248794    2580 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 02 23:10:14.255955 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.248797    2580 flags.go:64] FLAG: --seccomp-default="false"
Jul 02 23:10:14.255955 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.248800    2580 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 02 23:10:14.255955 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.248802    2580 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 02 23:10:14.255955 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.248805    2580 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 02 23:10:14.255955 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.248808    2580 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 02 23:10:14.255955 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.248811    2580 flags.go:64] FLAG: --storage-driver-password="root"
Jul 02 23:10:14.255955 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.248814    2580 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 02 23:10:14.255955 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.248817    2580 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 02 23:10:14.255955 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.248820    2580 flags.go:64] FLAG: --storage-driver-user="root"
Jul 02 23:10:14.255955 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.248823    2580 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 02 23:10:14.255955 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.248825    2580 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 02 23:10:14.255955 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.248830    2580 flags.go:64] FLAG: --system-cgroups=""
Jul 02 23:10:14.255955 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.248832    2580 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 02 23:10:14.255955 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.248838    2580 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 02 23:10:14.255955 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.248842    2580 flags.go:64] FLAG: --tls-cert-file=""
Jul 02 23:10:14.255955 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.248845    2580 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 02 23:10:14.255955 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.248848    2580 flags.go:64] FLAG: --tls-min-version=""
Jul 02 23:10:14.255955 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.248851    2580 flags.go:64] FLAG: --tls-private-key-file=""
Jul 02 23:10:14.255955 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.248854    2580 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 02 23:10:14.255955 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.248857    2580 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 02 23:10:14.255955 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.248859    2580 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 02 23:10:14.256562 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.248862    2580 flags.go:64] FLAG: --v="2"
Jul 02 23:10:14.256562 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.248867    2580 flags.go:64] FLAG: --version="false"
Jul 02 23:10:14.256562 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.248871    2580 flags.go:64] FLAG: --vmodule=""
Jul 02 23:10:14.256562 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.248875    2580 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 02 23:10:14.256562 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.248878    2580 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 02 23:10:14.256562 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.248996    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 02 23:10:14.256562 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.249000    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 02 23:10:14.256562 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.249003    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 02 23:10:14.256562 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.249006    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 02 23:10:14.256562 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.249009    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 02 23:10:14.256562 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.249011    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 02 23:10:14.256562 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.249014    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 02 23:10:14.256562 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.249016    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 02 23:10:14.256562 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.249019    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 02 23:10:14.256562 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.249022    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 02 23:10:14.256562 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.249024    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 02 23:10:14.256562 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.249027    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 02 23:10:14.256562 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.249029    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 02 23:10:14.256562 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.249032    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 02 23:10:14.256562 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.249035    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 02 23:10:14.256562 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.249037    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 02 23:10:14.257096 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.249039    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 02 23:10:14.257096 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.249044    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 02 23:10:14.257096 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.249048    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 02 23:10:14.257096 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.249051    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 02 23:10:14.257096 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.249055    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 02 23:10:14.257096 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.249057    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 02 23:10:14.257096 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.249060    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 02 23:10:14.257096 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.249062    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 02 23:10:14.257096 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.249066    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 02 23:10:14.257096 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.249069    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 02 23:10:14.257096 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.249072    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 02 23:10:14.257096 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.249075    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 02 23:10:14.257096 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.249078    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 02 23:10:14.257096 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.249080    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 02 23:10:14.257096 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.249083    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 02 23:10:14.257096 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.249086    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 02 23:10:14.257096 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.249088    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 02 23:10:14.257096 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.249091    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 02 23:10:14.257565 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.249095    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 02 23:10:14.257565 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.249098    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 02 23:10:14.257565 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.249101    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 02 23:10:14.257565 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.249103    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 02 23:10:14.257565 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.249106    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 02 23:10:14.257565 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.249108    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 02 23:10:14.257565 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.249111    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 02 23:10:14.257565 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.249113    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 02 23:10:14.257565 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.249116    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 02 23:10:14.257565 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.249118    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 02 23:10:14.257565 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.249121    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 02 23:10:14.257565 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.249123    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 02 23:10:14.257565 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.249126    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 02 23:10:14.257565 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.249128    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 02 23:10:14.257565 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.249131    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 02 23:10:14.257565 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.249133    2580 feature_gate.go:328] unrecognized feature gate: Example
Jul 02 23:10:14.257565 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.249136    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 02 23:10:14.257565 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.249139    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 02 23:10:14.257565 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.249143    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 02 23:10:14.258016 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.249145    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 02 23:10:14.258016 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.249148    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 02 23:10:14.258016 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.249150    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 02 23:10:14.258016 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.249153    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 02 23:10:14.258016 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.249156    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 02 23:10:14.258016 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.249158    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 02 23:10:14.258016 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.249160    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 02 23:10:14.258016 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.249163    2580 feature_gate.go:328] unrecognized feature gate: Example2
Jul 02 23:10:14.258016 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.249165    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 02 23:10:14.258016 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.249168    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 02 23:10:14.258016 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.249171    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 02 23:10:14.258016 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.249173    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 02 23:10:14.258016 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.249176    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 02 23:10:14.258016 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.249178    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 02 23:10:14.258016 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.249181    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 02 23:10:14.258016 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.249183    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 02 23:10:14.258016 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.249186    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 02 23:10:14.258016 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.249188    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 02 23:10:14.258016 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.249191    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 02 23:10:14.258016 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.249193    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 02 23:10:14.258521 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.249196    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 02 23:10:14.258521 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.249198    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 02 23:10:14.258521 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.249200    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 02 23:10:14.258521 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.249203    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 02 23:10:14.258521 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.249206    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 02 23:10:14.258521 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.249208    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 02 23:10:14.258521 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.249210    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 02 23:10:14.258521 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.249213    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 02 23:10:14.258521 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.249215    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 02 23:10:14.258521 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.249218    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 02 23:10:14.258521 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.249221    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 02 23:10:14.258521 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.249225    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 02 23:10:14.258521 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.249227    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 02 23:10:14.258521 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.249230    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 02 23:10:14.258521 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.249232    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 02 23:10:14.258521 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.249235    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 02 23:10:14.258521 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.249237    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 02 23:10:14.258521 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.249253    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 02 23:10:14.258521 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.249255    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 02 23:10:14.258521 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.249259    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 02 23:10:14.258999 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.249262    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 02 23:10:14.258999 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.249264    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 02 23:10:14.258999 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.249267    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 02 23:10:14.258999 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.249270    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 02 23:10:14.258999 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.249273    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 02 23:10:14.258999 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.249275    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 02 23:10:14.258999 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.249958    2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 02 23:10:14.258999 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.256743    2580 server.go:529] "Kubelet version" kubeletVersion="v1.34.8"
Jul 02 23:10:14.258999 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.256759    2580 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 02 23:10:14.258999 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.256778    2580 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 02 23:10:14.258999 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.256784    2580 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 02 23:10:14.258999 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.256841    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 02 23:10:14.258999 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.256845    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 02 23:10:14.258999 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.256849    2580 feature_gate.go:328] unrecognized feature gate: Example
Jul 02 23:10:14.258999 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.256852    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 02 23:10:14.259395 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.256855    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 02 23:10:14.259395 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.256858    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 02 23:10:14.259395 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.256861    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 02 23:10:14.259395 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.256864    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 02 23:10:14.259395 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.256867    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 02 23:10:14.259395 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.256870    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 02 23:10:14.259395 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.256873    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 02 23:10:14.259395 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.256875    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 02 23:10:14.259395 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.256878    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 02 23:10:14.259395 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.256881    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 02 23:10:14.259395 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.256883    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 02 23:10:14.259395 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.256886    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 02 23:10:14.259395 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.256888    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 02 23:10:14.259395 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.256891    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 02 23:10:14.259395 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.256893    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 02 23:10:14.259395 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.256896    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 02 23:10:14.259395 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.256899    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 02 23:10:14.259395 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.256901    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 02 23:10:14.259395 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.256904    2580 feature_gate.go:328] unrecognized feature gate: Example2
Jul 02 23:10:14.259841 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.256907    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 02 23:10:14.259841 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.256909    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 02 23:10:14.259841 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.256911    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 02 23:10:14.259841 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.256914    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 02 23:10:14.259841 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.256916    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 02 23:10:14.259841 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.256919    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 02 23:10:14.259841 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.256923    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 02 23:10:14.259841 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.256926    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 02 23:10:14.259841 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.256929    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 02 23:10:14.259841 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.256931    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 02 23:10:14.259841 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.256934    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 02 23:10:14.259841 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.256937    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 02 23:10:14.259841 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.256939    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 02 23:10:14.259841 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.256942    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 02 23:10:14.259841 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.256944    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 02 23:10:14.259841 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.256947    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 02 23:10:14.259841 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.256950    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 02 23:10:14.259841 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.256954    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 02 23:10:14.259841 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.256958    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 02 23:10:14.260355 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.256961    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 02 23:10:14.260355 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.256964    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 02 23:10:14.260355 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.256967    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 02 23:10:14.260355 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.256970    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 02 23:10:14.260355 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.256973    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 02 23:10:14.260355 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.256975    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 02 23:10:14.260355 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.256979    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 02 23:10:14.260355 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.256981    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 02 23:10:14.260355 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.256984    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 02 23:10:14.260355 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.256987    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 02 23:10:14.260355 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.256989    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 02 23:10:14.260355 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.256992    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 02 23:10:14.260355 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.256994    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 02 23:10:14.260355 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.256997    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 02 23:10:14.260355 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.256999    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 02 23:10:14.260355 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.257003    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 02 23:10:14.260355 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.257006    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 02 23:10:14.260355 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.257009    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 02 23:10:14.260355 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.257011    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 02 23:10:14.260355 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.257015    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 02 23:10:14.260842 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.257018    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 02 23:10:14.260842 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.257021    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 02 23:10:14.260842 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.257023    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 02 23:10:14.260842 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.257026    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 02 23:10:14.260842 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.257028    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 02 23:10:14.260842 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.257031    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 02 23:10:14.260842 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.257033    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 02 23:10:14.260842 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.257036    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 02 23:10:14.260842 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.257039    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 02 23:10:14.260842 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.257042    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 02 23:10:14.260842 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.257044    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 02 23:10:14.260842 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.257047    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 02 23:10:14.260842 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.257050    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 02 23:10:14.260842 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.257052    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 02 23:10:14.260842 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.257055    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 02 23:10:14.260842 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.257057    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 02 23:10:14.260842 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.257060    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 02 23:10:14.260842 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.257063    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 02 23:10:14.260842 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.257065    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 02 23:10:14.260842 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.257068    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 02 23:10:14.261380 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.257070    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 02 23:10:14.261380 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.257072    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 02 23:10:14.261380 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.257075    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 02 23:10:14.261380 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.257078    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 02 23:10:14.261380 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.257080    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 02 23:10:14.261380 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.257083    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 02 23:10:14.261380 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.257086    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 02 23:10:14.261380 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.257088    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 02 23:10:14.261380 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.257091    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 02 23:10:14.261380 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.257094    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 02 23:10:14.261380 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.257096    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 02 23:10:14.261380 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.257100    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 02 23:10:14.261380 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.257103    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 02 23:10:14.261380 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.257106    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 02 23:10:14.261380 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.257109    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 02 23:10:14.261380 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.257112    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 02 23:10:14.261380 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.257116    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 02 23:10:14.261794 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.257121    2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 02 23:10:14.261794 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.257227    2580 feature_gate.go:328] unrecognized feature gate: Example
Jul 02 23:10:14.261794 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.257231    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 02 23:10:14.261794 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.257233    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 02 23:10:14.261794 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.257236    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 02 23:10:14.261794 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.257256    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 02 23:10:14.261794 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.257260    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 02 23:10:14.261794 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.257263    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 02 23:10:14.261794 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.257266    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 02 23:10:14.261794 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.257269    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 02 23:10:14.261794 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.257272    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 02 23:10:14.261794 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.257275    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 02 23:10:14.261794 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.257278    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 02 23:10:14.261794 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.257281    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 02 23:10:14.261794 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.257284    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 02 23:10:14.262167 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.257286    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 02 23:10:14.262167 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.257289    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 02 23:10:14.262167 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.257292    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 02 23:10:14.262167 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.257294    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 02 23:10:14.262167 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.257297    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 02 23:10:14.262167 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.257299    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 02 23:10:14.262167 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.257302    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 02 23:10:14.262167 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.257304    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 02 23:10:14.262167 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.257307    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 02 23:10:14.262167 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.257309    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 02 23:10:14.262167 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.257312    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 02 23:10:14.262167 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.257315    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 02 23:10:14.262167 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.257318    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 02 23:10:14.262167 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.257320    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 02 23:10:14.262167 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.257324    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 02 23:10:14.262167 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.257326    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 02 23:10:14.262167 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.257329    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 02 23:10:14.262167 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.257331    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 02 23:10:14.262167 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.257334    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 02 23:10:14.262167 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.257336    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 02 23:10:14.262698 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.257339    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 02 23:10:14.262698 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.257341    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 02 23:10:14.262698 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.257344    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 02 23:10:14.262698 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.257346    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 02 23:10:14.262698 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.257349    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 02 23:10:14.262698 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.257351    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 02 23:10:14.262698 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.257353    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 02 23:10:14.262698 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.257356    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 02 23:10:14.262698 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.257359    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 02 23:10:14.262698 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.257361    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 02 23:10:14.262698 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.257363    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 02 23:10:14.262698 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.257366    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 02 23:10:14.262698 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.257368    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 02 23:10:14.262698 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.257371    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 02 23:10:14.262698 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.257373    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 02 23:10:14.262698 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.257376    2580 feature_gate.go:328] unrecognized feature gate: Example2
Jul 02 23:10:14.262698 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.257378    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 02 23:10:14.262698 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.257381    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 02 23:10:14.262698 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.257383    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 02 23:10:14.262698 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.257386    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 02 23:10:14.263172 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.257388    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 02 23:10:14.263172 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.257391    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 02 23:10:14.263172 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.257393    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 02 23:10:14.263172 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.257396    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 02 23:10:14.263172 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.257398    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 02 23:10:14.263172 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.257401    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 02 23:10:14.263172 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.257403    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 02 23:10:14.263172 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.257406    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 02 23:10:14.263172 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.257409    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 02 23:10:14.263172 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.257411    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 02 23:10:14.263172 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.257414    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 02 23:10:14.263172 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.257416    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 02 23:10:14.263172 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.257419    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 02 23:10:14.263172 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.257421    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 02 23:10:14.263172 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.257424    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 02 23:10:14.263172 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.257426    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 02 23:10:14.263172 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.257428    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 02 23:10:14.263172 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.257431    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 02 23:10:14.263172 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.257434    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 02 23:10:14.263172 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.257438    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 02 23:10:14.263668 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.257441    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 02 23:10:14.263668 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.257443    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 02 23:10:14.263668 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.257446    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 02 23:10:14.263668 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.257448    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 02 23:10:14.263668 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.257451    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 02 23:10:14.263668 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.257454    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 02 23:10:14.263668 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.257456    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 02 23:10:14.263668 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.257460    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 02 23:10:14.263668 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.257463    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 02 23:10:14.263668 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.257465    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 02 23:10:14.263668 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.257469    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 02 23:10:14.263668 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.257471    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 02 23:10:14.263668 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.257474    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 02 23:10:14.263668 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.257476    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 02 23:10:14.263668 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.257479    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 02 23:10:14.263668 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.257482    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 02 23:10:14.263668 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.257484    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 02 23:10:14.263668 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.257487    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 02 23:10:14.263668 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.257489    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 02 23:10:14.263668 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.257492    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 02 23:10:14.264152 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.257495    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 02 23:10:14.264152 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.257497    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 02 23:10:14.264152 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.257501    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 02 23:10:14.264152 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.257504    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 02 23:10:14.264152 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:14.257507    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 02 23:10:14.264152 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.257512    2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 02 23:10:14.264152 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.257621    2580 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 02 23:10:14.264152 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.260768    2580 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 02 23:10:14.264152 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.262529    2580 server.go:1019] "Starting client certificate rotation"
Jul 02 23:10:14.264152 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.262625    2580 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 02 23:10:14.264152 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.262661    2580 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 02 23:10:14.265192 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.265179    2580 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 02 23:10:14.266280 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.266268    2580 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 02 23:10:14.278157 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.278134    2580 log.go:25] "Validated CRI v1 runtime API"
Jul 02 23:10:14.280578 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.280564    2580 log.go:25] "Validated CRI v1 image API"
Jul 02 23:10:14.281452 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.281434    2580 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 02 23:10:14.284657 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.284638    2580 fs.go:135] Filesystem UUIDs: map[06453e2b-5a5c-4e0c-8faa-2aec0c01480d:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 f17640d1-cbb9-41bd-bf19-9a6dfc75095b:/dev/nvme0n1p4]
Jul 02 23:10:14.284710 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.284658    2580 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 02 23:10:14.289762 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.289648    2580 manager.go:216] Machine: {Timestamp:2026-07-02 23:10:14.288392418 +0000 UTC m=+0.305823608 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3098973 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec26a7c639f98aa8b01c11ce93dd7db8 SystemUUID:ec26a7c6-39f9-8aa8-b01c-11ce93dd7db8 BootID:c483ffae-b144-4797-86ba-2d3d7a4f0089 Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:60:1b:da:0f:3b Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:60:1b:da:0f:3b Speed:0 Mtu:9001} {Name:ovs-system MacAddress:de:ab:b9:20:4f:0c Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 02 23:10:14.289762 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.289759    2580 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 02 23:10:14.289871 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.289837    2580 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 02 23:10:14.290715 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.290699    2580 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 02 23:10:14.292942 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.292916    2580 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 02 23:10:14.293073 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.292945    2580 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-135-187.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 02 23:10:14.294467 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.294456    2580 topology_manager.go:138] "Creating topology manager with none policy"
Jul 02 23:10:14.294502 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.294469    2580 container_manager_linux.go:309] "Creating device plugin manager"
Jul 02 23:10:14.294502 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.294477    2580 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 02 23:10:14.295153 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.295143    2580 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 02 23:10:14.296927 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.296918    2580 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 02 23:10:14.300603 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.300593    2580 state_mem.go:36] "Initialized new in-memory state store"
Jul 02 23:10:14.300714 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.300705    2580 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 02 23:10:14.300749 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.300736    2580 kubelet.go:486] "Attempting to sync node with API server"
Jul 02 23:10:14.300777 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.300749    2580 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 02 23:10:14.300777 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.300764    2580 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 02 23:10:14.300777 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.300772    2580 kubelet.go:398] "Adding apiserver pod source"
Jul 02 23:10:14.300854 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.300781    2580 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 02 23:10:14.301140 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.301128    2580 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 02 23:10:14.301175 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.301146    2580 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 02 23:10:14.304736 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.304719    2580 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1"
Jul 02 23:10:14.307457 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.307444    2580 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 02 23:10:14.307502 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.307474    2580 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 02 23:10:14.308866 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.308855    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 02 23:10:14.308904 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.308872    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 02 23:10:14.308904 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.308879    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 02 23:10:14.308904 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.308886    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 02 23:10:14.308904 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.308895    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 02 23:10:14.308904 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.308901    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 02 23:10:14.309050 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.308913    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 02 23:10:14.309050 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.308921    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 02 23:10:14.309050 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.308930    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 02 23:10:14.309050 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.308936    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 02 23:10:14.309050 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.308944    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 02 23:10:14.309050 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.308949    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 02 23:10:14.309650 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.309641    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 02 23:10:14.309650 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.309651    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 02 23:10:14.311098 ip-10-0-135-187 kubenswrapper[2580]: E0702 23:10:14.311074    2580 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-135-187.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 02 23:10:14.311161 ip-10-0-135-187 kubenswrapper[2580]: E0702 23:10:14.311076    2580 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 02 23:10:14.312889 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.312876    2580 server.go:1268] "Started kubelet"
Jul 02 23:10:14.313033 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.312952    2580 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 02 23:10:14.313130 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.313006    2580 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 02 23:10:14.313130 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.313075    2580 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 02 23:10:14.313679 ip-10-0-135-187 systemd[1]: Started Kubernetes Kubelet.
Jul 02 23:10:14.317619 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.317596    2580 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 02 23:10:14.318748 ip-10-0-135-187 kubenswrapper[2580]: E0702 23:10:14.318709    2580 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 02 23:10:14.319028 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.319011    2580 server.go:310] "Adding debug handlers to kubelet server"
Jul 02 23:10:14.321074 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.321057    2580 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-bdmbc"
Jul 02 23:10:14.324255 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.324230    2580 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-135-187.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 02 23:10:14.325040 ip-10-0-135-187 kubenswrapper[2580]: E0702 23:10:14.324120    2580 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-187.ec2.internal.18be9bcea4a0799b  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-187.ec2.internal,UID:ip-10-0-135-187.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-135-187.ec2.internal,},FirstTimestamp:2026-07-02 23:10:14.312843675 +0000 UTC m=+0.330274864,LastTimestamp:2026-07-02 23:10:14.312843675 +0000 UTC m=+0.330274864,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-187.ec2.internal,}"
Jul 02 23:10:14.325380 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.325366    2580 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 02 23:10:14.325434 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.325385    2580 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 02 23:10:14.325616 ip-10-0-135-187 kubenswrapper[2580]: E0702 23:10:14.325600    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-187.ec2.internal\" not found"
Jul 02 23:10:14.326174 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.326146    2580 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 02 23:10:14.326174 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.326147    2580 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 02 23:10:14.326174 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.326172    2580 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 02 23:10:14.326394 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.326300    2580 reconstruct.go:97] "Volume reconstruction finished"
Jul 02 23:10:14.326394 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.326309    2580 reconciler.go:29] "Reconciler: start to sync state"
Jul 02 23:10:14.326394 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.326391    2580 factory.go:55] Registering systemd factory
Jul 02 23:10:14.326526 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.326427    2580 factory.go:223] Registration of the systemd container factory successfully
Jul 02 23:10:14.326630 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.326618    2580 factory.go:153] Registering CRI-O factory
Jul 02 23:10:14.326697 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.326632    2580 factory.go:223] Registration of the crio container factory successfully
Jul 02 23:10:14.326697 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.326682    2580 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 02 23:10:14.326804 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.326705    2580 factory.go:103] Registering Raw factory
Jul 02 23:10:14.326804 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.326719    2580 manager.go:1196] Started watching for new ooms in manager
Jul 02 23:10:14.327140 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.327126    2580 manager.go:349] Starting recovery of all containers
Jul 02 23:10:14.329452 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.329433    2580 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-bdmbc"
Jul 02 23:10:14.330755 ip-10-0-135-187 kubenswrapper[2580]: E0702 23:10:14.330733    2580 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-135-187.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 02 23:10:14.330840 ip-10-0-135-187 kubenswrapper[2580]: E0702 23:10:14.330815    2580 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 02 23:10:14.337591 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.337458    2580 manager.go:354] Recovery completed
Jul 02 23:10:14.338908 ip-10-0-135-187 kubenswrapper[2580]: E0702 23:10:14.338890    2580 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory
Jul 02 23:10:14.341881 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.341869    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 02 23:10:14.344062 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.344048    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-187.ec2.internal" event="NodeHasSufficientMemory"
Jul 02 23:10:14.344118 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.344077    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-187.ec2.internal" event="NodeHasNoDiskPressure"
Jul 02 23:10:14.344118 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.344090    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-187.ec2.internal" event="NodeHasSufficientPID"
Jul 02 23:10:14.344750 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.344734    2580 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 02 23:10:14.344750 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.344747    2580 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 02 23:10:14.344840 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.344752    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 02 23:10:14.344840 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.344763    2580 state_mem.go:36] "Initialized new in-memory state store"
Jul 02 23:10:14.345797 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.345783    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-187.ec2.internal" event="NodeHasSufficientMemory"
Jul 02 23:10:14.345884 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.345810    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-187.ec2.internal" event="NodeHasNoDiskPressure"
Jul 02 23:10:14.345884 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.345823    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-187.ec2.internal" event="NodeHasSufficientPID"
Jul 02 23:10:14.345975 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.345888    2580 policy_none.go:49] "None policy: Start"
Jul 02 23:10:14.345975 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.345903    2580 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 02 23:10:14.345975 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.345913    2580 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 02 23:10:14.346842 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.346830    2580 policy_none.go:47] "Start"
Jul 02 23:10:14.381932 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.381766    2580 manager.go:337] "Starting Device Plugin manager"
Jul 02 23:10:14.382009 ip-10-0-135-187 kubenswrapper[2580]: E0702 23:10:14.381944    2580 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 02 23:10:14.382009 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.381959    2580 server.go:87] "Starting device plugin registration server"
Jul 02 23:10:14.382236 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.382225    2580 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 02 23:10:14.382297 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.382261    2580 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 02 23:10:14.382390 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.382369    2580 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 02 23:10:14.382501 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.382452    2580 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 02 23:10:14.382501 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.382461    2580 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 02 23:10:14.382945 ip-10-0-135-187 kubenswrapper[2580]: E0702 23:10:14.382926    2580 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 02 23:10:14.383044 ip-10-0-135-187 kubenswrapper[2580]: E0702 23:10:14.382968    2580 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-135-187.ec2.internal\" not found"
Jul 02 23:10:14.421233 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.421206    2580 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 02 23:10:14.423126 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.422385    2580 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 02 23:10:14.423126 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.422419    2580 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 02 23:10:14.423126 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.422442    2580 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 02 23:10:14.423126 ip-10-0-135-187 kubenswrapper[2580]: E0702 23:10:14.422474    2580 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 02 23:10:14.424443 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.424427    2580 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 02 23:10:14.483391 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.483367    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 02 23:10:14.484170 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.484153    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-187.ec2.internal" event="NodeHasSufficientMemory"
Jul 02 23:10:14.484273 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.484184    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-187.ec2.internal" event="NodeHasNoDiskPressure"
Jul 02 23:10:14.484273 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.484194    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-187.ec2.internal" event="NodeHasSufficientPID"
Jul 02 23:10:14.484273 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.484214    2580 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-135-187.ec2.internal"
Jul 02 23:10:14.492120 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.492073    2580 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-135-187.ec2.internal"
Jul 02 23:10:14.492120 ip-10-0-135-187 kubenswrapper[2580]: E0702 23:10:14.492097    2580 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-135-187.ec2.internal\": node \"ip-10-0-135-187.ec2.internal\" not found"
Jul 02 23:10:14.507098 ip-10-0-135-187 kubenswrapper[2580]: E0702 23:10:14.507076    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-187.ec2.internal\" not found"
Jul 02 23:10:14.523176 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.523155    2580 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-187.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-135-187.ec2.internal"]
Jul 02 23:10:14.523274 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.523228    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 02 23:10:14.524701 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.524686    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-187.ec2.internal" event="NodeHasSufficientMemory"
Jul 02 23:10:14.524776 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.524736    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-187.ec2.internal" event="NodeHasNoDiskPressure"
Jul 02 23:10:14.524776 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.524746    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-187.ec2.internal" event="NodeHasSufficientPID"
Jul 02 23:10:14.525930 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.525919    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 02 23:10:14.526073 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.526050    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-187.ec2.internal"
Jul 02 23:10:14.526122 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.526084    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 02 23:10:14.526628 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.526606    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-187.ec2.internal" event="NodeHasSufficientMemory"
Jul 02 23:10:14.526628 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.526621    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-187.ec2.internal" event="NodeHasSufficientMemory"
Jul 02 23:10:14.526745 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.526634    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-187.ec2.internal" event="NodeHasNoDiskPressure"
Jul 02 23:10:14.526745 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.526642    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-187.ec2.internal" event="NodeHasNoDiskPressure"
Jul 02 23:10:14.526745 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.526649    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-187.ec2.internal" event="NodeHasSufficientPID"
Jul 02 23:10:14.526745 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.526652    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-187.ec2.internal" event="NodeHasSufficientPID"
Jul 02 23:10:14.527568 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.527552    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c283261225547afb9c0d25ecb78d10bb-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-187.ec2.internal\" (UID: \"c283261225547afb9c0d25ecb78d10bb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-187.ec2.internal"
Jul 02 23:10:14.527624 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.527576    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c283261225547afb9c0d25ecb78d10bb-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-187.ec2.internal\" (UID: \"c283261225547afb9c0d25ecb78d10bb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-187.ec2.internal"
Jul 02 23:10:14.527624 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.527602    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2a3057b685ec6036d1a84888358dad85-config\") pod \"kube-apiserver-proxy-ip-10-0-135-187.ec2.internal\" (UID: \"2a3057b685ec6036d1a84888358dad85\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-187.ec2.internal"
Jul 02 23:10:14.527865 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.527852    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-187.ec2.internal"
Jul 02 23:10:14.527907 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.527880    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 02 23:10:14.528564 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.528540    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-187.ec2.internal" event="NodeHasSufficientMemory"
Jul 02 23:10:14.528672 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.528569    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-187.ec2.internal" event="NodeHasNoDiskPressure"
Jul 02 23:10:14.528672 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.528587    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-187.ec2.internal" event="NodeHasSufficientPID"
Jul 02 23:10:14.550855 ip-10-0-135-187 kubenswrapper[2580]: E0702 23:10:14.550832    2580 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-187.ec2.internal\" not found" node="ip-10-0-135-187.ec2.internal"
Jul 02 23:10:14.555223 ip-10-0-135-187 kubenswrapper[2580]: E0702 23:10:14.555207    2580 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-187.ec2.internal\" not found" node="ip-10-0-135-187.ec2.internal"
Jul 02 23:10:14.607169 ip-10-0-135-187 kubenswrapper[2580]: E0702 23:10:14.607145    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-187.ec2.internal\" not found"
Jul 02 23:10:14.628099 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.628078    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2a3057b685ec6036d1a84888358dad85-config\") pod \"kube-apiserver-proxy-ip-10-0-135-187.ec2.internal\" (UID: \"2a3057b685ec6036d1a84888358dad85\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-187.ec2.internal"
Jul 02 23:10:14.628181 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.628103    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c283261225547afb9c0d25ecb78d10bb-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-187.ec2.internal\" (UID: \"c283261225547afb9c0d25ecb78d10bb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-187.ec2.internal"
Jul 02 23:10:14.628181 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.628119    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c283261225547afb9c0d25ecb78d10bb-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-187.ec2.internal\" (UID: \"c283261225547afb9c0d25ecb78d10bb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-187.ec2.internal"
Jul 02 23:10:14.628181 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.628160    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c283261225547afb9c0d25ecb78d10bb-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-187.ec2.internal\" (UID: \"c283261225547afb9c0d25ecb78d10bb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-187.ec2.internal"
Jul 02 23:10:14.628321 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.628187    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c283261225547afb9c0d25ecb78d10bb-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-187.ec2.internal\" (UID: \"c283261225547afb9c0d25ecb78d10bb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-187.ec2.internal"
Jul 02 23:10:14.628321 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.628191    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2a3057b685ec6036d1a84888358dad85-config\") pod \"kube-apiserver-proxy-ip-10-0-135-187.ec2.internal\" (UID: \"2a3057b685ec6036d1a84888358dad85\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-187.ec2.internal"
Jul 02 23:10:14.707559 ip-10-0-135-187 kubenswrapper[2580]: E0702 23:10:14.707526    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-187.ec2.internal\" not found"
Jul 02 23:10:14.807929 ip-10-0-135-187 kubenswrapper[2580]: E0702 23:10:14.807900    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-187.ec2.internal\" not found"
Jul 02 23:10:14.857032 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.856999    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-187.ec2.internal"
Jul 02 23:10:14.859311 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:14.859291    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-187.ec2.internal"
Jul 02 23:10:14.908962 ip-10-0-135-187 kubenswrapper[2580]: E0702 23:10:14.908934    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-187.ec2.internal\" not found"
Jul 02 23:10:15.015509 ip-10-0-135-187 kubenswrapper[2580]: E0702 23:10:15.015473    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-187.ec2.internal\" not found"
Jul 02 23:10:15.122109 ip-10-0-135-187 kubenswrapper[2580]: E0702 23:10:15.122029    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-187.ec2.internal\" not found"
Jul 02 23:10:15.224975 ip-10-0-135-187 kubenswrapper[2580]: E0702 23:10:15.224944    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-187.ec2.internal\" not found"
Jul 02 23:10:15.262017 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:15.261994    2580 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 02 23:10:15.262438 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:15.262148    2580 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 02 23:10:15.325125 ip-10-0-135-187 kubenswrapper[2580]: E0702 23:10:15.325085    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-187.ec2.internal\" not found"
Jul 02 23:10:15.332028 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:15.331995    2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-01 23:05:14 +0000 UTC" deadline="2028-04-14 15:55:29.982854928 +0000 UTC"
Jul 02 23:10:15.332028 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:15.332025    2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15640h45m14.650832654s"
Jul 02 23:10:15.425661 ip-10-0-135-187 kubenswrapper[2580]: E0702 23:10:15.425588    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-187.ec2.internal\" not found"
Jul 02 23:10:15.455440 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:15.455409    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc283261225547afb9c0d25ecb78d10bb.slice/crio-338898d75d06e943ca93241eb24f5144100fee3110714df31516de515cdf3728 WatchSource:0}: Error finding container 338898d75d06e943ca93241eb24f5144100fee3110714df31516de515cdf3728: Status 404 returned error can't find the container with id 338898d75d06e943ca93241eb24f5144100fee3110714df31516de515cdf3728
Jul 02 23:10:15.456117 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:15.456079    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a3057b685ec6036d1a84888358dad85.slice/crio-ecea476aacc8647a428b15bfea722ac39bcdcb65422b8a418104a4fbbc221aca WatchSource:0}: Error finding container ecea476aacc8647a428b15bfea722ac39bcdcb65422b8a418104a4fbbc221aca: Status 404 returned error can't find the container with id ecea476aacc8647a428b15bfea722ac39bcdcb65422b8a418104a4fbbc221aca
Jul 02 23:10:15.461458 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:15.461442    2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 02 23:10:15.526534 ip-10-0-135-187 kubenswrapper[2580]: E0702 23:10:15.526492    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-187.ec2.internal\" not found"
Jul 02 23:10:15.626583 ip-10-0-135-187 kubenswrapper[2580]: E0702 23:10:15.626551    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-187.ec2.internal\" not found"
Jul 02 23:10:15.640935 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:15.640913    2580 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 02 23:10:15.726623 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:15.726545    2580 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-187.ec2.internal"
Jul 02 23:10:15.740070 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:15.740053    2580 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 02 23:10:15.742327 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:15.742314    2580 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-187.ec2.internal"
Jul 02 23:10:15.751945 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:15.751926    2580 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 02 23:10:15.910440 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:15.910411    2580 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 02 23:10:15.917954 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:15.917921    2580 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 02 23:10:16.303116 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.303086    2580 apiserver.go:52] "Watching apiserver"
Jul 02 23:10:16.314980 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.314951    2580 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 02 23:10:16.316236 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.316191    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ovn-kubernetes/ovnkube-node-xxshk","kube-system/global-pull-secret-syncer-x9hkk","kube-system/kube-apiserver-proxy-ip-10-0-135-187.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vsnbz","openshift-image-registry/node-ca-zd96c","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-187.ec2.internal","openshift-multus/multus-additional-cni-plugins-ngnnt","openshift-multus/multus-tvqsh","openshift-multus/network-metrics-daemon-7qztm","kube-system/konnectivity-agent-dl7lg","openshift-cluster-node-tuning-operator/tuned-mqdx9","openshift-dns/node-resolver-pbxh5","openshift-network-diagnostics/network-check-target-w8bhs","openshift-network-operator/iptables-alerter-gwfk5"]
Jul 02 23:10:16.318090 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.318067    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-ngnnt"
Jul 02 23:10:16.319467 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.319443    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w8bhs"
Jul 02 23:10:16.319572 ip-10-0-135-187 kubenswrapper[2580]: E0702 23:10:16.319526    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w8bhs" podUID="f8448dd8-d309-4d65-89c1-a7f6acc365cf"
Jul 02 23:10:16.321401 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.321268    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-gwfk5"
Jul 02 23:10:16.321511 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.321451    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 02 23:10:16.321606 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.321581    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 02 23:10:16.321762 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.321735    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 02 23:10:16.321856 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.321807    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 02 23:10:16.321856 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.321841    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 02 23:10:16.321856 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.321848    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-nngrm\""
Jul 02 23:10:16.323678 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.323657    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vsnbz"
Jul 02 23:10:16.324597 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.324576    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-4q6rp\""
Jul 02 23:10:16.324691 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.324640    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 02 23:10:16.325055 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.325034    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 02 23:10:16.325421 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.325399    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 02 23:10:16.325779 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.325761    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-zd96c"
Jul 02 23:10:16.326361 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.326290    2580 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 02 23:10:16.326831 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.326811    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-tvqsh"
Jul 02 23:10:16.327300 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.327275    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 02 23:10:16.327300 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.327290    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 02 23:10:16.327651 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.327633    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-g6d92\""
Jul 02 23:10:16.327651 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.327643    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 02 23:10:16.328469 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.328451    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7qztm"
Jul 02 23:10:16.328605 ip-10-0-135-187 kubenswrapper[2580]: E0702 23:10:16.328562    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7qztm" podUID="8f153fd5-a05d-4f36-8295-6c95914702e9"
Jul 02 23:10:16.329275 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.329220    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 02 23:10:16.329915 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.329678    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 02 23:10:16.329915 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.329766    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 02 23:10:16.329915 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.329782    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-97wff\""
Jul 02 23:10:16.330447 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.330427    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 02 23:10:16.330537 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.330434    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-44tqh\""
Jul 02 23:10:16.330593 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.330573    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-xxshk"
Jul 02 23:10:16.332577 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.332557    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x9hkk"
Jul 02 23:10:16.332671 ip-10-0-135-187 kubenswrapper[2580]: E0702 23:10:16.332643    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x9hkk" podUID="203dd5bc-44ec-49b7-9065-d343c88157f1"
Jul 02 23:10:16.333436 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.333415    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-wdfwz\""
Jul 02 23:10:16.333542 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.333415    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 02 23:10:16.333645 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.333621    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 02 23:10:16.334064 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.334045    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 02 23:10:16.334148 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.334124    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-dl7lg"
Jul 02 23:10:16.334574 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.334554    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 02 23:10:16.334662 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.334590    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 02 23:10:16.335173 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.335130    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 02 23:10:16.337155 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.337132    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 02 23:10:16.337401 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.337382    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-8wphz\""
Jul 02 23:10:16.337510 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.337493    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 02 23:10:16.338103 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.338082    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-mqdx9"
Jul 02 23:10:16.340640 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.340598    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/cd0e2259-affc-47b6-8234-298d698a5a18-iptables-alerter-script\") pod \"iptables-alerter-gwfk5\" (UID: \"cd0e2259-affc-47b6-8234-298d698a5a18\") " pod="openshift-network-operator/iptables-alerter-gwfk5"
Jul 02 23:10:16.340750 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.340655    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g57pz\" (UniqueName: \"kubernetes.io/projected/cd0e2259-affc-47b6-8234-298d698a5a18-kube-api-access-g57pz\") pod \"iptables-alerter-gwfk5\" (UID: \"cd0e2259-affc-47b6-8234-298d698a5a18\") " pod="openshift-network-operator/iptables-alerter-gwfk5"
Jul 02 23:10:16.340750 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.340733    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t7htq\" (UniqueName: \"kubernetes.io/projected/d394571a-8c62-4248-a9eb-9b165f3dfea3-kube-api-access-t7htq\") pod \"node-ca-zd96c\" (UID: \"d394571a-8c62-4248-a9eb-9b165f3dfea3\") " pod="openshift-image-registry/node-ca-zd96c"
Jul 02 23:10:16.340865 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.340775    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d1f07f77-f80b-40b6-820d-bf77344e6724-multus-daemon-config\") pod \"multus-tvqsh\" (UID: \"d1f07f77-f80b-40b6-820d-bf77344e6724\") " pod="openshift-multus/multus-tvqsh"
Jul 02 23:10:16.340865 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.340803    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d1f07f77-f80b-40b6-820d-bf77344e6724-etc-kubernetes\") pod \"multus-tvqsh\" (UID: \"d1f07f77-f80b-40b6-820d-bf77344e6724\") " pod="openshift-multus/multus-tvqsh"
Jul 02 23:10:16.340865 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.340835    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d9adaa10-5793-4280-9f7f-b7ff28a63c56-tuning-conf-dir\") pod \"multus-additional-cni-plugins-ngnnt\" (UID: \"d9adaa10-5793-4280-9f7f-b7ff28a63c56\") " pod="openshift-multus/multus-additional-cni-plugins-ngnnt"
Jul 02 23:10:16.340999 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.340871    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/07bf56c1-2a06-4268-a2e1-fa7572c6b568-etc-selinux\") pod \"aws-ebs-csi-driver-node-vsnbz\" (UID: \"07bf56c1-2a06-4268-a2e1-fa7572c6b568\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vsnbz"
Jul 02 23:10:16.340999 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.340903    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d394571a-8c62-4248-a9eb-9b165f3dfea3-host\") pod \"node-ca-zd96c\" (UID: \"d394571a-8c62-4248-a9eb-9b165f3dfea3\") " pod="openshift-image-registry/node-ca-zd96c"
Jul 02 23:10:16.340999 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.340932    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d1f07f77-f80b-40b6-820d-bf77344e6724-multus-cni-dir\") pod \"multus-tvqsh\" (UID: \"d1f07f77-f80b-40b6-820d-bf77344e6724\") " pod="openshift-multus/multus-tvqsh"
Jul 02 23:10:16.340999 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.340963    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d1f07f77-f80b-40b6-820d-bf77344e6724-multus-socket-dir-parent\") pod \"multus-tvqsh\" (UID: \"d1f07f77-f80b-40b6-820d-bf77344e6724\") " pod="openshift-multus/multus-tvqsh"
Jul 02 23:10:16.340999 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.340995    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d1f07f77-f80b-40b6-820d-bf77344e6724-host-run-netns\") pod \"multus-tvqsh\" (UID: \"d1f07f77-f80b-40b6-820d-bf77344e6724\") " pod="openshift-multus/multus-tvqsh"
Jul 02 23:10:16.341249 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.341024    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d1f07f77-f80b-40b6-820d-bf77344e6724-multus-conf-dir\") pod \"multus-tvqsh\" (UID: \"d1f07f77-f80b-40b6-820d-bf77344e6724\") " pod="openshift-multus/multus-tvqsh"
Jul 02 23:10:16.341249 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.341053    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/cd0e2259-affc-47b6-8234-298d698a5a18-host-slash\") pod \"iptables-alerter-gwfk5\" (UID: \"cd0e2259-affc-47b6-8234-298d698a5a18\") " pod="openshift-network-operator/iptables-alerter-gwfk5"
Jul 02 23:10:16.341249 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.341081    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/07bf56c1-2a06-4268-a2e1-fa7572c6b568-device-dir\") pod \"aws-ebs-csi-driver-node-vsnbz\" (UID: \"07bf56c1-2a06-4268-a2e1-fa7572c6b568\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vsnbz"
Jul 02 23:10:16.341249 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.341105    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d1f07f77-f80b-40b6-820d-bf77344e6724-host-run-k8s-cni-cncf-io\") pod \"multus-tvqsh\" (UID: \"d1f07f77-f80b-40b6-820d-bf77344e6724\") " pod="openshift-multus/multus-tvqsh"
Jul 02 23:10:16.341249 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.341135    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d9adaa10-5793-4280-9f7f-b7ff28a63c56-os-release\") pod \"multus-additional-cni-plugins-ngnnt\" (UID: \"d9adaa10-5793-4280-9f7f-b7ff28a63c56\") " pod="openshift-multus/multus-additional-cni-plugins-ngnnt"
Jul 02 23:10:16.341249 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.341168    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pkq9n\" (UniqueName: \"kubernetes.io/projected/f8448dd8-d309-4d65-89c1-a7f6acc365cf-kube-api-access-pkq9n\") pod \"network-check-target-w8bhs\" (UID: \"f8448dd8-d309-4d65-89c1-a7f6acc365cf\") " pod="openshift-network-diagnostics/network-check-target-w8bhs"
Jul 02 23:10:16.341249 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.341199    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/07bf56c1-2a06-4268-a2e1-fa7572c6b568-registration-dir\") pod \"aws-ebs-csi-driver-node-vsnbz\" (UID: \"07bf56c1-2a06-4268-a2e1-fa7572c6b568\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vsnbz"
Jul 02 23:10:16.341249 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.341230    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d1f07f77-f80b-40b6-820d-bf77344e6724-os-release\") pod \"multus-tvqsh\" (UID: \"d1f07f77-f80b-40b6-820d-bf77344e6724\") " pod="openshift-multus/multus-tvqsh"
Jul 02 23:10:16.342426 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.341264    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d1f07f77-f80b-40b6-820d-bf77344e6724-cni-binary-copy\") pod \"multus-tvqsh\" (UID: \"d1f07f77-f80b-40b6-820d-bf77344e6724\") " pod="openshift-multus/multus-tvqsh"
Jul 02 23:10:16.342426 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.341291    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sbmmj\" (UniqueName: \"kubernetes.io/projected/d9adaa10-5793-4280-9f7f-b7ff28a63c56-kube-api-access-sbmmj\") pod \"multus-additional-cni-plugins-ngnnt\" (UID: \"d9adaa10-5793-4280-9f7f-b7ff28a63c56\") " pod="openshift-multus/multus-additional-cni-plugins-ngnnt"
Jul 02 23:10:16.342426 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.341348    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/07bf56c1-2a06-4268-a2e1-fa7572c6b568-kubelet-dir\") pod \"aws-ebs-csi-driver-node-vsnbz\" (UID: \"07bf56c1-2a06-4268-a2e1-fa7572c6b568\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vsnbz"
Jul 02 23:10:16.342426 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.341379    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d1f07f77-f80b-40b6-820d-bf77344e6724-system-cni-dir\") pod \"multus-tvqsh\" (UID: \"d1f07f77-f80b-40b6-820d-bf77344e6724\") " pod="openshift-multus/multus-tvqsh"
Jul 02 23:10:16.342426 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.341496    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d1f07f77-f80b-40b6-820d-bf77344e6724-host-var-lib-cni-bin\") pod \"multus-tvqsh\" (UID: \"d1f07f77-f80b-40b6-820d-bf77344e6724\") " pod="openshift-multus/multus-tvqsh"
Jul 02 23:10:16.342426 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.341527    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gpgk5\" (UniqueName: \"kubernetes.io/projected/d1f07f77-f80b-40b6-820d-bf77344e6724-kube-api-access-gpgk5\") pod \"multus-tvqsh\" (UID: \"d1f07f77-f80b-40b6-820d-bf77344e6724\") " pod="openshift-multus/multus-tvqsh"
Jul 02 23:10:16.342426 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.341553    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d9adaa10-5793-4280-9f7f-b7ff28a63c56-system-cni-dir\") pod \"multus-additional-cni-plugins-ngnnt\" (UID: \"d9adaa10-5793-4280-9f7f-b7ff28a63c56\") " pod="openshift-multus/multus-additional-cni-plugins-ngnnt"
Jul 02 23:10:16.342426 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.341587    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d9adaa10-5793-4280-9f7f-b7ff28a63c56-cni-binary-copy\") pod \"multus-additional-cni-plugins-ngnnt\" (UID: \"d9adaa10-5793-4280-9f7f-b7ff28a63c56\") " pod="openshift-multus/multus-additional-cni-plugins-ngnnt"
Jul 02 23:10:16.342426 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.341619    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d9adaa10-5793-4280-9f7f-b7ff28a63c56-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-ngnnt\" (UID: \"d9adaa10-5793-4280-9f7f-b7ff28a63c56\") " pod="openshift-multus/multus-additional-cni-plugins-ngnnt"
Jul 02 23:10:16.342426 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.341651    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/07bf56c1-2a06-4268-a2e1-fa7572c6b568-sys-fs\") pod \"aws-ebs-csi-driver-node-vsnbz\" (UID: \"07bf56c1-2a06-4268-a2e1-fa7572c6b568\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vsnbz"
Jul 02 23:10:16.342426 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.341679    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d1f07f77-f80b-40b6-820d-bf77344e6724-cnibin\") pod \"multus-tvqsh\" (UID: \"d1f07f77-f80b-40b6-820d-bf77344e6724\") " pod="openshift-multus/multus-tvqsh"
Jul 02 23:10:16.342426 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.341703    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d1f07f77-f80b-40b6-820d-bf77344e6724-hostroot\") pod \"multus-tvqsh\" (UID: \"d1f07f77-f80b-40b6-820d-bf77344e6724\") " pod="openshift-multus/multus-tvqsh"
Jul 02 23:10:16.342426 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.341762    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d9adaa10-5793-4280-9f7f-b7ff28a63c56-cnibin\") pod \"multus-additional-cni-plugins-ngnnt\" (UID: \"d9adaa10-5793-4280-9f7f-b7ff28a63c56\") " pod="openshift-multus/multus-additional-cni-plugins-ngnnt"
Jul 02 23:10:16.342426 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.341814    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d394571a-8c62-4248-a9eb-9b165f3dfea3-serviceca\") pod \"node-ca-zd96c\" (UID: \"d394571a-8c62-4248-a9eb-9b165f3dfea3\") " pod="openshift-image-registry/node-ca-zd96c"
Jul 02 23:10:16.342426 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.342241    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d1f07f77-f80b-40b6-820d-bf77344e6724-host-var-lib-kubelet\") pod \"multus-tvqsh\" (UID: \"d1f07f77-f80b-40b6-820d-bf77344e6724\") " pod="openshift-multus/multus-tvqsh"
Jul 02 23:10:16.342426 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.342341    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d1f07f77-f80b-40b6-820d-bf77344e6724-host-run-multus-certs\") pod \"multus-tvqsh\" (UID: \"d1f07f77-f80b-40b6-820d-bf77344e6724\") " pod="openshift-multus/multus-tvqsh"
Jul 02 23:10:16.343373 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.342407    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r2svx\" (UniqueName: \"kubernetes.io/projected/07bf56c1-2a06-4268-a2e1-fa7572c6b568-kube-api-access-r2svx\") pod \"aws-ebs-csi-driver-node-vsnbz\" (UID: \"07bf56c1-2a06-4268-a2e1-fa7572c6b568\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vsnbz"
Jul 02 23:10:16.343373 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.342452    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/07bf56c1-2a06-4268-a2e1-fa7572c6b568-socket-dir\") pod \"aws-ebs-csi-driver-node-vsnbz\" (UID: \"07bf56c1-2a06-4268-a2e1-fa7572c6b568\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vsnbz"
Jul 02 23:10:16.343373 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.342482    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d1f07f77-f80b-40b6-820d-bf77344e6724-host-var-lib-cni-multus\") pod \"multus-tvqsh\" (UID: \"d1f07f77-f80b-40b6-820d-bf77344e6724\") " pod="openshift-multus/multus-tvqsh"
Jul 02 23:10:16.343373 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.342515    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d9adaa10-5793-4280-9f7f-b7ff28a63c56-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-ngnnt\" (UID: \"d9adaa10-5793-4280-9f7f-b7ff28a63c56\") " pod="openshift-multus/multus-additional-cni-plugins-ngnnt"
Jul 02 23:10:16.343373 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.342892    2580 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 02 23:10:16.343656 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.343527    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 02 23:10:16.344186 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.343811    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 02 23:10:16.345948 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.345924    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-gnrxq\""
Jul 02 23:10:16.349687 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.349663    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-pbxh5"
Jul 02 23:10:16.353273 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.353021    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 02 23:10:16.353273 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.353063    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-hmc9w\""
Jul 02 23:10:16.353273 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.353112    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 02 23:10:16.382282 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.382259    2580 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-h7ksf"
Jul 02 23:10:16.390791 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.390742    2580 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-h7ksf"
Jul 02 23:10:16.427237 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.427213    2580 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 02 23:10:16.427765 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.427717    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-187.ec2.internal" event={"ID":"c283261225547afb9c0d25ecb78d10bb","Type":"ContainerStarted","Data":"338898d75d06e943ca93241eb24f5144100fee3110714df31516de515cdf3728"}
Jul 02 23:10:16.429105 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.429067    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-187.ec2.internal" event={"ID":"2a3057b685ec6036d1a84888358dad85","Type":"ContainerStarted","Data":"ecea476aacc8647a428b15bfea722ac39bcdcb65422b8a418104a4fbbc221aca"}
Jul 02 23:10:16.443514 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.443479    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r2svx\" (UniqueName: \"kubernetes.io/projected/07bf56c1-2a06-4268-a2e1-fa7572c6b568-kube-api-access-r2svx\") pod \"aws-ebs-csi-driver-node-vsnbz\" (UID: \"07bf56c1-2a06-4268-a2e1-fa7572c6b568\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vsnbz"
Jul 02 23:10:16.443635 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.443528    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/07bf56c1-2a06-4268-a2e1-fa7572c6b568-socket-dir\") pod \"aws-ebs-csi-driver-node-vsnbz\" (UID: \"07bf56c1-2a06-4268-a2e1-fa7572c6b568\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vsnbz"
Jul 02 23:10:16.443635 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.443554    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d1f07f77-f80b-40b6-820d-bf77344e6724-host-var-lib-cni-multus\") pod \"multus-tvqsh\" (UID: \"d1f07f77-f80b-40b6-820d-bf77344e6724\") " pod="openshift-multus/multus-tvqsh"
Jul 02 23:10:16.443635 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.443584    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/76a3ba4e-e12e-4949-a03b-2012fe8f772c-ovnkube-config\") pod \"ovnkube-node-xxshk\" (UID: \"76a3ba4e-e12e-4949-a03b-2012fe8f772c\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxshk"
Jul 02 23:10:16.443635 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.443623    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/36619515-fe66-4e56-a608-49db958cb88c-run\") pod \"tuned-mqdx9\" (UID: \"36619515-fe66-4e56-a608-49db958cb88c\") " pod="openshift-cluster-node-tuning-operator/tuned-mqdx9"
Jul 02 23:10:16.443828 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.443768    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g57pz\" (UniqueName: \"kubernetes.io/projected/cd0e2259-affc-47b6-8234-298d698a5a18-kube-api-access-g57pz\") pod \"iptables-alerter-gwfk5\" (UID: \"cd0e2259-affc-47b6-8234-298d698a5a18\") " pod="openshift-network-operator/iptables-alerter-gwfk5"
Jul 02 23:10:16.443828 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.443793    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/07bf56c1-2a06-4268-a2e1-fa7572c6b568-socket-dir\") pod \"aws-ebs-csi-driver-node-vsnbz\" (UID: \"07bf56c1-2a06-4268-a2e1-fa7572c6b568\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vsnbz"
Jul 02 23:10:16.443938 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.443853    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d1f07f77-f80b-40b6-820d-bf77344e6724-host-var-lib-cni-multus\") pod \"multus-tvqsh\" (UID: \"d1f07f77-f80b-40b6-820d-bf77344e6724\") " pod="openshift-multus/multus-tvqsh"
Jul 02 23:10:16.443938 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.443893    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t7htq\" (UniqueName: \"kubernetes.io/projected/d394571a-8c62-4248-a9eb-9b165f3dfea3-kube-api-access-t7htq\") pod \"node-ca-zd96c\" (UID: \"d394571a-8c62-4248-a9eb-9b165f3dfea3\") " pod="openshift-image-registry/node-ca-zd96c"
Jul 02 23:10:16.443938 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.443932    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d1f07f77-f80b-40b6-820d-bf77344e6724-multus-daemon-config\") pod \"multus-tvqsh\" (UID: \"d1f07f77-f80b-40b6-820d-bf77344e6724\") " pod="openshift-multus/multus-tvqsh"
Jul 02 23:10:16.444098 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.443961    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d1f07f77-f80b-40b6-820d-bf77344e6724-etc-kubernetes\") pod \"multus-tvqsh\" (UID: \"d1f07f77-f80b-40b6-820d-bf77344e6724\") " pod="openshift-multus/multus-tvqsh"
Jul 02 23:10:16.444098 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.443988    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/76a3ba4e-e12e-4949-a03b-2012fe8f772c-node-log\") pod \"ovnkube-node-xxshk\" (UID: \"76a3ba4e-e12e-4949-a03b-2012fe8f772c\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxshk"
Jul 02 23:10:16.444098 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.444014    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8f153fd5-a05d-4f36-8295-6c95914702e9-metrics-certs\") pod \"network-metrics-daemon-7qztm\" (UID: \"8f153fd5-a05d-4f36-8295-6c95914702e9\") " pod="openshift-multus/network-metrics-daemon-7qztm"
Jul 02 23:10:16.444098 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.444040    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/36619515-fe66-4e56-a608-49db958cb88c-etc-sysconfig\") pod \"tuned-mqdx9\" (UID: \"36619515-fe66-4e56-a608-49db958cb88c\") " pod="openshift-cluster-node-tuning-operator/tuned-mqdx9"
Jul 02 23:10:16.444098 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.444062    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/36619515-fe66-4e56-a608-49db958cb88c-tmp\") pod \"tuned-mqdx9\" (UID: \"36619515-fe66-4e56-a608-49db958cb88c\") " pod="openshift-cluster-node-tuning-operator/tuned-mqdx9"
Jul 02 23:10:16.444098 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.444090    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/07bf56c1-2a06-4268-a2e1-fa7572c6b568-etc-selinux\") pod \"aws-ebs-csi-driver-node-vsnbz\" (UID: \"07bf56c1-2a06-4268-a2e1-fa7572c6b568\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vsnbz"
Jul 02 23:10:16.444476 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.444088    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d1f07f77-f80b-40b6-820d-bf77344e6724-etc-kubernetes\") pod \"multus-tvqsh\" (UID: \"d1f07f77-f80b-40b6-820d-bf77344e6724\") " pod="openshift-multus/multus-tvqsh"
Jul 02 23:10:16.444476 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.444115    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d394571a-8c62-4248-a9eb-9b165f3dfea3-host\") pod \"node-ca-zd96c\" (UID: \"d394571a-8c62-4248-a9eb-9b165f3dfea3\") " pod="openshift-image-registry/node-ca-zd96c"
Jul 02 23:10:16.444476 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.444155    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d1f07f77-f80b-40b6-820d-bf77344e6724-multus-cni-dir\") pod \"multus-tvqsh\" (UID: \"d1f07f77-f80b-40b6-820d-bf77344e6724\") " pod="openshift-multus/multus-tvqsh"
Jul 02 23:10:16.444476 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.444233    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d1f07f77-f80b-40b6-820d-bf77344e6724-multus-socket-dir-parent\") pod \"multus-tvqsh\" (UID: \"d1f07f77-f80b-40b6-820d-bf77344e6724\") " pod="openshift-multus/multus-tvqsh"
Jul 02 23:10:16.444476 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.444243    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/07bf56c1-2a06-4268-a2e1-fa7572c6b568-etc-selinux\") pod \"aws-ebs-csi-driver-node-vsnbz\" (UID: \"07bf56c1-2a06-4268-a2e1-fa7572c6b568\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vsnbz"
Jul 02 23:10:16.444476 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.444262    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d1f07f77-f80b-40b6-820d-bf77344e6724-host-run-netns\") pod \"multus-tvqsh\" (UID: \"d1f07f77-f80b-40b6-820d-bf77344e6724\") " pod="openshift-multus/multus-tvqsh"
Jul 02 23:10:16.444476 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.444282    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d394571a-8c62-4248-a9eb-9b165f3dfea3-host\") pod \"node-ca-zd96c\" (UID: \"d394571a-8c62-4248-a9eb-9b165f3dfea3\") " pod="openshift-image-registry/node-ca-zd96c"
Jul 02 23:10:16.444476 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.444327    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d1f07f77-f80b-40b6-820d-bf77344e6724-multus-socket-dir-parent\") pod \"multus-tvqsh\" (UID: \"d1f07f77-f80b-40b6-820d-bf77344e6724\") " pod="openshift-multus/multus-tvqsh"
Jul 02 23:10:16.444476 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.444364    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/76a3ba4e-e12e-4949-a03b-2012fe8f772c-run-systemd\") pod \"ovnkube-node-xxshk\" (UID: \"76a3ba4e-e12e-4949-a03b-2012fe8f772c\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxshk"
Jul 02 23:10:16.444476 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.444400    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d1f07f77-f80b-40b6-820d-bf77344e6724-host-run-netns\") pod \"multus-tvqsh\" (UID: \"d1f07f77-f80b-40b6-820d-bf77344e6724\") " pod="openshift-multus/multus-tvqsh"
Jul 02 23:10:16.444476 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.444430    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d1f07f77-f80b-40b6-820d-bf77344e6724-multus-cni-dir\") pod \"multus-tvqsh\" (UID: \"d1f07f77-f80b-40b6-820d-bf77344e6724\") " pod="openshift-multus/multus-tvqsh"
Jul 02 23:10:16.444476 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.444437    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/76a3ba4e-e12e-4949-a03b-2012fe8f772c-var-lib-openvswitch\") pod \"ovnkube-node-xxshk\" (UID: \"76a3ba4e-e12e-4949-a03b-2012fe8f772c\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxshk"
Jul 02 23:10:16.444476 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.444476    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4h2fc\" (UniqueName: \"kubernetes.io/projected/36619515-fe66-4e56-a608-49db958cb88c-kube-api-access-4h2fc\") pod \"tuned-mqdx9\" (UID: \"36619515-fe66-4e56-a608-49db958cb88c\") " pod="openshift-cluster-node-tuning-operator/tuned-mqdx9"
Jul 02 23:10:16.445299 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.444505    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d1f07f77-f80b-40b6-820d-bf77344e6724-host-run-k8s-cni-cncf-io\") pod \"multus-tvqsh\" (UID: \"d1f07f77-f80b-40b6-820d-bf77344e6724\") " pod="openshift-multus/multus-tvqsh"
Jul 02 23:10:16.445299 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.444537    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/76a3ba4e-e12e-4949-a03b-2012fe8f772c-host-cni-netd\") pod \"ovnkube-node-xxshk\" (UID: \"76a3ba4e-e12e-4949-a03b-2012fe8f772c\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxshk"
Jul 02 23:10:16.445299 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.444560    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d1f07f77-f80b-40b6-820d-bf77344e6724-host-run-k8s-cni-cncf-io\") pod \"multus-tvqsh\" (UID: \"d1f07f77-f80b-40b6-820d-bf77344e6724\") " pod="openshift-multus/multus-tvqsh"
Jul 02 23:10:16.445299 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.444609    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/07bf56c1-2a06-4268-a2e1-fa7572c6b568-registration-dir\") pod \"aws-ebs-csi-driver-node-vsnbz\" (UID: \"07bf56c1-2a06-4268-a2e1-fa7572c6b568\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vsnbz"
Jul 02 23:10:16.445299 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.444647    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d1f07f77-f80b-40b6-820d-bf77344e6724-cni-binary-copy\") pod \"multus-tvqsh\" (UID: \"d1f07f77-f80b-40b6-820d-bf77344e6724\") " pod="openshift-multus/multus-tvqsh"
Jul 02 23:10:16.445299 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.444706    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d1f07f77-f80b-40b6-820d-bf77344e6724-multus-daemon-config\") pod \"multus-tvqsh\" (UID: \"d1f07f77-f80b-40b6-820d-bf77344e6724\") " pod="openshift-multus/multus-tvqsh"
Jul 02 23:10:16.445299 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.444785    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sbmmj\" (UniqueName: \"kubernetes.io/projected/d9adaa10-5793-4280-9f7f-b7ff28a63c56-kube-api-access-sbmmj\") pod \"multus-additional-cni-plugins-ngnnt\" (UID: \"d9adaa10-5793-4280-9f7f-b7ff28a63c56\") " pod="openshift-multus/multus-additional-cni-plugins-ngnnt"
Jul 02 23:10:16.445299 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.444829    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/07bf56c1-2a06-4268-a2e1-fa7572c6b568-registration-dir\") pod \"aws-ebs-csi-driver-node-vsnbz\" (UID: \"07bf56c1-2a06-4268-a2e1-fa7572c6b568\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vsnbz"
Jul 02 23:10:16.445299 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.444833    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/76a3ba4e-e12e-4949-a03b-2012fe8f772c-run-ovn\") pod \"ovnkube-node-xxshk\" (UID: \"76a3ba4e-e12e-4949-a03b-2012fe8f772c\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxshk"
Jul 02 23:10:16.445299 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.444874    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/76a3ba4e-e12e-4949-a03b-2012fe8f772c-log-socket\") pod \"ovnkube-node-xxshk\" (UID: \"76a3ba4e-e12e-4949-a03b-2012fe8f772c\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxshk"
Jul 02 23:10:16.445299 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.444901    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/36619515-fe66-4e56-a608-49db958cb88c-etc-tuned\") pod \"tuned-mqdx9\" (UID: \"36619515-fe66-4e56-a608-49db958cb88c\") " pod="openshift-cluster-node-tuning-operator/tuned-mqdx9"
Jul 02 23:10:16.445299 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.444939    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d1f07f77-f80b-40b6-820d-bf77344e6724-host-var-lib-cni-bin\") pod \"multus-tvqsh\" (UID: \"d1f07f77-f80b-40b6-820d-bf77344e6724\") " pod="openshift-multus/multus-tvqsh"
Jul 02 23:10:16.445299 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.444963    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d9adaa10-5793-4280-9f7f-b7ff28a63c56-cni-binary-copy\") pod \"multus-additional-cni-plugins-ngnnt\" (UID: \"d9adaa10-5793-4280-9f7f-b7ff28a63c56\") " pod="openshift-multus/multus-additional-cni-plugins-ngnnt"
Jul 02 23:10:16.445299 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.445014    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d9adaa10-5793-4280-9f7f-b7ff28a63c56-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-ngnnt\" (UID: \"d9adaa10-5793-4280-9f7f-b7ff28a63c56\") " pod="openshift-multus/multus-additional-cni-plugins-ngnnt"
Jul 02 23:10:16.445299 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.445055    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/76a3ba4e-e12e-4949-a03b-2012fe8f772c-systemd-units\") pod \"ovnkube-node-xxshk\" (UID: \"76a3ba4e-e12e-4949-a03b-2012fe8f772c\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxshk"
Jul 02 23:10:16.445299 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.445074    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/76a3ba4e-e12e-4949-a03b-2012fe8f772c-host-slash\") pod \"ovnkube-node-xxshk\" (UID: \"76a3ba4e-e12e-4949-a03b-2012fe8f772c\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxshk"
Jul 02 23:10:16.445299 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.445093    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/203dd5bc-44ec-49b7-9065-d343c88157f1-kubelet-config\") pod \"global-pull-secret-syncer-x9hkk\" (UID: \"203dd5bc-44ec-49b7-9065-d343c88157f1\") " pod="kube-system/global-pull-secret-syncer-x9hkk"
Jul 02 23:10:16.446190 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.445111    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6758f85e-f0e3-4322-bae6-bbce4d0ba66f-konnectivity-ca\") pod \"konnectivity-agent-dl7lg\" (UID: \"6758f85e-f0e3-4322-bae6-bbce4d0ba66f\") " pod="kube-system/konnectivity-agent-dl7lg"
Jul 02 23:10:16.446190 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.445131    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/36619515-fe66-4e56-a608-49db958cb88c-lib-modules\") pod \"tuned-mqdx9\" (UID: \"36619515-fe66-4e56-a608-49db958cb88c\") " pod="openshift-cluster-node-tuning-operator/tuned-mqdx9"
Jul 02 23:10:16.446190 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.445157    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d1f07f77-f80b-40b6-820d-bf77344e6724-cnibin\") pod \"multus-tvqsh\" (UID: \"d1f07f77-f80b-40b6-820d-bf77344e6724\") " pod="openshift-multus/multus-tvqsh"
Jul 02 23:10:16.446190 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.445197    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d1f07f77-f80b-40b6-820d-bf77344e6724-hostroot\") pod \"multus-tvqsh\" (UID: \"d1f07f77-f80b-40b6-820d-bf77344e6724\") " pod="openshift-multus/multus-tvqsh"
Jul 02 23:10:16.446190 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.445214    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/76a3ba4e-e12e-4949-a03b-2012fe8f772c-env-overrides\") pod \"ovnkube-node-xxshk\" (UID: \"76a3ba4e-e12e-4949-a03b-2012fe8f772c\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxshk"
Jul 02 23:10:16.446190 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.445230    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/203dd5bc-44ec-49b7-9065-d343c88157f1-original-pull-secret\") pod \"global-pull-secret-syncer-x9hkk\" (UID: \"203dd5bc-44ec-49b7-9065-d343c88157f1\") " pod="kube-system/global-pull-secret-syncer-x9hkk"
Jul 02 23:10:16.446190 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.445245    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/36619515-fe66-4e56-a608-49db958cb88c-etc-sysctl-d\") pod \"tuned-mqdx9\" (UID: \"36619515-fe66-4e56-a608-49db958cb88c\") " pod="openshift-cluster-node-tuning-operator/tuned-mqdx9"
Jul 02 23:10:16.446190 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.445255    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d1f07f77-f80b-40b6-820d-bf77344e6724-cni-binary-copy\") pod \"multus-tvqsh\" (UID: \"d1f07f77-f80b-40b6-820d-bf77344e6724\") " pod="openshift-multus/multus-tvqsh"
Jul 02 23:10:16.446190 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.445265    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d1f07f77-f80b-40b6-820d-bf77344e6724-host-run-multus-certs\") pod \"multus-tvqsh\" (UID: \"d1f07f77-f80b-40b6-820d-bf77344e6724\") " pod="openshift-multus/multus-tvqsh"
Jul 02 23:10:16.446190 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.445295    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d9adaa10-5793-4280-9f7f-b7ff28a63c56-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-ngnnt\" (UID: \"d9adaa10-5793-4280-9f7f-b7ff28a63c56\") " pod="openshift-multus/multus-additional-cni-plugins-ngnnt"
Jul 02 23:10:16.446190 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.445337    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d1f07f77-f80b-40b6-820d-bf77344e6724-host-var-lib-cni-bin\") pod \"multus-tvqsh\" (UID: \"d1f07f77-f80b-40b6-820d-bf77344e6724\") " pod="openshift-multus/multus-tvqsh"
Jul 02 23:10:16.446190 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.445386    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/76a3ba4e-e12e-4949-a03b-2012fe8f772c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-xxshk\" (UID: \"76a3ba4e-e12e-4949-a03b-2012fe8f772c\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxshk"
Jul 02 23:10:16.446190 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.445417    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-txmh8\" (UniqueName: \"kubernetes.io/projected/8f153fd5-a05d-4f36-8295-6c95914702e9-kube-api-access-txmh8\") pod \"network-metrics-daemon-7qztm\" (UID: \"8f153fd5-a05d-4f36-8295-6c95914702e9\") " pod="openshift-multus/network-metrics-daemon-7qztm"
Jul 02 23:10:16.446190 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.445431    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d1f07f77-f80b-40b6-820d-bf77344e6724-cnibin\") pod \"multus-tvqsh\" (UID: \"d1f07f77-f80b-40b6-820d-bf77344e6724\") " pod="openshift-multus/multus-tvqsh"
Jul 02 23:10:16.446190 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.445473    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/cd0e2259-affc-47b6-8234-298d698a5a18-iptables-alerter-script\") pod \"iptables-alerter-gwfk5\" (UID: \"cd0e2259-affc-47b6-8234-298d698a5a18\") " pod="openshift-network-operator/iptables-alerter-gwfk5"
Jul 02 23:10:16.446190 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.445481    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d1f07f77-f80b-40b6-820d-bf77344e6724-host-run-multus-certs\") pod \"multus-tvqsh\" (UID: \"d1f07f77-f80b-40b6-820d-bf77344e6724\") " pod="openshift-multus/multus-tvqsh"
Jul 02 23:10:16.446190 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.445505    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d9adaa10-5793-4280-9f7f-b7ff28a63c56-tuning-conf-dir\") pod \"multus-additional-cni-plugins-ngnnt\" (UID: \"d9adaa10-5793-4280-9f7f-b7ff28a63c56\") " pod="openshift-multus/multus-additional-cni-plugins-ngnnt"
Jul 02 23:10:16.447075 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.445562    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d9adaa10-5793-4280-9f7f-b7ff28a63c56-cni-binary-copy\") pod \"multus-additional-cni-plugins-ngnnt\" (UID: \"d9adaa10-5793-4280-9f7f-b7ff28a63c56\") " pod="openshift-multus/multus-additional-cni-plugins-ngnnt"
Jul 02 23:10:16.447075 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.445563    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d1f07f77-f80b-40b6-820d-bf77344e6724-hostroot\") pod \"multus-tvqsh\" (UID: \"d1f07f77-f80b-40b6-820d-bf77344e6724\") " pod="openshift-multus/multus-tvqsh"
Jul 02 23:10:16.447075 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.445614    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g8qzm\" (UniqueName: \"kubernetes.io/projected/82fa80d2-d1b6-4aed-bd41-c32e9589c4b5-kube-api-access-g8qzm\") pod \"node-resolver-pbxh5\" (UID: \"82fa80d2-d1b6-4aed-bd41-c32e9589c4b5\") " pod="openshift-dns/node-resolver-pbxh5"
Jul 02 23:10:16.447075 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.445683    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d1f07f77-f80b-40b6-820d-bf77344e6724-multus-conf-dir\") pod \"multus-tvqsh\" (UID: \"d1f07f77-f80b-40b6-820d-bf77344e6724\") " pod="openshift-multus/multus-tvqsh"
Jul 02 23:10:16.447075 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.445703    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d9adaa10-5793-4280-9f7f-b7ff28a63c56-tuning-conf-dir\") pod \"multus-additional-cni-plugins-ngnnt\" (UID: \"d9adaa10-5793-4280-9f7f-b7ff28a63c56\") " pod="openshift-multus/multus-additional-cni-plugins-ngnnt"
Jul 02 23:10:16.447075 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.445715    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/76a3ba4e-e12e-4949-a03b-2012fe8f772c-host-run-netns\") pod \"ovnkube-node-xxshk\" (UID: \"76a3ba4e-e12e-4949-a03b-2012fe8f772c\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxshk"
Jul 02 23:10:16.447075 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.445748    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d1f07f77-f80b-40b6-820d-bf77344e6724-multus-conf-dir\") pod \"multus-tvqsh\" (UID: \"d1f07f77-f80b-40b6-820d-bf77344e6724\") " pod="openshift-multus/multus-tvqsh"
Jul 02 23:10:16.447075 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.445791    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/76a3ba4e-e12e-4949-a03b-2012fe8f772c-etc-openvswitch\") pod \"ovnkube-node-xxshk\" (UID: \"76a3ba4e-e12e-4949-a03b-2012fe8f772c\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxshk"
Jul 02 23:10:16.447075 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.445819    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/76a3ba4e-e12e-4949-a03b-2012fe8f772c-host-run-ovn-kubernetes\") pod \"ovnkube-node-xxshk\" (UID: \"76a3ba4e-e12e-4949-a03b-2012fe8f772c\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxshk"
Jul 02 23:10:16.447075 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.445860    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/76a3ba4e-e12e-4949-a03b-2012fe8f772c-ovn-node-metrics-cert\") pod \"ovnkube-node-xxshk\" (UID: \"76a3ba4e-e12e-4949-a03b-2012fe8f772c\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxshk"
Jul 02 23:10:16.447075 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.445890    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/76a3ba4e-e12e-4949-a03b-2012fe8f772c-ovnkube-script-lib\") pod \"ovnkube-node-xxshk\" (UID: \"76a3ba4e-e12e-4949-a03b-2012fe8f772c\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxshk"
Jul 02 23:10:16.447075 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.445925    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/cd0e2259-affc-47b6-8234-298d698a5a18-host-slash\") pod \"iptables-alerter-gwfk5\" (UID: \"cd0e2259-affc-47b6-8234-298d698a5a18\") " pod="openshift-network-operator/iptables-alerter-gwfk5"
Jul 02 23:10:16.447075 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.445954    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/07bf56c1-2a06-4268-a2e1-fa7572c6b568-device-dir\") pod \"aws-ebs-csi-driver-node-vsnbz\" (UID: \"07bf56c1-2a06-4268-a2e1-fa7572c6b568\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vsnbz"
Jul 02 23:10:16.447075 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.446003    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d9adaa10-5793-4280-9f7f-b7ff28a63c56-os-release\") pod \"multus-additional-cni-plugins-ngnnt\" (UID: \"d9adaa10-5793-4280-9f7f-b7ff28a63c56\") " pod="openshift-multus/multus-additional-cni-plugins-ngnnt"
Jul 02 23:10:16.447075 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.446030    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/203dd5bc-44ec-49b7-9065-d343c88157f1-dbus\") pod \"global-pull-secret-syncer-x9hkk\" (UID: \"203dd5bc-44ec-49b7-9065-d343c88157f1\") " pod="kube-system/global-pull-secret-syncer-x9hkk"
Jul 02 23:10:16.447075 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.446041    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d9adaa10-5793-4280-9f7f-b7ff28a63c56-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-ngnnt\" (UID: \"d9adaa10-5793-4280-9f7f-b7ff28a63c56\") " pod="openshift-multus/multus-additional-cni-plugins-ngnnt"
Jul 02 23:10:16.447075 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.446059    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/36619515-fe66-4e56-a608-49db958cb88c-etc-modprobe-d\") pod \"tuned-mqdx9\" (UID: \"36619515-fe66-4e56-a608-49db958cb88c\") " pod="openshift-cluster-node-tuning-operator/tuned-mqdx9"
Jul 02 23:10:16.447946 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.446161    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/36619515-fe66-4e56-a608-49db958cb88c-sys\") pod \"tuned-mqdx9\" (UID: \"36619515-fe66-4e56-a608-49db958cb88c\") " pod="openshift-cluster-node-tuning-operator/tuned-mqdx9"
Jul 02 23:10:16.447946 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.446170    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d9adaa10-5793-4280-9f7f-b7ff28a63c56-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-ngnnt\" (UID: \"d9adaa10-5793-4280-9f7f-b7ff28a63c56\") " pod="openshift-multus/multus-additional-cni-plugins-ngnnt"
Jul 02 23:10:16.447946 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.446185    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/cd0e2259-affc-47b6-8234-298d698a5a18-iptables-alerter-script\") pod \"iptables-alerter-gwfk5\" (UID: \"cd0e2259-affc-47b6-8234-298d698a5a18\") " pod="openshift-network-operator/iptables-alerter-gwfk5"
Jul 02 23:10:16.447946 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.446234    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/07bf56c1-2a06-4268-a2e1-fa7572c6b568-device-dir\") pod \"aws-ebs-csi-driver-node-vsnbz\" (UID: \"07bf56c1-2a06-4268-a2e1-fa7572c6b568\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vsnbz"
Jul 02 23:10:16.447946 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.446245    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/cd0e2259-affc-47b6-8234-298d698a5a18-host-slash\") pod \"iptables-alerter-gwfk5\" (UID: \"cd0e2259-affc-47b6-8234-298d698a5a18\") " pod="openshift-network-operator/iptables-alerter-gwfk5"
Jul 02 23:10:16.447946 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.446285    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/36619515-fe66-4e56-a608-49db958cb88c-var-lib-kubelet\") pod \"tuned-mqdx9\" (UID: \"36619515-fe66-4e56-a608-49db958cb88c\") " pod="openshift-cluster-node-tuning-operator/tuned-mqdx9"
Jul 02 23:10:16.447946 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.446306    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d9adaa10-5793-4280-9f7f-b7ff28a63c56-os-release\") pod \"multus-additional-cni-plugins-ngnnt\" (UID: \"d9adaa10-5793-4280-9f7f-b7ff28a63c56\") " pod="openshift-multus/multus-additional-cni-plugins-ngnnt"
Jul 02 23:10:16.447946 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.446329    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/36619515-fe66-4e56-a608-49db958cb88c-host\") pod \"tuned-mqdx9\" (UID: \"36619515-fe66-4e56-a608-49db958cb88c\") " pod="openshift-cluster-node-tuning-operator/tuned-mqdx9"
Jul 02 23:10:16.447946 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.446366    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pkq9n\" (UniqueName: \"kubernetes.io/projected/f8448dd8-d309-4d65-89c1-a7f6acc365cf-kube-api-access-pkq9n\") pod \"network-check-target-w8bhs\" (UID: \"f8448dd8-d309-4d65-89c1-a7f6acc365cf\") " pod="openshift-network-diagnostics/network-check-target-w8bhs"
Jul 02 23:10:16.447946 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.446395    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d1f07f77-f80b-40b6-820d-bf77344e6724-os-release\") pod \"multus-tvqsh\" (UID: \"d1f07f77-f80b-40b6-820d-bf77344e6724\") " pod="openshift-multus/multus-tvqsh"
Jul 02 23:10:16.447946 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.446421    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j54hf\" (UniqueName: \"kubernetes.io/projected/76a3ba4e-e12e-4949-a03b-2012fe8f772c-kube-api-access-j54hf\") pod \"ovnkube-node-xxshk\" (UID: \"76a3ba4e-e12e-4949-a03b-2012fe8f772c\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxshk"
Jul 02 23:10:16.447946 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.446461    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6758f85e-f0e3-4322-bae6-bbce4d0ba66f-agent-certs\") pod \"konnectivity-agent-dl7lg\" (UID: \"6758f85e-f0e3-4322-bae6-bbce4d0ba66f\") " pod="kube-system/konnectivity-agent-dl7lg"
Jul 02 23:10:16.447946 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.446486    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/36619515-fe66-4e56-a608-49db958cb88c-etc-kubernetes\") pod \"tuned-mqdx9\" (UID: \"36619515-fe66-4e56-a608-49db958cb88c\") " pod="openshift-cluster-node-tuning-operator/tuned-mqdx9"
Jul 02 23:10:16.447946 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.446512    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d1f07f77-f80b-40b6-820d-bf77344e6724-os-release\") pod \"multus-tvqsh\" (UID: \"d1f07f77-f80b-40b6-820d-bf77344e6724\") " pod="openshift-multus/multus-tvqsh"
Jul 02 23:10:16.447946 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.446520    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/82fa80d2-d1b6-4aed-bd41-c32e9589c4b5-hosts-file\") pod \"node-resolver-pbxh5\" (UID: \"82fa80d2-d1b6-4aed-bd41-c32e9589c4b5\") " pod="openshift-dns/node-resolver-pbxh5"
Jul 02 23:10:16.447946 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.446545    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/82fa80d2-d1b6-4aed-bd41-c32e9589c4b5-tmp-dir\") pod \"node-resolver-pbxh5\" (UID: \"82fa80d2-d1b6-4aed-bd41-c32e9589c4b5\") " pod="openshift-dns/node-resolver-pbxh5"
Jul 02 23:10:16.447946 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.446568    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/07bf56c1-2a06-4268-a2e1-fa7572c6b568-kubelet-dir\") pod \"aws-ebs-csi-driver-node-vsnbz\" (UID: \"07bf56c1-2a06-4268-a2e1-fa7572c6b568\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vsnbz"
Jul 02 23:10:16.448832 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.446624    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d1f07f77-f80b-40b6-820d-bf77344e6724-system-cni-dir\") pod \"multus-tvqsh\" (UID: \"d1f07f77-f80b-40b6-820d-bf77344e6724\") " pod="openshift-multus/multus-tvqsh"
Jul 02 23:10:16.448832 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.446656    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/07bf56c1-2a06-4268-a2e1-fa7572c6b568-kubelet-dir\") pod \"aws-ebs-csi-driver-node-vsnbz\" (UID: \"07bf56c1-2a06-4268-a2e1-fa7572c6b568\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vsnbz"
Jul 02 23:10:16.448832 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.446670    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gpgk5\" (UniqueName: \"kubernetes.io/projected/d1f07f77-f80b-40b6-820d-bf77344e6724-kube-api-access-gpgk5\") pod \"multus-tvqsh\" (UID: \"d1f07f77-f80b-40b6-820d-bf77344e6724\") " pod="openshift-multus/multus-tvqsh"
Jul 02 23:10:16.448832 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.446697    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d9adaa10-5793-4280-9f7f-b7ff28a63c56-system-cni-dir\") pod \"multus-additional-cni-plugins-ngnnt\" (UID: \"d9adaa10-5793-4280-9f7f-b7ff28a63c56\") " pod="openshift-multus/multus-additional-cni-plugins-ngnnt"
Jul 02 23:10:16.448832 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.446713    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d1f07f77-f80b-40b6-820d-bf77344e6724-system-cni-dir\") pod \"multus-tvqsh\" (UID: \"d1f07f77-f80b-40b6-820d-bf77344e6724\") " pod="openshift-multus/multus-tvqsh"
Jul 02 23:10:16.448832 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.446802    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/36619515-fe66-4e56-a608-49db958cb88c-etc-sysctl-conf\") pod \"tuned-mqdx9\" (UID: \"36619515-fe66-4e56-a608-49db958cb88c\") " pod="openshift-cluster-node-tuning-operator/tuned-mqdx9"
Jul 02 23:10:16.448832 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.446827    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/36619515-fe66-4e56-a608-49db958cb88c-etc-systemd\") pod \"tuned-mqdx9\" (UID: \"36619515-fe66-4e56-a608-49db958cb88c\") " pod="openshift-cluster-node-tuning-operator/tuned-mqdx9"
Jul 02 23:10:16.448832 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.446850    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d9adaa10-5793-4280-9f7f-b7ff28a63c56-system-cni-dir\") pod \"multus-additional-cni-plugins-ngnnt\" (UID: \"d9adaa10-5793-4280-9f7f-b7ff28a63c56\") " pod="openshift-multus/multus-additional-cni-plugins-ngnnt"
Jul 02 23:10:16.448832 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.446880    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/07bf56c1-2a06-4268-a2e1-fa7572c6b568-sys-fs\") pod \"aws-ebs-csi-driver-node-vsnbz\" (UID: \"07bf56c1-2a06-4268-a2e1-fa7572c6b568\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vsnbz"
Jul 02 23:10:16.448832 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.446906    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d9adaa10-5793-4280-9f7f-b7ff28a63c56-cnibin\") pod \"multus-additional-cni-plugins-ngnnt\" (UID: \"d9adaa10-5793-4280-9f7f-b7ff28a63c56\") " pod="openshift-multus/multus-additional-cni-plugins-ngnnt"
Jul 02 23:10:16.448832 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.446922    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/07bf56c1-2a06-4268-a2e1-fa7572c6b568-sys-fs\") pod \"aws-ebs-csi-driver-node-vsnbz\" (UID: \"07bf56c1-2a06-4268-a2e1-fa7572c6b568\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vsnbz"
Jul 02 23:10:16.448832 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.446928    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d394571a-8c62-4248-a9eb-9b165f3dfea3-serviceca\") pod \"node-ca-zd96c\" (UID: \"d394571a-8c62-4248-a9eb-9b165f3dfea3\") " pod="openshift-image-registry/node-ca-zd96c"
Jul 02 23:10:16.448832 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.446944    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d1f07f77-f80b-40b6-820d-bf77344e6724-host-var-lib-kubelet\") pod \"multus-tvqsh\" (UID: \"d1f07f77-f80b-40b6-820d-bf77344e6724\") " pod="openshift-multus/multus-tvqsh"
Jul 02 23:10:16.448832 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.446960    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/76a3ba4e-e12e-4949-a03b-2012fe8f772c-host-kubelet\") pod \"ovnkube-node-xxshk\" (UID: \"76a3ba4e-e12e-4949-a03b-2012fe8f772c\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxshk"
Jul 02 23:10:16.448832 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.446976    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/76a3ba4e-e12e-4949-a03b-2012fe8f772c-run-openvswitch\") pod \"ovnkube-node-xxshk\" (UID: \"76a3ba4e-e12e-4949-a03b-2012fe8f772c\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxshk"
Jul 02 23:10:16.448832 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.447029    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d1f07f77-f80b-40b6-820d-bf77344e6724-host-var-lib-kubelet\") pod \"multus-tvqsh\" (UID: \"d1f07f77-f80b-40b6-820d-bf77344e6724\") " pod="openshift-multus/multus-tvqsh"
Jul 02 23:10:16.448832 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.447032    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d9adaa10-5793-4280-9f7f-b7ff28a63c56-cnibin\") pod \"multus-additional-cni-plugins-ngnnt\" (UID: \"d9adaa10-5793-4280-9f7f-b7ff28a63c56\") " pod="openshift-multus/multus-additional-cni-plugins-ngnnt"
Jul 02 23:10:16.449731 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.447061    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/76a3ba4e-e12e-4949-a03b-2012fe8f772c-host-cni-bin\") pod \"ovnkube-node-xxshk\" (UID: \"76a3ba4e-e12e-4949-a03b-2012fe8f772c\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxshk"
Jul 02 23:10:16.449731 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.447356    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d394571a-8c62-4248-a9eb-9b165f3dfea3-serviceca\") pod \"node-ca-zd96c\" (UID: \"d394571a-8c62-4248-a9eb-9b165f3dfea3\") " pod="openshift-image-registry/node-ca-zd96c"
Jul 02 23:10:16.470473 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.470436    2580 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 02 23:10:16.474650 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.474623    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t7htq\" (UniqueName: \"kubernetes.io/projected/d394571a-8c62-4248-a9eb-9b165f3dfea3-kube-api-access-t7htq\") pod \"node-ca-zd96c\" (UID: \"d394571a-8c62-4248-a9eb-9b165f3dfea3\") " pod="openshift-image-registry/node-ca-zd96c"
Jul 02 23:10:16.480787 ip-10-0-135-187 kubenswrapper[2580]: E0702 23:10:16.480762    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 02 23:10:16.480907 ip-10-0-135-187 kubenswrapper[2580]: E0702 23:10:16.480798    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 02 23:10:16.480907 ip-10-0-135-187 kubenswrapper[2580]: E0702 23:10:16.480813    2580 projected.go:196] Error preparing data for projected volume kube-api-access-pkq9n for pod openshift-network-diagnostics/network-check-target-w8bhs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 23:10:16.480907 ip-10-0-135-187 kubenswrapper[2580]: E0702 23:10:16.480895    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f8448dd8-d309-4d65-89c1-a7f6acc365cf-kube-api-access-pkq9n podName:f8448dd8-d309-4d65-89c1-a7f6acc365cf nodeName:}" failed. No retries permitted until 2026-07-02 23:10:16.980861599 +0000 UTC m=+2.998292796 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-pkq9n" (UniqueName: "kubernetes.io/projected/f8448dd8-d309-4d65-89c1-a7f6acc365cf-kube-api-access-pkq9n") pod "network-check-target-w8bhs" (UID: "f8448dd8-d309-4d65-89c1-a7f6acc365cf") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 23:10:16.481137 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.481113    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r2svx\" (UniqueName: \"kubernetes.io/projected/07bf56c1-2a06-4268-a2e1-fa7572c6b568-kube-api-access-r2svx\") pod \"aws-ebs-csi-driver-node-vsnbz\" (UID: \"07bf56c1-2a06-4268-a2e1-fa7572c6b568\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vsnbz"
Jul 02 23:10:16.482590 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.482563    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sbmmj\" (UniqueName: \"kubernetes.io/projected/d9adaa10-5793-4280-9f7f-b7ff28a63c56-kube-api-access-sbmmj\") pod \"multus-additional-cni-plugins-ngnnt\" (UID: \"d9adaa10-5793-4280-9f7f-b7ff28a63c56\") " pod="openshift-multus/multus-additional-cni-plugins-ngnnt"
Jul 02 23:10:16.482801 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.482783    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g57pz\" (UniqueName: \"kubernetes.io/projected/cd0e2259-affc-47b6-8234-298d698a5a18-kube-api-access-g57pz\") pod \"iptables-alerter-gwfk5\" (UID: \"cd0e2259-affc-47b6-8234-298d698a5a18\") " pod="openshift-network-operator/iptables-alerter-gwfk5"
Jul 02 23:10:16.483754 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.483737    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gpgk5\" (UniqueName: \"kubernetes.io/projected/d1f07f77-f80b-40b6-820d-bf77344e6724-kube-api-access-gpgk5\") pod \"multus-tvqsh\" (UID: \"d1f07f77-f80b-40b6-820d-bf77344e6724\") " pod="openshift-multus/multus-tvqsh"
Jul 02 23:10:16.547424 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.547388    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/76a3ba4e-e12e-4949-a03b-2012fe8f772c-host-run-netns\") pod \"ovnkube-node-xxshk\" (UID: \"76a3ba4e-e12e-4949-a03b-2012fe8f772c\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxshk"
Jul 02 23:10:16.547572 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.547435    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/76a3ba4e-e12e-4949-a03b-2012fe8f772c-etc-openvswitch\") pod \"ovnkube-node-xxshk\" (UID: \"76a3ba4e-e12e-4949-a03b-2012fe8f772c\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxshk"
Jul 02 23:10:16.547572 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.547505    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/76a3ba4e-e12e-4949-a03b-2012fe8f772c-host-run-netns\") pod \"ovnkube-node-xxshk\" (UID: \"76a3ba4e-e12e-4949-a03b-2012fe8f772c\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxshk"
Jul 02 23:10:16.547572 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.547523    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/76a3ba4e-e12e-4949-a03b-2012fe8f772c-etc-openvswitch\") pod \"ovnkube-node-xxshk\" (UID: \"76a3ba4e-e12e-4949-a03b-2012fe8f772c\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxshk"
Jul 02 23:10:16.547572 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.547552    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/76a3ba4e-e12e-4949-a03b-2012fe8f772c-host-run-ovn-kubernetes\") pod \"ovnkube-node-xxshk\" (UID: \"76a3ba4e-e12e-4949-a03b-2012fe8f772c\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxshk"
Jul 02 23:10:16.547753 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.547590    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/76a3ba4e-e12e-4949-a03b-2012fe8f772c-ovn-node-metrics-cert\") pod \"ovnkube-node-xxshk\" (UID: \"76a3ba4e-e12e-4949-a03b-2012fe8f772c\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxshk"
Jul 02 23:10:16.547753 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.547614    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/76a3ba4e-e12e-4949-a03b-2012fe8f772c-ovnkube-script-lib\") pod \"ovnkube-node-xxshk\" (UID: \"76a3ba4e-e12e-4949-a03b-2012fe8f772c\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxshk"
Jul 02 23:10:16.547753 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.547642    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/203dd5bc-44ec-49b7-9065-d343c88157f1-dbus\") pod \"global-pull-secret-syncer-x9hkk\" (UID: \"203dd5bc-44ec-49b7-9065-d343c88157f1\") " pod="kube-system/global-pull-secret-syncer-x9hkk"
Jul 02 23:10:16.547753 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.547666    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/36619515-fe66-4e56-a608-49db958cb88c-etc-modprobe-d\") pod \"tuned-mqdx9\" (UID: \"36619515-fe66-4e56-a608-49db958cb88c\") " pod="openshift-cluster-node-tuning-operator/tuned-mqdx9"
Jul 02 23:10:16.547753 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.547660    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/76a3ba4e-e12e-4949-a03b-2012fe8f772c-host-run-ovn-kubernetes\") pod \"ovnkube-node-xxshk\" (UID: \"76a3ba4e-e12e-4949-a03b-2012fe8f772c\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxshk"
Jul 02 23:10:16.547753 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.547691    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/36619515-fe66-4e56-a608-49db958cb88c-sys\") pod \"tuned-mqdx9\" (UID: \"36619515-fe66-4e56-a608-49db958cb88c\") " pod="openshift-cluster-node-tuning-operator/tuned-mqdx9"
Jul 02 23:10:16.547753 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.547713    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/36619515-fe66-4e56-a608-49db958cb88c-var-lib-kubelet\") pod \"tuned-mqdx9\" (UID: \"36619515-fe66-4e56-a608-49db958cb88c\") " pod="openshift-cluster-node-tuning-operator/tuned-mqdx9"
Jul 02 23:10:16.547753 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.547735    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/36619515-fe66-4e56-a608-49db958cb88c-host\") pod \"tuned-mqdx9\" (UID: \"36619515-fe66-4e56-a608-49db958cb88c\") " pod="openshift-cluster-node-tuning-operator/tuned-mqdx9"
Jul 02 23:10:16.548113 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.547757    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/203dd5bc-44ec-49b7-9065-d343c88157f1-dbus\") pod \"global-pull-secret-syncer-x9hkk\" (UID: \"203dd5bc-44ec-49b7-9065-d343c88157f1\") " pod="kube-system/global-pull-secret-syncer-x9hkk"
Jul 02 23:10:16.548113 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.547782    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j54hf\" (UniqueName: \"kubernetes.io/projected/76a3ba4e-e12e-4949-a03b-2012fe8f772c-kube-api-access-j54hf\") pod \"ovnkube-node-xxshk\" (UID: \"76a3ba4e-e12e-4949-a03b-2012fe8f772c\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxshk"
Jul 02 23:10:16.548113 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.547815    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6758f85e-f0e3-4322-bae6-bbce4d0ba66f-agent-certs\") pod \"konnectivity-agent-dl7lg\" (UID: \"6758f85e-f0e3-4322-bae6-bbce4d0ba66f\") " pod="kube-system/konnectivity-agent-dl7lg"
Jul 02 23:10:16.548113 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.547813    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/36619515-fe66-4e56-a608-49db958cb88c-etc-modprobe-d\") pod \"tuned-mqdx9\" (UID: \"36619515-fe66-4e56-a608-49db958cb88c\") " pod="openshift-cluster-node-tuning-operator/tuned-mqdx9"
Jul 02 23:10:16.548113 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.547833    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/36619515-fe66-4e56-a608-49db958cb88c-host\") pod \"tuned-mqdx9\" (UID: \"36619515-fe66-4e56-a608-49db958cb88c\") " pod="openshift-cluster-node-tuning-operator/tuned-mqdx9"
Jul 02 23:10:16.548113 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.547850    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/36619515-fe66-4e56-a608-49db958cb88c-sys\") pod \"tuned-mqdx9\" (UID: \"36619515-fe66-4e56-a608-49db958cb88c\") " pod="openshift-cluster-node-tuning-operator/tuned-mqdx9"
Jul 02 23:10:16.548436 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.548128    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/36619515-fe66-4e56-a608-49db958cb88c-etc-kubernetes\") pod \"tuned-mqdx9\" (UID: \"36619515-fe66-4e56-a608-49db958cb88c\") " pod="openshift-cluster-node-tuning-operator/tuned-mqdx9"
Jul 02 23:10:16.548436 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.548263    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/82fa80d2-d1b6-4aed-bd41-c32e9589c4b5-hosts-file\") pod \"node-resolver-pbxh5\" (UID: \"82fa80d2-d1b6-4aed-bd41-c32e9589c4b5\") " pod="openshift-dns/node-resolver-pbxh5"
Jul 02 23:10:16.548436 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.548326    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/82fa80d2-d1b6-4aed-bd41-c32e9589c4b5-tmp-dir\") pod \"node-resolver-pbxh5\" (UID: \"82fa80d2-d1b6-4aed-bd41-c32e9589c4b5\") " pod="openshift-dns/node-resolver-pbxh5"
Jul 02 23:10:16.548855 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.548353    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/36619515-fe66-4e56-a608-49db958cb88c-etc-kubernetes\") pod \"tuned-mqdx9\" (UID: \"36619515-fe66-4e56-a608-49db958cb88c\") " pod="openshift-cluster-node-tuning-operator/tuned-mqdx9"
Jul 02 23:10:16.549100 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.548360    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/36619515-fe66-4e56-a608-49db958cb88c-etc-sysctl-conf\") pod \"tuned-mqdx9\" (UID: \"36619515-fe66-4e56-a608-49db958cb88c\") " pod="openshift-cluster-node-tuning-operator/tuned-mqdx9"
Jul 02 23:10:16.549293 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.549226    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/36619515-fe66-4e56-a608-49db958cb88c-etc-systemd\") pod \"tuned-mqdx9\" (UID: \"36619515-fe66-4e56-a608-49db958cb88c\") " pod="openshift-cluster-node-tuning-operator/tuned-mqdx9"
Jul 02 23:10:16.549426 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.549325    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/36619515-fe66-4e56-a608-49db958cb88c-etc-sysctl-conf\") pod \"tuned-mqdx9\" (UID: \"36619515-fe66-4e56-a608-49db958cb88c\") " pod="openshift-cluster-node-tuning-operator/tuned-mqdx9"
Jul 02 23:10:16.549508 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.549490    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/76a3ba4e-e12e-4949-a03b-2012fe8f772c-ovnkube-script-lib\") pod \"ovnkube-node-xxshk\" (UID: \"76a3ba4e-e12e-4949-a03b-2012fe8f772c\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxshk"
Jul 02 23:10:16.549578 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.549562    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/36619515-fe66-4e56-a608-49db958cb88c-etc-systemd\") pod \"tuned-mqdx9\" (UID: \"36619515-fe66-4e56-a608-49db958cb88c\") " pod="openshift-cluster-node-tuning-operator/tuned-mqdx9"
Jul 02 23:10:16.549652 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.549638    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/76a3ba4e-e12e-4949-a03b-2012fe8f772c-host-kubelet\") pod \"ovnkube-node-xxshk\" (UID: \"76a3ba4e-e12e-4949-a03b-2012fe8f772c\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxshk"
Jul 02 23:10:16.549722 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.549708    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/82fa80d2-d1b6-4aed-bd41-c32e9589c4b5-hosts-file\") pod \"node-resolver-pbxh5\" (UID: \"82fa80d2-d1b6-4aed-bd41-c32e9589c4b5\") " pod="openshift-dns/node-resolver-pbxh5"
Jul 02 23:10:16.549813 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.549454    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/76a3ba4e-e12e-4949-a03b-2012fe8f772c-host-kubelet\") pod \"ovnkube-node-xxshk\" (UID: \"76a3ba4e-e12e-4949-a03b-2012fe8f772c\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxshk"
Jul 02 23:10:16.549888 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.549860    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/76a3ba4e-e12e-4949-a03b-2012fe8f772c-run-openvswitch\") pod \"ovnkube-node-xxshk\" (UID: \"76a3ba4e-e12e-4949-a03b-2012fe8f772c\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxshk"
Jul 02 23:10:16.549929 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.549913    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/76a3ba4e-e12e-4949-a03b-2012fe8f772c-host-cni-bin\") pod \"ovnkube-node-xxshk\" (UID: \"76a3ba4e-e12e-4949-a03b-2012fe8f772c\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxshk"
Jul 02 23:10:16.549966 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.549952    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/76a3ba4e-e12e-4949-a03b-2012fe8f772c-ovnkube-config\") pod \"ovnkube-node-xxshk\" (UID: \"76a3ba4e-e12e-4949-a03b-2012fe8f772c\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxshk"
Jul 02 23:10:16.550002 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.549991    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/36619515-fe66-4e56-a608-49db958cb88c-run\") pod \"tuned-mqdx9\" (UID: \"36619515-fe66-4e56-a608-49db958cb88c\") " pod="openshift-cluster-node-tuning-operator/tuned-mqdx9"
Jul 02 23:10:16.550052 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.550018    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/76a3ba4e-e12e-4949-a03b-2012fe8f772c-run-openvswitch\") pod \"ovnkube-node-xxshk\" (UID: \"76a3ba4e-e12e-4949-a03b-2012fe8f772c\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxshk"
Jul 02 23:10:16.550101 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.550038    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/76a3ba4e-e12e-4949-a03b-2012fe8f772c-node-log\") pod \"ovnkube-node-xxshk\" (UID: \"76a3ba4e-e12e-4949-a03b-2012fe8f772c\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxshk"
Jul 02 23:10:16.550161 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.550105    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8f153fd5-a05d-4f36-8295-6c95914702e9-metrics-certs\") pod \"network-metrics-daemon-7qztm\" (UID: \"8f153fd5-a05d-4f36-8295-6c95914702e9\") " pod="openshift-multus/network-metrics-daemon-7qztm"
Jul 02 23:10:16.550161 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.550110    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/36619515-fe66-4e56-a608-49db958cb88c-run\") pod \"tuned-mqdx9\" (UID: \"36619515-fe66-4e56-a608-49db958cb88c\") " pod="openshift-cluster-node-tuning-operator/tuned-mqdx9"
Jul 02 23:10:16.550161 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.550025    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/82fa80d2-d1b6-4aed-bd41-c32e9589c4b5-tmp-dir\") pod \"node-resolver-pbxh5\" (UID: \"82fa80d2-d1b6-4aed-bd41-c32e9589c4b5\") " pod="openshift-dns/node-resolver-pbxh5"
Jul 02 23:10:16.550161 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.550153    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/36619515-fe66-4e56-a608-49db958cb88c-etc-sysconfig\") pod \"tuned-mqdx9\" (UID: \"36619515-fe66-4e56-a608-49db958cb88c\") " pod="openshift-cluster-node-tuning-operator/tuned-mqdx9"
Jul 02 23:10:16.550385 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.550221    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/36619515-fe66-4e56-a608-49db958cb88c-tmp\") pod \"tuned-mqdx9\" (UID: \"36619515-fe66-4e56-a608-49db958cb88c\") " pod="openshift-cluster-node-tuning-operator/tuned-mqdx9"
Jul 02 23:10:16.550385 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.550226    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/36619515-fe66-4e56-a608-49db958cb88c-var-lib-kubelet\") pod \"tuned-mqdx9\" (UID: \"36619515-fe66-4e56-a608-49db958cb88c\") " pod="openshift-cluster-node-tuning-operator/tuned-mqdx9"
Jul 02 23:10:16.550494 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.550380    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/76a3ba4e-e12e-4949-a03b-2012fe8f772c-host-cni-bin\") pod \"ovnkube-node-xxshk\" (UID: \"76a3ba4e-e12e-4949-a03b-2012fe8f772c\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxshk"
Jul 02 23:10:16.550494 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.550479    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/76a3ba4e-e12e-4949-a03b-2012fe8f772c-node-log\") pod \"ovnkube-node-xxshk\" (UID: \"76a3ba4e-e12e-4949-a03b-2012fe8f772c\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxshk"
Jul 02 23:10:16.551086 ip-10-0-135-187 kubenswrapper[2580]: E0702 23:10:16.550590    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 23:10:16.551086 ip-10-0-135-187 kubenswrapper[2580]: E0702 23:10:16.550817    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8f153fd5-a05d-4f36-8295-6c95914702e9-metrics-certs podName:8f153fd5-a05d-4f36-8295-6c95914702e9 nodeName:}" failed. No retries permitted until 2026-07-02 23:10:17.050795338 +0000 UTC m=+3.068226520 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8f153fd5-a05d-4f36-8295-6c95914702e9-metrics-certs") pod "network-metrics-daemon-7qztm" (UID: "8f153fd5-a05d-4f36-8295-6c95914702e9") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 23:10:16.551086 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.550857    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/76a3ba4e-e12e-4949-a03b-2012fe8f772c-ovnkube-config\") pod \"ovnkube-node-xxshk\" (UID: \"76a3ba4e-e12e-4949-a03b-2012fe8f772c\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxshk"
Jul 02 23:10:16.551086 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.550919    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/76a3ba4e-e12e-4949-a03b-2012fe8f772c-ovn-node-metrics-cert\") pod \"ovnkube-node-xxshk\" (UID: \"76a3ba4e-e12e-4949-a03b-2012fe8f772c\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxshk"
Jul 02 23:10:16.551394 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.551129    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/36619515-fe66-4e56-a608-49db958cb88c-etc-sysconfig\") pod \"tuned-mqdx9\" (UID: \"36619515-fe66-4e56-a608-49db958cb88c\") " pod="openshift-cluster-node-tuning-operator/tuned-mqdx9"
Jul 02 23:10:16.551394 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.551313    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/76a3ba4e-e12e-4949-a03b-2012fe8f772c-run-systemd\") pod \"ovnkube-node-xxshk\" (UID: \"76a3ba4e-e12e-4949-a03b-2012fe8f772c\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxshk"
Jul 02 23:10:16.551394 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.551372    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/76a3ba4e-e12e-4949-a03b-2012fe8f772c-var-lib-openvswitch\") pod \"ovnkube-node-xxshk\" (UID: \"76a3ba4e-e12e-4949-a03b-2012fe8f772c\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxshk"
Jul 02 23:10:16.551536 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.551424    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4h2fc\" (UniqueName: \"kubernetes.io/projected/36619515-fe66-4e56-a608-49db958cb88c-kube-api-access-4h2fc\") pod \"tuned-mqdx9\" (UID: \"36619515-fe66-4e56-a608-49db958cb88c\") " pod="openshift-cluster-node-tuning-operator/tuned-mqdx9"
Jul 02 23:10:16.551536 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.551472    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/76a3ba4e-e12e-4949-a03b-2012fe8f772c-host-cni-netd\") pod \"ovnkube-node-xxshk\" (UID: \"76a3ba4e-e12e-4949-a03b-2012fe8f772c\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxshk"
Jul 02 23:10:16.551536 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.551471    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/76a3ba4e-e12e-4949-a03b-2012fe8f772c-run-systemd\") pod \"ovnkube-node-xxshk\" (UID: \"76a3ba4e-e12e-4949-a03b-2012fe8f772c\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxshk"
Jul 02 23:10:16.551677 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.551560    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/76a3ba4e-e12e-4949-a03b-2012fe8f772c-host-cni-netd\") pod \"ovnkube-node-xxshk\" (UID: \"76a3ba4e-e12e-4949-a03b-2012fe8f772c\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxshk"
Jul 02 23:10:16.551677 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.551564    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/76a3ba4e-e12e-4949-a03b-2012fe8f772c-var-lib-openvswitch\") pod \"ovnkube-node-xxshk\" (UID: \"76a3ba4e-e12e-4949-a03b-2012fe8f772c\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxshk"
Jul 02 23:10:16.551677 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.551591    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/76a3ba4e-e12e-4949-a03b-2012fe8f772c-run-ovn\") pod \"ovnkube-node-xxshk\" (UID: \"76a3ba4e-e12e-4949-a03b-2012fe8f772c\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxshk"
Jul 02 23:10:16.551677 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.551643    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/76a3ba4e-e12e-4949-a03b-2012fe8f772c-log-socket\") pod \"ovnkube-node-xxshk\" (UID: \"76a3ba4e-e12e-4949-a03b-2012fe8f772c\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxshk"
Jul 02 23:10:16.551867 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.551676    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/36619515-fe66-4e56-a608-49db958cb88c-etc-tuned\") pod \"tuned-mqdx9\" (UID: \"36619515-fe66-4e56-a608-49db958cb88c\") " pod="openshift-cluster-node-tuning-operator/tuned-mqdx9"
Jul 02 23:10:16.551867 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.551726    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/76a3ba4e-e12e-4949-a03b-2012fe8f772c-systemd-units\") pod \"ovnkube-node-xxshk\" (UID: \"76a3ba4e-e12e-4949-a03b-2012fe8f772c\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxshk"
Jul 02 23:10:16.551867 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.551753    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/76a3ba4e-e12e-4949-a03b-2012fe8f772c-host-slash\") pod \"ovnkube-node-xxshk\" (UID: \"76a3ba4e-e12e-4949-a03b-2012fe8f772c\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxshk"
Jul 02 23:10:16.551867 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.551809    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/203dd5bc-44ec-49b7-9065-d343c88157f1-kubelet-config\") pod \"global-pull-secret-syncer-x9hkk\" (UID: \"203dd5bc-44ec-49b7-9065-d343c88157f1\") " pod="kube-system/global-pull-secret-syncer-x9hkk"
Jul 02 23:10:16.552062 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.551865    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6758f85e-f0e3-4322-bae6-bbce4d0ba66f-konnectivity-ca\") pod \"konnectivity-agent-dl7lg\" (UID: \"6758f85e-f0e3-4322-bae6-bbce4d0ba66f\") " pod="kube-system/konnectivity-agent-dl7lg"
Jul 02 23:10:16.552062 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.551911    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/36619515-fe66-4e56-a608-49db958cb88c-lib-modules\") pod \"tuned-mqdx9\" (UID: \"36619515-fe66-4e56-a608-49db958cb88c\") " pod="openshift-cluster-node-tuning-operator/tuned-mqdx9"
Jul 02 23:10:16.552062 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.551986    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/76a3ba4e-e12e-4949-a03b-2012fe8f772c-env-overrides\") pod \"ovnkube-node-xxshk\" (UID: \"76a3ba4e-e12e-4949-a03b-2012fe8f772c\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxshk"
Jul 02 23:10:16.552062 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.552028    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/203dd5bc-44ec-49b7-9065-d343c88157f1-original-pull-secret\") pod \"global-pull-secret-syncer-x9hkk\" (UID: \"203dd5bc-44ec-49b7-9065-d343c88157f1\") " pod="kube-system/global-pull-secret-syncer-x9hkk"
Jul 02 23:10:16.552253 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.552061    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/36619515-fe66-4e56-a608-49db958cb88c-etc-sysctl-d\") pod \"tuned-mqdx9\" (UID: \"36619515-fe66-4e56-a608-49db958cb88c\") " pod="openshift-cluster-node-tuning-operator/tuned-mqdx9"
Jul 02 23:10:16.552253 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.552123    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/76a3ba4e-e12e-4949-a03b-2012fe8f772c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-xxshk\" (UID: \"76a3ba4e-e12e-4949-a03b-2012fe8f772c\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxshk"
Jul 02 23:10:16.552253 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.552171    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-txmh8\" (UniqueName: \"kubernetes.io/projected/8f153fd5-a05d-4f36-8295-6c95914702e9-kube-api-access-txmh8\") pod \"network-metrics-daemon-7qztm\" (UID: \"8f153fd5-a05d-4f36-8295-6c95914702e9\") " pod="openshift-multus/network-metrics-daemon-7qztm"
Jul 02 23:10:16.552253 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.552216    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g8qzm\" (UniqueName: \"kubernetes.io/projected/82fa80d2-d1b6-4aed-bd41-c32e9589c4b5-kube-api-access-g8qzm\") pod \"node-resolver-pbxh5\" (UID: \"82fa80d2-d1b6-4aed-bd41-c32e9589c4b5\") " pod="openshift-dns/node-resolver-pbxh5"
Jul 02 23:10:16.555054 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.552534    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/76a3ba4e-e12e-4949-a03b-2012fe8f772c-run-ovn\") pod \"ovnkube-node-xxshk\" (UID: \"76a3ba4e-e12e-4949-a03b-2012fe8f772c\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxshk"
Jul 02 23:10:16.555054 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.552614    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/76a3ba4e-e12e-4949-a03b-2012fe8f772c-log-socket\") pod \"ovnkube-node-xxshk\" (UID: \"76a3ba4e-e12e-4949-a03b-2012fe8f772c\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxshk"
Jul 02 23:10:16.555054 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.552752    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/36619515-fe66-4e56-a608-49db958cb88c-lib-modules\") pod \"tuned-mqdx9\" (UID: \"36619515-fe66-4e56-a608-49db958cb88c\") " pod="openshift-cluster-node-tuning-operator/tuned-mqdx9"
Jul 02 23:10:16.555054 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.552826    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/76a3ba4e-e12e-4949-a03b-2012fe8f772c-systemd-units\") pod \"ovnkube-node-xxshk\" (UID: \"76a3ba4e-e12e-4949-a03b-2012fe8f772c\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxshk"
Jul 02 23:10:16.555054 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.552868    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/76a3ba4e-e12e-4949-a03b-2012fe8f772c-host-slash\") pod \"ovnkube-node-xxshk\" (UID: \"76a3ba4e-e12e-4949-a03b-2012fe8f772c\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxshk"
Jul 02 23:10:16.555054 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.552949    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/203dd5bc-44ec-49b7-9065-d343c88157f1-kubelet-config\") pod \"global-pull-secret-syncer-x9hkk\" (UID: \"203dd5bc-44ec-49b7-9065-d343c88157f1\") " pod="kube-system/global-pull-secret-syncer-x9hkk"
Jul 02 23:10:16.555054 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.553226    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/76a3ba4e-e12e-4949-a03b-2012fe8f772c-env-overrides\") pod \"ovnkube-node-xxshk\" (UID: \"76a3ba4e-e12e-4949-a03b-2012fe8f772c\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxshk"
Jul 02 23:10:16.555054 ip-10-0-135-187 kubenswrapper[2580]: E0702 23:10:16.553377    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 02 23:10:16.555054 ip-10-0-135-187 kubenswrapper[2580]: E0702 23:10:16.553530    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/203dd5bc-44ec-49b7-9065-d343c88157f1-original-pull-secret podName:203dd5bc-44ec-49b7-9065-d343c88157f1 nodeName:}" failed. No retries permitted until 2026-07-02 23:10:17.053512483 +0000 UTC m=+3.070943677 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/203dd5bc-44ec-49b7-9065-d343c88157f1-original-pull-secret") pod "global-pull-secret-syncer-x9hkk" (UID: "203dd5bc-44ec-49b7-9065-d343c88157f1") : object "kube-system"/"original-pull-secret" not registered
Jul 02 23:10:16.555054 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.553571    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6758f85e-f0e3-4322-bae6-bbce4d0ba66f-konnectivity-ca\") pod \"konnectivity-agent-dl7lg\" (UID: \"6758f85e-f0e3-4322-bae6-bbce4d0ba66f\") " pod="kube-system/konnectivity-agent-dl7lg"
Jul 02 23:10:16.555054 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.553649    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/76a3ba4e-e12e-4949-a03b-2012fe8f772c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-xxshk\" (UID: \"76a3ba4e-e12e-4949-a03b-2012fe8f772c\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxshk"
Jul 02 23:10:16.555054 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.553692    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/36619515-fe66-4e56-a608-49db958cb88c-etc-sysctl-d\") pod \"tuned-mqdx9\" (UID: \"36619515-fe66-4e56-a608-49db958cb88c\") " pod="openshift-cluster-node-tuning-operator/tuned-mqdx9"
Jul 02 23:10:16.555054 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.553757    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/36619515-fe66-4e56-a608-49db958cb88c-tmp\") pod \"tuned-mqdx9\" (UID: \"36619515-fe66-4e56-a608-49db958cb88c\") " pod="openshift-cluster-node-tuning-operator/tuned-mqdx9"
Jul 02 23:10:16.556121 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.555950    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/36619515-fe66-4e56-a608-49db958cb88c-etc-tuned\") pod \"tuned-mqdx9\" (UID: \"36619515-fe66-4e56-a608-49db958cb88c\") " pod="openshift-cluster-node-tuning-operator/tuned-mqdx9"
Jul 02 23:10:16.556839 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.556809    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6758f85e-f0e3-4322-bae6-bbce4d0ba66f-agent-certs\") pod \"konnectivity-agent-dl7lg\" (UID: \"6758f85e-f0e3-4322-bae6-bbce4d0ba66f\") " pod="kube-system/konnectivity-agent-dl7lg"
Jul 02 23:10:16.560405 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.560383    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j54hf\" (UniqueName: \"kubernetes.io/projected/76a3ba4e-e12e-4949-a03b-2012fe8f772c-kube-api-access-j54hf\") pod \"ovnkube-node-xxshk\" (UID: \"76a3ba4e-e12e-4949-a03b-2012fe8f772c\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxshk"
Jul 02 23:10:16.562063 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.562035    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g8qzm\" (UniqueName: \"kubernetes.io/projected/82fa80d2-d1b6-4aed-bd41-c32e9589c4b5-kube-api-access-g8qzm\") pod \"node-resolver-pbxh5\" (UID: \"82fa80d2-d1b6-4aed-bd41-c32e9589c4b5\") " pod="openshift-dns/node-resolver-pbxh5"
Jul 02 23:10:16.562346 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.562320    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4h2fc\" (UniqueName: \"kubernetes.io/projected/36619515-fe66-4e56-a608-49db958cb88c-kube-api-access-4h2fc\") pod \"tuned-mqdx9\" (UID: \"36619515-fe66-4e56-a608-49db958cb88c\") " pod="openshift-cluster-node-tuning-operator/tuned-mqdx9"
Jul 02 23:10:16.563236 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.563213    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-txmh8\" (UniqueName: \"kubernetes.io/projected/8f153fd5-a05d-4f36-8295-6c95914702e9-kube-api-access-txmh8\") pod \"network-metrics-daemon-7qztm\" (UID: \"8f153fd5-a05d-4f36-8295-6c95914702e9\") " pod="openshift-multus/network-metrics-daemon-7qztm"
Jul 02 23:10:16.615291 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.615243    2580 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 02 23:10:16.641665 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.641634    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-ngnnt"
Jul 02 23:10:16.651990 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.651964    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-gwfk5"
Jul 02 23:10:16.663888 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.663867    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vsnbz"
Jul 02 23:10:16.667813 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.667790    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-zd96c"
Jul 02 23:10:16.676700 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.676679    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-tvqsh"
Jul 02 23:10:16.684935 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.684912    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-xxshk"
Jul 02 23:10:16.693703 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.693683    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-dl7lg"
Jul 02 23:10:16.701493 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.701472    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-mqdx9"
Jul 02 23:10:16.707564 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:16.707547    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-pbxh5"
Jul 02 23:10:17.056725 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:17.056691    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8f153fd5-a05d-4f36-8295-6c95914702e9-metrics-certs\") pod \"network-metrics-daemon-7qztm\" (UID: \"8f153fd5-a05d-4f36-8295-6c95914702e9\") " pod="openshift-multus/network-metrics-daemon-7qztm"
Jul 02 23:10:17.056903 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:17.056748    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/203dd5bc-44ec-49b7-9065-d343c88157f1-original-pull-secret\") pod \"global-pull-secret-syncer-x9hkk\" (UID: \"203dd5bc-44ec-49b7-9065-d343c88157f1\") " pod="kube-system/global-pull-secret-syncer-x9hkk"
Jul 02 23:10:17.056903 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:17.056785    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pkq9n\" (UniqueName: \"kubernetes.io/projected/f8448dd8-d309-4d65-89c1-a7f6acc365cf-kube-api-access-pkq9n\") pod \"network-check-target-w8bhs\" (UID: \"f8448dd8-d309-4d65-89c1-a7f6acc365cf\") " pod="openshift-network-diagnostics/network-check-target-w8bhs"
Jul 02 23:10:17.056903 ip-10-0-135-187 kubenswrapper[2580]: E0702 23:10:17.056848    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 23:10:17.057080 ip-10-0-135-187 kubenswrapper[2580]: E0702 23:10:17.056918    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8f153fd5-a05d-4f36-8295-6c95914702e9-metrics-certs podName:8f153fd5-a05d-4f36-8295-6c95914702e9 nodeName:}" failed. No retries permitted until 2026-07-02 23:10:18.056895634 +0000 UTC m=+4.074326816 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8f153fd5-a05d-4f36-8295-6c95914702e9-metrics-certs") pod "network-metrics-daemon-7qztm" (UID: "8f153fd5-a05d-4f36-8295-6c95914702e9") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 23:10:17.057080 ip-10-0-135-187 kubenswrapper[2580]: E0702 23:10:17.056928    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 02 23:10:17.057080 ip-10-0-135-187 kubenswrapper[2580]: E0702 23:10:17.056991    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 02 23:10:17.057080 ip-10-0-135-187 kubenswrapper[2580]: E0702 23:10:17.057007    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/203dd5bc-44ec-49b7-9065-d343c88157f1-original-pull-secret podName:203dd5bc-44ec-49b7-9065-d343c88157f1 nodeName:}" failed. No retries permitted until 2026-07-02 23:10:18.056978176 +0000 UTC m=+4.074409370 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/203dd5bc-44ec-49b7-9065-d343c88157f1-original-pull-secret") pod "global-pull-secret-syncer-x9hkk" (UID: "203dd5bc-44ec-49b7-9065-d343c88157f1") : object "kube-system"/"original-pull-secret" not registered
Jul 02 23:10:17.057080 ip-10-0-135-187 kubenswrapper[2580]: E0702 23:10:17.057038    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 02 23:10:17.057080 ip-10-0-135-187 kubenswrapper[2580]: E0702 23:10:17.057054    2580 projected.go:196] Error preparing data for projected volume kube-api-access-pkq9n for pod openshift-network-diagnostics/network-check-target-w8bhs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 23:10:17.057428 ip-10-0-135-187 kubenswrapper[2580]: E0702 23:10:17.057113    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f8448dd8-d309-4d65-89c1-a7f6acc365cf-kube-api-access-pkq9n podName:f8448dd8-d309-4d65-89c1-a7f6acc365cf nodeName:}" failed. No retries permitted until 2026-07-02 23:10:18.057094423 +0000 UTC m=+4.074525605 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-pkq9n" (UniqueName: "kubernetes.io/projected/f8448dd8-d309-4d65-89c1-a7f6acc365cf-kube-api-access-pkq9n") pod "network-check-target-w8bhs" (UID: "f8448dd8-d309-4d65-89c1-a7f6acc365cf") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 23:10:17.393342 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:17.393233    2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-01 23:05:16 +0000 UTC" deadline="2028-03-24 00:02:39.86305588 +0000 UTC"
Jul 02 23:10:17.393342 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:17.393283    2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15120h52m22.469776963s"
Jul 02 23:10:17.423602 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:17.423572    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7qztm"
Jul 02 23:10:17.423769 ip-10-0-135-187 kubenswrapper[2580]: E0702 23:10:17.423717    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7qztm" podUID="8f153fd5-a05d-4f36-8295-6c95914702e9"
Jul 02 23:10:17.591628 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:17.591604    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd394571a_8c62_4248_a9eb_9b165f3dfea3.slice/crio-96192ebc489e7c3c838d9fe71f17b7f13ff49f3535b618584abe290a454c2ac7 WatchSource:0}: Error finding container 96192ebc489e7c3c838d9fe71f17b7f13ff49f3535b618584abe290a454c2ac7: Status 404 returned error can't find the container with id 96192ebc489e7c3c838d9fe71f17b7f13ff49f3535b618584abe290a454c2ac7
Jul 02 23:10:17.594318 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:17.594099    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1f07f77_f80b_40b6_820d_bf77344e6724.slice/crio-780e9cfcc08b41f12e14be17bb9463c45428cd468ed73211352cb3e9f1a41028 WatchSource:0}: Error finding container 780e9cfcc08b41f12e14be17bb9463c45428cd468ed73211352cb3e9f1a41028: Status 404 returned error can't find the container with id 780e9cfcc08b41f12e14be17bb9463c45428cd468ed73211352cb3e9f1a41028
Jul 02 23:10:17.597717 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:17.597691    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd0e2259_affc_47b6_8234_298d698a5a18.slice/crio-dcf8051a2f7e81cc4e87ec5e31e90294b5b00f77a75fe8cfa79a7834e6898bbf WatchSource:0}: Error finding container dcf8051a2f7e81cc4e87ec5e31e90294b5b00f77a75fe8cfa79a7834e6898bbf: Status 404 returned error can't find the container with id dcf8051a2f7e81cc4e87ec5e31e90294b5b00f77a75fe8cfa79a7834e6898bbf
Jul 02 23:10:17.598129 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:17.598104    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36619515_fe66_4e56_a608_49db958cb88c.slice/crio-fb5c81214c44b05caaa38a2aac917341ec7b4a1a5ac57acb154cfe3378659f1c WatchSource:0}: Error finding container fb5c81214c44b05caaa38a2aac917341ec7b4a1a5ac57acb154cfe3378659f1c: Status 404 returned error can't find the container with id fb5c81214c44b05caaa38a2aac917341ec7b4a1a5ac57acb154cfe3378659f1c
Jul 02 23:10:17.599119 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:17.599093    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6758f85e_f0e3_4322_bae6_bbce4d0ba66f.slice/crio-20ced5deaf7571f0fc2ec7846a887bcbc814e8f9dc834a1f547ffd6b477d311c WatchSource:0}: Error finding container 20ced5deaf7571f0fc2ec7846a887bcbc814e8f9dc834a1f547ffd6b477d311c: Status 404 returned error can't find the container with id 20ced5deaf7571f0fc2ec7846a887bcbc814e8f9dc834a1f547ffd6b477d311c
Jul 02 23:10:17.600755 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:17.600678    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07bf56c1_2a06_4268_a2e1_fa7572c6b568.slice/crio-57a02b826b6b97a55d3ed83bd323fe00cc95217652f2d2db6d9e1d73a50045f1 WatchSource:0}: Error finding container 57a02b826b6b97a55d3ed83bd323fe00cc95217652f2d2db6d9e1d73a50045f1: Status 404 returned error can't find the container with id 57a02b826b6b97a55d3ed83bd323fe00cc95217652f2d2db6d9e1d73a50045f1
Jul 02 23:10:17.602535 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:17.602376    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76a3ba4e_e12e_4949_a03b_2012fe8f772c.slice/crio-dec21e6ec3b620a93c60ff9f8bcb2101f1df9f452a60da8c8e9530e276f0f52b WatchSource:0}: Error finding container dec21e6ec3b620a93c60ff9f8bcb2101f1df9f452a60da8c8e9530e276f0f52b: Status 404 returned error can't find the container with id dec21e6ec3b620a93c60ff9f8bcb2101f1df9f452a60da8c8e9530e276f0f52b
Jul 02 23:10:17.603246 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:17.603225    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9adaa10_5793_4280_9f7f_b7ff28a63c56.slice/crio-22ba69703461b14874cffe92c7d5bae3a09deb0c2533089dad790e049f768162 WatchSource:0}: Error finding container 22ba69703461b14874cffe92c7d5bae3a09deb0c2533089dad790e049f768162: Status 404 returned error can't find the container with id 22ba69703461b14874cffe92c7d5bae3a09deb0c2533089dad790e049f768162
Jul 02 23:10:17.606433 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:17.606411    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82fa80d2_d1b6_4aed_bd41_c32e9589c4b5.slice/crio-105ba06e935055d6f047746fae81823561016fe6d9157b18741ba7a1039943a4 WatchSource:0}: Error finding container 105ba06e935055d6f047746fae81823561016fe6d9157b18741ba7a1039943a4: Status 404 returned error can't find the container with id 105ba06e935055d6f047746fae81823561016fe6d9157b18741ba7a1039943a4
Jul 02 23:10:18.066812 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:18.065863    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/203dd5bc-44ec-49b7-9065-d343c88157f1-original-pull-secret\") pod \"global-pull-secret-syncer-x9hkk\" (UID: \"203dd5bc-44ec-49b7-9065-d343c88157f1\") " pod="kube-system/global-pull-secret-syncer-x9hkk"
Jul 02 23:10:18.066812 ip-10-0-135-187 kubenswrapper[2580]: E0702 23:10:18.066132    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 02 23:10:18.066812 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:18.066182    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pkq9n\" (UniqueName: \"kubernetes.io/projected/f8448dd8-d309-4d65-89c1-a7f6acc365cf-kube-api-access-pkq9n\") pod \"network-check-target-w8bhs\" (UID: \"f8448dd8-d309-4d65-89c1-a7f6acc365cf\") " pod="openshift-network-diagnostics/network-check-target-w8bhs"
Jul 02 23:10:18.066812 ip-10-0-135-187 kubenswrapper[2580]: E0702 23:10:18.066231    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/203dd5bc-44ec-49b7-9065-d343c88157f1-original-pull-secret podName:203dd5bc-44ec-49b7-9065-d343c88157f1 nodeName:}" failed. No retries permitted until 2026-07-02 23:10:20.066209607 +0000 UTC m=+6.083640786 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/203dd5bc-44ec-49b7-9065-d343c88157f1-original-pull-secret") pod "global-pull-secret-syncer-x9hkk" (UID: "203dd5bc-44ec-49b7-9065-d343c88157f1") : object "kube-system"/"original-pull-secret" not registered
Jul 02 23:10:18.066812 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:18.066292    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8f153fd5-a05d-4f36-8295-6c95914702e9-metrics-certs\") pod \"network-metrics-daemon-7qztm\" (UID: \"8f153fd5-a05d-4f36-8295-6c95914702e9\") " pod="openshift-multus/network-metrics-daemon-7qztm"
Jul 02 23:10:18.066812 ip-10-0-135-187 kubenswrapper[2580]: E0702 23:10:18.066326    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 02 23:10:18.066812 ip-10-0-135-187 kubenswrapper[2580]: E0702 23:10:18.066354    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 02 23:10:18.066812 ip-10-0-135-187 kubenswrapper[2580]: E0702 23:10:18.066367    2580 projected.go:196] Error preparing data for projected volume kube-api-access-pkq9n for pod openshift-network-diagnostics/network-check-target-w8bhs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 23:10:18.066812 ip-10-0-135-187 kubenswrapper[2580]: E0702 23:10:18.066427    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f8448dd8-d309-4d65-89c1-a7f6acc365cf-kube-api-access-pkq9n podName:f8448dd8-d309-4d65-89c1-a7f6acc365cf nodeName:}" failed. No retries permitted until 2026-07-02 23:10:20.066400808 +0000 UTC m=+6.083831986 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-pkq9n" (UniqueName: "kubernetes.io/projected/f8448dd8-d309-4d65-89c1-a7f6acc365cf-kube-api-access-pkq9n") pod "network-check-target-w8bhs" (UID: "f8448dd8-d309-4d65-89c1-a7f6acc365cf") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 23:10:18.066812 ip-10-0-135-187 kubenswrapper[2580]: E0702 23:10:18.066432    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 23:10:18.066812 ip-10-0-135-187 kubenswrapper[2580]: E0702 23:10:18.066473    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8f153fd5-a05d-4f36-8295-6c95914702e9-metrics-certs podName:8f153fd5-a05d-4f36-8295-6c95914702e9 nodeName:}" failed. No retries permitted until 2026-07-02 23:10:20.06645973 +0000 UTC m=+6.083890910 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8f153fd5-a05d-4f36-8295-6c95914702e9-metrics-certs") pod "network-metrics-daemon-7qztm" (UID: "8f153fd5-a05d-4f36-8295-6c95914702e9") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 23:10:18.393525 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:18.393460    2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-01 23:05:16 +0000 UTC" deadline="2028-01-19 13:58:24.786999471 +0000 UTC"
Jul 02 23:10:18.393525 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:18.393523    2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13574h48m6.393481128s"
Jul 02 23:10:18.435662 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:18.434948    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w8bhs"
Jul 02 23:10:18.435662 ip-10-0-135-187 kubenswrapper[2580]: E0702 23:10:18.435067    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w8bhs" podUID="f8448dd8-d309-4d65-89c1-a7f6acc365cf"
Jul 02 23:10:18.435662 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:18.435507    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x9hkk"
Jul 02 23:10:18.435662 ip-10-0-135-187 kubenswrapper[2580]: E0702 23:10:18.435609    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x9hkk" podUID="203dd5bc-44ec-49b7-9065-d343c88157f1"
Jul 02 23:10:18.446127 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:18.446090    2580 generic.go:356] "Generic (PLEG): container finished" podID="c283261225547afb9c0d25ecb78d10bb" containerID="a407ffcef3f79ae8df7fb9e5016a8a7641bd17817cd8bce55df1455e54c72c1d" exitCode=0
Jul 02 23:10:18.446298 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:18.446186    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-187.ec2.internal" event={"ID":"c283261225547afb9c0d25ecb78d10bb","Type":"ContainerDied","Data":"a407ffcef3f79ae8df7fb9e5016a8a7641bd17817cd8bce55df1455e54c72c1d"}
Jul 02 23:10:18.454926 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:18.454893    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-pbxh5" event={"ID":"82fa80d2-d1b6-4aed-bd41-c32e9589c4b5","Type":"ContainerStarted","Data":"105ba06e935055d6f047746fae81823561016fe6d9157b18741ba7a1039943a4"}
Jul 02 23:10:18.477504 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:18.477467    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ngnnt" event={"ID":"d9adaa10-5793-4280-9f7f-b7ff28a63c56","Type":"ContainerStarted","Data":"22ba69703461b14874cffe92c7d5bae3a09deb0c2533089dad790e049f768162"}
Jul 02 23:10:18.503037 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:18.503003    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vsnbz" event={"ID":"07bf56c1-2a06-4268-a2e1-fa7572c6b568","Type":"ContainerStarted","Data":"57a02b826b6b97a55d3ed83bd323fe00cc95217652f2d2db6d9e1d73a50045f1"}
Jul 02 23:10:18.528825 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:18.528704    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xxshk" event={"ID":"76a3ba4e-e12e-4949-a03b-2012fe8f772c","Type":"ContainerStarted","Data":"dec21e6ec3b620a93c60ff9f8bcb2101f1df9f452a60da8c8e9530e276f0f52b"}
Jul 02 23:10:18.559463 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:18.559396    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-mqdx9" event={"ID":"36619515-fe66-4e56-a608-49db958cb88c","Type":"ContainerStarted","Data":"fb5c81214c44b05caaa38a2aac917341ec7b4a1a5ac57acb154cfe3378659f1c"}
Jul 02 23:10:18.574074 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:18.573991    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-tvqsh" event={"ID":"d1f07f77-f80b-40b6-820d-bf77344e6724","Type":"ContainerStarted","Data":"780e9cfcc08b41f12e14be17bb9463c45428cd468ed73211352cb3e9f1a41028"}
Jul 02 23:10:18.581936 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:18.581308    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-187.ec2.internal" event={"ID":"2a3057b685ec6036d1a84888358dad85","Type":"ContainerStarted","Data":"5e2cb18bc80da732fe9fe48439dc57dc20b110d7eaa2ee33fdc9873cde7e2a53"}
Jul 02 23:10:18.594254 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:18.594173    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-dl7lg" event={"ID":"6758f85e-f0e3-4322-bae6-bbce4d0ba66f","Type":"ContainerStarted","Data":"20ced5deaf7571f0fc2ec7846a887bcbc814e8f9dc834a1f547ffd6b477d311c"}
Jul 02 23:10:18.607741 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:18.607661    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-gwfk5" event={"ID":"cd0e2259-affc-47b6-8234-298d698a5a18","Type":"ContainerStarted","Data":"dcf8051a2f7e81cc4e87ec5e31e90294b5b00f77a75fe8cfa79a7834e6898bbf"}
Jul 02 23:10:18.615771 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:18.615708    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-zd96c" event={"ID":"d394571a-8c62-4248-a9eb-9b165f3dfea3","Type":"ContainerStarted","Data":"96192ebc489e7c3c838d9fe71f17b7f13ff49f3535b618584abe290a454c2ac7"}
Jul 02 23:10:19.422770 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:19.422735    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7qztm"
Jul 02 23:10:19.423277 ip-10-0-135-187 kubenswrapper[2580]: E0702 23:10:19.422895    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7qztm" podUID="8f153fd5-a05d-4f36-8295-6c95914702e9"
Jul 02 23:10:19.647580 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:19.647542    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-187.ec2.internal" event={"ID":"c283261225547afb9c0d25ecb78d10bb","Type":"ContainerStarted","Data":"cdb130d3a1385e93206532e42c20a6a2390dcfcd3d3fb8b73e787ab893ff77f0"}
Jul 02 23:10:19.667588 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:19.667508    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-187.ec2.internal" podStartSLOduration=3.667484117 podStartE2EDuration="3.667484117s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 23:10:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:10:18.600105037 +0000 UTC m=+4.617536243" watchObservedRunningTime="2026-07-02 23:10:19.667484117 +0000 UTC m=+5.684915319"
Jul 02 23:10:19.667796 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:19.667762    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-187.ec2.internal" podStartSLOduration=3.667748853 podStartE2EDuration="3.667748853s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 23:10:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:10:19.666813932 +0000 UTC m=+5.684245149" watchObservedRunningTime="2026-07-02 23:10:19.667748853 +0000 UTC m=+5.685180056"
Jul 02 23:10:20.085049 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:20.083990    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pkq9n\" (UniqueName: \"kubernetes.io/projected/f8448dd8-d309-4d65-89c1-a7f6acc365cf-kube-api-access-pkq9n\") pod \"network-check-target-w8bhs\" (UID: \"f8448dd8-d309-4d65-89c1-a7f6acc365cf\") " pod="openshift-network-diagnostics/network-check-target-w8bhs"
Jul 02 23:10:20.085049 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:20.084066    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8f153fd5-a05d-4f36-8295-6c95914702e9-metrics-certs\") pod \"network-metrics-daemon-7qztm\" (UID: \"8f153fd5-a05d-4f36-8295-6c95914702e9\") " pod="openshift-multus/network-metrics-daemon-7qztm"
Jul 02 23:10:20.085049 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:20.084112    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/203dd5bc-44ec-49b7-9065-d343c88157f1-original-pull-secret\") pod \"global-pull-secret-syncer-x9hkk\" (UID: \"203dd5bc-44ec-49b7-9065-d343c88157f1\") " pod="kube-system/global-pull-secret-syncer-x9hkk"
Jul 02 23:10:20.085049 ip-10-0-135-187 kubenswrapper[2580]: E0702 23:10:20.084263    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 02 23:10:20.085049 ip-10-0-135-187 kubenswrapper[2580]: E0702 23:10:20.084348    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/203dd5bc-44ec-49b7-9065-d343c88157f1-original-pull-secret podName:203dd5bc-44ec-49b7-9065-d343c88157f1 nodeName:}" failed. No retries permitted until 2026-07-02 23:10:24.084327324 +0000 UTC m=+10.101758507 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/203dd5bc-44ec-49b7-9065-d343c88157f1-original-pull-secret") pod "global-pull-secret-syncer-x9hkk" (UID: "203dd5bc-44ec-49b7-9065-d343c88157f1") : object "kube-system"/"original-pull-secret" not registered
Jul 02 23:10:20.085049 ip-10-0-135-187 kubenswrapper[2580]: E0702 23:10:20.084778    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 02 23:10:20.085049 ip-10-0-135-187 kubenswrapper[2580]: E0702 23:10:20.084801    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 02 23:10:20.085049 ip-10-0-135-187 kubenswrapper[2580]: E0702 23:10:20.084815    2580 projected.go:196] Error preparing data for projected volume kube-api-access-pkq9n for pod openshift-network-diagnostics/network-check-target-w8bhs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 23:10:20.085049 ip-10-0-135-187 kubenswrapper[2580]: E0702 23:10:20.084861    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f8448dd8-d309-4d65-89c1-a7f6acc365cf-kube-api-access-pkq9n podName:f8448dd8-d309-4d65-89c1-a7f6acc365cf nodeName:}" failed. No retries permitted until 2026-07-02 23:10:24.084845031 +0000 UTC m=+10.102276211 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-pkq9n" (UniqueName: "kubernetes.io/projected/f8448dd8-d309-4d65-89c1-a7f6acc365cf-kube-api-access-pkq9n") pod "network-check-target-w8bhs" (UID: "f8448dd8-d309-4d65-89c1-a7f6acc365cf") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 23:10:20.085049 ip-10-0-135-187 kubenswrapper[2580]: E0702 23:10:20.084929    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 23:10:20.085049 ip-10-0-135-187 kubenswrapper[2580]: E0702 23:10:20.084963    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8f153fd5-a05d-4f36-8295-6c95914702e9-metrics-certs podName:8f153fd5-a05d-4f36-8295-6c95914702e9 nodeName:}" failed. No retries permitted until 2026-07-02 23:10:24.084951199 +0000 UTC m=+10.102382420 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8f153fd5-a05d-4f36-8295-6c95914702e9-metrics-certs") pod "network-metrics-daemon-7qztm" (UID: "8f153fd5-a05d-4f36-8295-6c95914702e9") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 23:10:20.425038 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:20.424955    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w8bhs"
Jul 02 23:10:20.425554 ip-10-0-135-187 kubenswrapper[2580]: E0702 23:10:20.425084    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w8bhs" podUID="f8448dd8-d309-4d65-89c1-a7f6acc365cf"
Jul 02 23:10:20.425554 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:20.425470    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x9hkk"
Jul 02 23:10:20.425670 ip-10-0-135-187 kubenswrapper[2580]: E0702 23:10:20.425571    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x9hkk" podUID="203dd5bc-44ec-49b7-9065-d343c88157f1"
Jul 02 23:10:21.423135 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:21.423100    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7qztm"
Jul 02 23:10:21.423358 ip-10-0-135-187 kubenswrapper[2580]: E0702 23:10:21.423231    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7qztm" podUID="8f153fd5-a05d-4f36-8295-6c95914702e9"
Jul 02 23:10:22.423688 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:22.423655    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w8bhs"
Jul 02 23:10:22.424137 ip-10-0-135-187 kubenswrapper[2580]: E0702 23:10:22.423787    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w8bhs" podUID="f8448dd8-d309-4d65-89c1-a7f6acc365cf"
Jul 02 23:10:22.424137 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:22.423836    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x9hkk"
Jul 02 23:10:22.424137 ip-10-0-135-187 kubenswrapper[2580]: E0702 23:10:22.423942    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x9hkk" podUID="203dd5bc-44ec-49b7-9065-d343c88157f1"
Jul 02 23:10:23.423325 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:23.423192    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7qztm"
Jul 02 23:10:23.423518 ip-10-0-135-187 kubenswrapper[2580]: E0702 23:10:23.423350    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7qztm" podUID="8f153fd5-a05d-4f36-8295-6c95914702e9"
Jul 02 23:10:24.123101 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:24.122231    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8f153fd5-a05d-4f36-8295-6c95914702e9-metrics-certs\") pod \"network-metrics-daemon-7qztm\" (UID: \"8f153fd5-a05d-4f36-8295-6c95914702e9\") " pod="openshift-multus/network-metrics-daemon-7qztm"
Jul 02 23:10:24.123101 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:24.122304    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/203dd5bc-44ec-49b7-9065-d343c88157f1-original-pull-secret\") pod \"global-pull-secret-syncer-x9hkk\" (UID: \"203dd5bc-44ec-49b7-9065-d343c88157f1\") " pod="kube-system/global-pull-secret-syncer-x9hkk"
Jul 02 23:10:24.123101 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:24.122341    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pkq9n\" (UniqueName: \"kubernetes.io/projected/f8448dd8-d309-4d65-89c1-a7f6acc365cf-kube-api-access-pkq9n\") pod \"network-check-target-w8bhs\" (UID: \"f8448dd8-d309-4d65-89c1-a7f6acc365cf\") " pod="openshift-network-diagnostics/network-check-target-w8bhs"
Jul 02 23:10:24.123101 ip-10-0-135-187 kubenswrapper[2580]: E0702 23:10:24.122477    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 02 23:10:24.123101 ip-10-0-135-187 kubenswrapper[2580]: E0702 23:10:24.122495    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 02 23:10:24.123101 ip-10-0-135-187 kubenswrapper[2580]: E0702 23:10:24.122507    2580 projected.go:196] Error preparing data for projected volume kube-api-access-pkq9n for pod openshift-network-diagnostics/network-check-target-w8bhs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 23:10:24.123101 ip-10-0-135-187 kubenswrapper[2580]: E0702 23:10:24.122564    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f8448dd8-d309-4d65-89c1-a7f6acc365cf-kube-api-access-pkq9n podName:f8448dd8-d309-4d65-89c1-a7f6acc365cf nodeName:}" failed. No retries permitted until 2026-07-02 23:10:32.122545018 +0000 UTC m=+18.139976196 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-pkq9n" (UniqueName: "kubernetes.io/projected/f8448dd8-d309-4d65-89c1-a7f6acc365cf-kube-api-access-pkq9n") pod "network-check-target-w8bhs" (UID: "f8448dd8-d309-4d65-89c1-a7f6acc365cf") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 23:10:24.123101 ip-10-0-135-187 kubenswrapper[2580]: E0702 23:10:24.122632    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 23:10:24.123101 ip-10-0-135-187 kubenswrapper[2580]: E0702 23:10:24.122664    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8f153fd5-a05d-4f36-8295-6c95914702e9-metrics-certs podName:8f153fd5-a05d-4f36-8295-6c95914702e9 nodeName:}" failed. No retries permitted until 2026-07-02 23:10:32.122652658 +0000 UTC m=+18.140083835 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8f153fd5-a05d-4f36-8295-6c95914702e9-metrics-certs") pod "network-metrics-daemon-7qztm" (UID: "8f153fd5-a05d-4f36-8295-6c95914702e9") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 23:10:24.123101 ip-10-0-135-187 kubenswrapper[2580]: E0702 23:10:24.122730    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 02 23:10:24.123101 ip-10-0-135-187 kubenswrapper[2580]: E0702 23:10:24.122759    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/203dd5bc-44ec-49b7-9065-d343c88157f1-original-pull-secret podName:203dd5bc-44ec-49b7-9065-d343c88157f1 nodeName:}" failed. No retries permitted until 2026-07-02 23:10:32.122749333 +0000 UTC m=+18.140180511 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/203dd5bc-44ec-49b7-9065-d343c88157f1-original-pull-secret") pod "global-pull-secret-syncer-x9hkk" (UID: "203dd5bc-44ec-49b7-9065-d343c88157f1") : object "kube-system"/"original-pull-secret" not registered
Jul 02 23:10:24.423954 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:24.423610    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w8bhs"
Jul 02 23:10:24.423954 ip-10-0-135-187 kubenswrapper[2580]: E0702 23:10:24.423727    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w8bhs" podUID="f8448dd8-d309-4d65-89c1-a7f6acc365cf"
Jul 02 23:10:24.423954 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:24.423799    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x9hkk"
Jul 02 23:10:24.423954 ip-10-0-135-187 kubenswrapper[2580]: E0702 23:10:24.423875    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x9hkk" podUID="203dd5bc-44ec-49b7-9065-d343c88157f1"
Jul 02 23:10:25.423453 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:25.423417    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7qztm"
Jul 02 23:10:25.424002 ip-10-0-135-187 kubenswrapper[2580]: E0702 23:10:25.423564    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7qztm" podUID="8f153fd5-a05d-4f36-8295-6c95914702e9"
Jul 02 23:10:26.423313 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:26.423280    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x9hkk"
Jul 02 23:10:26.423472 ip-10-0-135-187 kubenswrapper[2580]: E0702 23:10:26.423414    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x9hkk" podUID="203dd5bc-44ec-49b7-9065-d343c88157f1"
Jul 02 23:10:26.423807 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:26.423521    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w8bhs"
Jul 02 23:10:26.423807 ip-10-0-135-187 kubenswrapper[2580]: E0702 23:10:26.423606    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w8bhs" podUID="f8448dd8-d309-4d65-89c1-a7f6acc365cf"
Jul 02 23:10:27.423015 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:27.422981    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7qztm"
Jul 02 23:10:27.423224 ip-10-0-135-187 kubenswrapper[2580]: E0702 23:10:27.423188    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7qztm" podUID="8f153fd5-a05d-4f36-8295-6c95914702e9"
Jul 02 23:10:28.423149 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:28.423109    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x9hkk"
Jul 02 23:10:28.423609 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:28.423109    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w8bhs"
Jul 02 23:10:28.423609 ip-10-0-135-187 kubenswrapper[2580]: E0702 23:10:28.423263    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x9hkk" podUID="203dd5bc-44ec-49b7-9065-d343c88157f1"
Jul 02 23:10:28.423609 ip-10-0-135-187 kubenswrapper[2580]: E0702 23:10:28.423282    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w8bhs" podUID="f8448dd8-d309-4d65-89c1-a7f6acc365cf"
Jul 02 23:10:29.422689 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:29.422652    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7qztm"
Jul 02 23:10:29.422854 ip-10-0-135-187 kubenswrapper[2580]: E0702 23:10:29.422779    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7qztm" podUID="8f153fd5-a05d-4f36-8295-6c95914702e9"
Jul 02 23:10:30.426288 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:30.426259    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x9hkk"
Jul 02 23:10:30.426703 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:30.426262    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w8bhs"
Jul 02 23:10:30.426703 ip-10-0-135-187 kubenswrapper[2580]: E0702 23:10:30.426371    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x9hkk" podUID="203dd5bc-44ec-49b7-9065-d343c88157f1"
Jul 02 23:10:30.426703 ip-10-0-135-187 kubenswrapper[2580]: E0702 23:10:30.426465    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w8bhs" podUID="f8448dd8-d309-4d65-89c1-a7f6acc365cf"
Jul 02 23:10:31.422796 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:31.422760    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7qztm"
Jul 02 23:10:31.423039 ip-10-0-135-187 kubenswrapper[2580]: E0702 23:10:31.422874    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7qztm" podUID="8f153fd5-a05d-4f36-8295-6c95914702e9"
Jul 02 23:10:32.187702 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:32.187654    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/203dd5bc-44ec-49b7-9065-d343c88157f1-original-pull-secret\") pod \"global-pull-secret-syncer-x9hkk\" (UID: \"203dd5bc-44ec-49b7-9065-d343c88157f1\") " pod="kube-system/global-pull-secret-syncer-x9hkk"
Jul 02 23:10:32.188182 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:32.187720    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pkq9n\" (UniqueName: \"kubernetes.io/projected/f8448dd8-d309-4d65-89c1-a7f6acc365cf-kube-api-access-pkq9n\") pod \"network-check-target-w8bhs\" (UID: \"f8448dd8-d309-4d65-89c1-a7f6acc365cf\") " pod="openshift-network-diagnostics/network-check-target-w8bhs"
Jul 02 23:10:32.188182 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:32.187763    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8f153fd5-a05d-4f36-8295-6c95914702e9-metrics-certs\") pod \"network-metrics-daemon-7qztm\" (UID: \"8f153fd5-a05d-4f36-8295-6c95914702e9\") " pod="openshift-multus/network-metrics-daemon-7qztm"
Jul 02 23:10:32.188182 ip-10-0-135-187 kubenswrapper[2580]: E0702 23:10:32.187824    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 02 23:10:32.188182 ip-10-0-135-187 kubenswrapper[2580]: E0702 23:10:32.187862    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 23:10:32.188182 ip-10-0-135-187 kubenswrapper[2580]: E0702 23:10:32.187885    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 02 23:10:32.188182 ip-10-0-135-187 kubenswrapper[2580]: E0702 23:10:32.187903    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/203dd5bc-44ec-49b7-9065-d343c88157f1-original-pull-secret podName:203dd5bc-44ec-49b7-9065-d343c88157f1 nodeName:}" failed. No retries permitted until 2026-07-02 23:10:48.187884287 +0000 UTC m=+34.205315467 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/203dd5bc-44ec-49b7-9065-d343c88157f1-original-pull-secret") pod "global-pull-secret-syncer-x9hkk" (UID: "203dd5bc-44ec-49b7-9065-d343c88157f1") : object "kube-system"/"original-pull-secret" not registered
Jul 02 23:10:32.188182 ip-10-0-135-187 kubenswrapper[2580]: E0702 23:10:32.187924    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8f153fd5-a05d-4f36-8295-6c95914702e9-metrics-certs podName:8f153fd5-a05d-4f36-8295-6c95914702e9 nodeName:}" failed. No retries permitted until 2026-07-02 23:10:48.187913429 +0000 UTC m=+34.205344605 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8f153fd5-a05d-4f36-8295-6c95914702e9-metrics-certs") pod "network-metrics-daemon-7qztm" (UID: "8f153fd5-a05d-4f36-8295-6c95914702e9") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 23:10:32.188182 ip-10-0-135-187 kubenswrapper[2580]: E0702 23:10:32.187904    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 02 23:10:32.188182 ip-10-0-135-187 kubenswrapper[2580]: E0702 23:10:32.187975    2580 projected.go:196] Error preparing data for projected volume kube-api-access-pkq9n for pod openshift-network-diagnostics/network-check-target-w8bhs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 23:10:32.188182 ip-10-0-135-187 kubenswrapper[2580]: E0702 23:10:32.188017    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f8448dd8-d309-4d65-89c1-a7f6acc365cf-kube-api-access-pkq9n podName:f8448dd8-d309-4d65-89c1-a7f6acc365cf nodeName:}" failed. No retries permitted until 2026-07-02 23:10:48.188005463 +0000 UTC m=+34.205436644 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-pkq9n" (UniqueName: "kubernetes.io/projected/f8448dd8-d309-4d65-89c1-a7f6acc365cf-kube-api-access-pkq9n") pod "network-check-target-w8bhs" (UID: "f8448dd8-d309-4d65-89c1-a7f6acc365cf") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 23:10:32.423497 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:32.423466    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w8bhs"
Jul 02 23:10:32.423692 ip-10-0-135-187 kubenswrapper[2580]: E0702 23:10:32.423610    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w8bhs" podUID="f8448dd8-d309-4d65-89c1-a7f6acc365cf"
Jul 02 23:10:32.423692 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:32.423622    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x9hkk"
Jul 02 23:10:32.423812 ip-10-0-135-187 kubenswrapper[2580]: E0702 23:10:32.423740    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x9hkk" podUID="203dd5bc-44ec-49b7-9065-d343c88157f1"
Jul 02 23:10:33.423236 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:33.423196    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7qztm"
Jul 02 23:10:33.423664 ip-10-0-135-187 kubenswrapper[2580]: E0702 23:10:33.423352    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7qztm" podUID="8f153fd5-a05d-4f36-8295-6c95914702e9"
Jul 02 23:10:34.423776 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:34.423744    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w8bhs"
Jul 02 23:10:34.424258 ip-10-0-135-187 kubenswrapper[2580]: E0702 23:10:34.423845    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w8bhs" podUID="f8448dd8-d309-4d65-89c1-a7f6acc365cf"
Jul 02 23:10:34.424258 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:34.423900    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x9hkk"
Jul 02 23:10:34.424258 ip-10-0-135-187 kubenswrapper[2580]: E0702 23:10:34.424009    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x9hkk" podUID="203dd5bc-44ec-49b7-9065-d343c88157f1"
Jul 02 23:10:35.422908 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:35.422880    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7qztm"
Jul 02 23:10:35.423081 ip-10-0-135-187 kubenswrapper[2580]: E0702 23:10:35.422993    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7qztm" podUID="8f153fd5-a05d-4f36-8295-6c95914702e9"
Jul 02 23:10:36.423324 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:36.423293    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x9hkk"
Jul 02 23:10:36.423748 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:36.423293    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w8bhs"
Jul 02 23:10:36.423748 ip-10-0-135-187 kubenswrapper[2580]: E0702 23:10:36.423417    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x9hkk" podUID="203dd5bc-44ec-49b7-9065-d343c88157f1"
Jul 02 23:10:36.423748 ip-10-0-135-187 kubenswrapper[2580]: E0702 23:10:36.423553    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w8bhs" podUID="f8448dd8-d309-4d65-89c1-a7f6acc365cf"
Jul 02 23:10:37.423262 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:37.423067    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7qztm"
Jul 02 23:10:37.423519 ip-10-0-135-187 kubenswrapper[2580]: E0702 23:10:37.423355    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7qztm" podUID="8f153fd5-a05d-4f36-8295-6c95914702e9"
Jul 02 23:10:37.691142 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:37.691110    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-dl7lg" event={"ID":"6758f85e-f0e3-4322-bae6-bbce4d0ba66f","Type":"ContainerStarted","Data":"c902825a71795100265545a0e1fe63d8f0182fd7ab3736b5860806acf8ac7016"}
Jul 02 23:10:37.692478 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:37.692452    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-zd96c" event={"ID":"d394571a-8c62-4248-a9eb-9b165f3dfea3","Type":"ContainerStarted","Data":"8dd9c6cdd5481e357893b7ecccd3c164fa7dadc82286c3063d64646031badf3c"}
Jul 02 23:10:37.693622 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:37.693600    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-pbxh5" event={"ID":"82fa80d2-d1b6-4aed-bd41-c32e9589c4b5","Type":"ContainerStarted","Data":"aa44ca4d7620d3961df328639d7a5ac84c46030393a28d52aa35dd7f0048f0cd"}
Jul 02 23:10:37.694931 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:37.694905    2580 generic.go:356] "Generic (PLEG): container finished" podID="d9adaa10-5793-4280-9f7f-b7ff28a63c56" containerID="bf29fdf555543919fd0cc81d537c43c2ec358bda855e7117c781a3ad7bd8a591" exitCode=0
Jul 02 23:10:37.695044 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:37.694990    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ngnnt" event={"ID":"d9adaa10-5793-4280-9f7f-b7ff28a63c56","Type":"ContainerDied","Data":"bf29fdf555543919fd0cc81d537c43c2ec358bda855e7117c781a3ad7bd8a591"}
Jul 02 23:10:37.696484 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:37.696435    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vsnbz" event={"ID":"07bf56c1-2a06-4268-a2e1-fa7572c6b568","Type":"ContainerStarted","Data":"cc15959fc566bf0e7e1d51fe06a2225f50713ea44dff7411aa493849ae0b9d8f"}
Jul 02 23:10:37.699228 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:37.699206    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xxshk" event={"ID":"76a3ba4e-e12e-4949-a03b-2012fe8f772c","Type":"ContainerStarted","Data":"d061acf33be6d0505e212b2a57a661139782b0025450bad3fc2c3e7c58e6b7dd"}
Jul 02 23:10:37.699330 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:37.699296    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xxshk" event={"ID":"76a3ba4e-e12e-4949-a03b-2012fe8f772c","Type":"ContainerStarted","Data":"a377aa184f8fdae4993985ea47aa422713ae976f3290d647b232de5cb6638b50"}
Jul 02 23:10:37.699381 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:37.699346    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xxshk" event={"ID":"76a3ba4e-e12e-4949-a03b-2012fe8f772c","Type":"ContainerStarted","Data":"f4b0fa595ac7321f053d333489b1d49fb881f60c6097e5e7cbb1a535ed2d217e"}
Jul 02 23:10:37.699430 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:37.699393    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xxshk" event={"ID":"76a3ba4e-e12e-4949-a03b-2012fe8f772c","Type":"ContainerStarted","Data":"6f1c6d2bead88b2afd7850313060f08e5125ed84756fe61978d5a6b40bc87f35"}
Jul 02 23:10:37.699470 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:37.699440    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xxshk" event={"ID":"76a3ba4e-e12e-4949-a03b-2012fe8f772c","Type":"ContainerStarted","Data":"e0107f8a614b14b31754bd625bb363a8d5080a786c2cbd21f747e73fb387d7d7"}
Jul 02 23:10:37.699510 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:37.699470    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xxshk" event={"ID":"76a3ba4e-e12e-4949-a03b-2012fe8f772c","Type":"ContainerStarted","Data":"06df2c9c8e4e9316128653db7ca7e9ca7e96d8ecd8ac8d27b1a82afd1eb2e812"}
Jul 02 23:10:37.700467 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:37.700448    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-mqdx9" event={"ID":"36619515-fe66-4e56-a608-49db958cb88c","Type":"ContainerStarted","Data":"63ec0b0eaeaf5d49ba294470e2a0fe78ac8472f0a06c7d14f2c5d992970ec320"}
Jul 02 23:10:37.701660 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:37.701642    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-tvqsh" event={"ID":"d1f07f77-f80b-40b6-820d-bf77344e6724","Type":"ContainerStarted","Data":"eb54891e03082b38e049ccc2fc537d666d743d027669efc42c33033b38301f70"}
Jul 02 23:10:37.706360 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:37.706327    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-dl7lg" podStartSLOduration=3.734473001 podStartE2EDuration="22.706316741s" totalImagesPullingTime="18.97184374s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:10:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:10:37.706201072 +0000 UTC m=+23.723632264" watchObservedRunningTime="2026-07-02 23:10:37.706316741 +0000 UTC m=+23.723747939"
Jul 02 23:10:37.721217 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:37.721176    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-pbxh5" podStartSLOduration=3.752719335 podStartE2EDuration="22.721164717s" totalImagesPullingTime="18.968445382s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 23:10:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:10:37.720997763 +0000 UTC m=+23.738428961" watchObservedRunningTime="2026-07-02 23:10:37.721164717 +0000 UTC m=+23.738595915"
Jul 02 23:10:37.757347 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:37.757316    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-zd96c" podStartSLOduration=3.778020953 podStartE2EDuration="22.757305259s" totalImagesPullingTime="18.979284306s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 23:10:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:10:37.757220618 +0000 UTC m=+23.774651815" watchObservedRunningTime="2026-07-02 23:10:37.757305259 +0000 UTC m=+23.774736456"
Jul 02 23:10:37.803599 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:37.803568    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-mqdx9" podStartSLOduration=3.803059305 podStartE2EDuration="22.803557398s" totalImagesPullingTime="19.000498093s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 23:10:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:10:37.803521641 +0000 UTC m=+23.820952839" watchObservedRunningTime="2026-07-02 23:10:37.803557398 +0000 UTC m=+23.820988596"
Jul 02 23:10:37.804047 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:37.804023    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-tvqsh" podStartSLOduration=3.749073545 podStartE2EDuration="22.804014392s" totalImagesPullingTime="19.054940847s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 23:10:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:10:37.782072619 +0000 UTC m=+23.799503816" watchObservedRunningTime="2026-07-02 23:10:37.804014392 +0000 UTC m=+23.821445605"
Jul 02 23:10:38.030139 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:38.030121    2580 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 02 23:10:38.397019 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:38.396918    2580 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-02T23:10:38.030136446Z","UUID":"495a8f73-1ed1-4dea-8adf-74a0c9167f02","Handler":null,"Name":"","Endpoint":""}
Jul 02 23:10:38.398628 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:38.398605    2580 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 02 23:10:38.398751 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:38.398648    2580 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 02 23:10:38.422606 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:38.422581    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w8bhs"
Jul 02 23:10:38.422764 ip-10-0-135-187 kubenswrapper[2580]: E0702 23:10:38.422738    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w8bhs" podUID="f8448dd8-d309-4d65-89c1-a7f6acc365cf"
Jul 02 23:10:38.422825 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:38.422768    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x9hkk"
Jul 02 23:10:38.422860 ip-10-0-135-187 kubenswrapper[2580]: E0702 23:10:38.422833    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x9hkk" podUID="203dd5bc-44ec-49b7-9065-d343c88157f1"
Jul 02 23:10:38.706542 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:38.706461    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vsnbz" event={"ID":"07bf56c1-2a06-4268-a2e1-fa7572c6b568","Type":"ContainerStarted","Data":"31bcd26d4b9dcbb2751188cdf3ac63ab88017fb6611b091bd224ea39095f7b85"}
Jul 02 23:10:38.708081 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:38.708017    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-gwfk5" event={"ID":"cd0e2259-affc-47b6-8234-298d698a5a18","Type":"ContainerStarted","Data":"300b2ab7f41733b60462427779767f51f777da9f3da11649b161bc865981b628"}
Jul 02 23:10:38.725228 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:38.725179    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-gwfk5" podStartSLOduration=4.748712026 podStartE2EDuration="23.725161433s" totalImagesPullingTime="18.976449407s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 23:10:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:10:38.724922832 +0000 UTC m=+24.742354030" watchObservedRunningTime="2026-07-02 23:10:38.725161433 +0000 UTC m=+24.742592669"
Jul 02 23:10:39.423229 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:39.423204    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7qztm"
Jul 02 23:10:39.423380 ip-10-0-135-187 kubenswrapper[2580]: E0702 23:10:39.423358    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7qztm" podUID="8f153fd5-a05d-4f36-8295-6c95914702e9"
Jul 02 23:10:39.713025 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:39.712939    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vsnbz" event={"ID":"07bf56c1-2a06-4268-a2e1-fa7572c6b568","Type":"ContainerStarted","Data":"f88137f3f5fbe284f0d7e353480abe6263b17c3b2f92fdc61e8f7223a3ca7efc"}
Jul 02 23:10:39.716654 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:39.716622    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xxshk" event={"ID":"76a3ba4e-e12e-4949-a03b-2012fe8f772c","Type":"ContainerStarted","Data":"6d4046bafed2d659dfc86bfaa143be5760540021fa3421566b7282d157b05e4d"}
Jul 02 23:10:39.731558 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:39.731511    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vsnbz" podStartSLOduration=3.617323712 podStartE2EDuration="24.731498729s" totalImagesPullingTime="21.114175017s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 23:10:15 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:10:39.72999995 +0000 UTC m=+25.747431147" watchObservedRunningTime="2026-07-02 23:10:39.731498729 +0000 UTC m=+25.748929928"
Jul 02 23:10:40.208158 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:40.208125    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-dl7lg"
Jul 02 23:10:40.208778 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:40.208756    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-dl7lg"
Jul 02 23:10:40.422932 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:40.422773    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w8bhs"
Jul 02 23:10:40.423105 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:40.422773    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x9hkk"
Jul 02 23:10:40.423105 ip-10-0-135-187 kubenswrapper[2580]: E0702 23:10:40.423012    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w8bhs" podUID="f8448dd8-d309-4d65-89c1-a7f6acc365cf"
Jul 02 23:10:40.423220 ip-10-0-135-187 kubenswrapper[2580]: E0702 23:10:40.423100    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x9hkk" podUID="203dd5bc-44ec-49b7-9065-d343c88157f1"
Jul 02 23:10:40.719193 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:40.719124    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-dl7lg"
Jul 02 23:10:40.719621 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:40.719471    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-dl7lg"
Jul 02 23:10:41.423116 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:41.423083    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7qztm"
Jul 02 23:10:41.423350 ip-10-0-135-187 kubenswrapper[2580]: E0702 23:10:41.423199    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7qztm" podUID="8f153fd5-a05d-4f36-8295-6c95914702e9"
Jul 02 23:10:42.423189 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:42.422957    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w8bhs"
Jul 02 23:10:42.423715 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:42.423011    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x9hkk"
Jul 02 23:10:42.423715 ip-10-0-135-187 kubenswrapper[2580]: E0702 23:10:42.423312    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w8bhs" podUID="f8448dd8-d309-4d65-89c1-a7f6acc365cf"
Jul 02 23:10:42.423715 ip-10-0-135-187 kubenswrapper[2580]: E0702 23:10:42.423351    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x9hkk" podUID="203dd5bc-44ec-49b7-9065-d343c88157f1"
Jul 02 23:10:42.725475 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:42.725438    2580 generic.go:356] "Generic (PLEG): container finished" podID="d9adaa10-5793-4280-9f7f-b7ff28a63c56" containerID="2b61bc568e9511e5d6d2416fe1b60d8fd2ba5999cb3d62e8621638e39a4259e0" exitCode=0
Jul 02 23:10:42.725661 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:42.725522    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ngnnt" event={"ID":"d9adaa10-5793-4280-9f7f-b7ff28a63c56","Type":"ContainerDied","Data":"2b61bc568e9511e5d6d2416fe1b60d8fd2ba5999cb3d62e8621638e39a4259e0"}
Jul 02 23:10:42.729176 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:42.729151    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xxshk" event={"ID":"76a3ba4e-e12e-4949-a03b-2012fe8f772c","Type":"ContainerStarted","Data":"8ffb3256dfa55fc490450e864b88a05ae592adf2f9100559f14f7bb3c97cd2eb"}
Jul 02 23:10:42.776230 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:42.776190    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-xxshk" podStartSLOduration=8.731237806 podStartE2EDuration="27.776177153s" totalImagesPullingTime="19.044939347s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 23:10:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:10:42.776062744 +0000 UTC m=+28.793493942" watchObservedRunningTime="2026-07-02 23:10:42.776177153 +0000 UTC m=+28.793608350"
Jul 02 23:10:43.422935 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:43.422909    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7qztm"
Jul 02 23:10:43.423130 ip-10-0-135-187 kubenswrapper[2580]: E0702 23:10:43.423011    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7qztm" podUID="8f153fd5-a05d-4f36-8295-6c95914702e9"
Jul 02 23:10:43.731315 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:43.731287    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-xxshk"
Jul 02 23:10:43.731698 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:43.731406    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-xxshk"
Jul 02 23:10:43.731698 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:43.731451    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-xxshk"
Jul 02 23:10:43.750658 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:43.750630    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-xxshk"
Jul 02 23:10:43.751057 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:43.751027    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-xxshk"
Jul 02 23:10:43.937146 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:43.936993    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-x9hkk"]
Jul 02 23:10:43.937282 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:43.937217    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x9hkk"
Jul 02 23:10:43.937335 ip-10-0-135-187 kubenswrapper[2580]: E0702 23:10:43.937318    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x9hkk" podUID="203dd5bc-44ec-49b7-9065-d343c88157f1"
Jul 02 23:10:43.943110 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:43.943085    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-w8bhs"]
Jul 02 23:10:43.943303 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:43.943190    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w8bhs"
Jul 02 23:10:43.943381 ip-10-0-135-187 kubenswrapper[2580]: E0702 23:10:43.943320    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w8bhs" podUID="f8448dd8-d309-4d65-89c1-a7f6acc365cf"
Jul 02 23:10:43.943732 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:43.943711    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-7qztm"]
Jul 02 23:10:43.943831 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:43.943817    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7qztm"
Jul 02 23:10:43.943942 ip-10-0-135-187 kubenswrapper[2580]: E0702 23:10:43.943925    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7qztm" podUID="8f153fd5-a05d-4f36-8295-6c95914702e9"
Jul 02 23:10:44.734515 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:44.734481    2580 generic.go:356] "Generic (PLEG): container finished" podID="d9adaa10-5793-4280-9f7f-b7ff28a63c56" containerID="3cc1538e2e8b95c33d6e1bdd280775f4a23a6461a4d610a1a76d9f0bb778ae21" exitCode=0
Jul 02 23:10:44.734956 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:44.734561    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ngnnt" event={"ID":"d9adaa10-5793-4280-9f7f-b7ff28a63c56","Type":"ContainerDied","Data":"3cc1538e2e8b95c33d6e1bdd280775f4a23a6461a4d610a1a76d9f0bb778ae21"}
Jul 02 23:10:45.423546 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:45.423511    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w8bhs"
Jul 02 23:10:45.423546 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:45.423534    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x9hkk"
Jul 02 23:10:45.423833 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:45.423540    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7qztm"
Jul 02 23:10:45.423833 ip-10-0-135-187 kubenswrapper[2580]: E0702 23:10:45.423615    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w8bhs" podUID="f8448dd8-d309-4d65-89c1-a7f6acc365cf"
Jul 02 23:10:45.423833 ip-10-0-135-187 kubenswrapper[2580]: E0702 23:10:45.423700    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x9hkk" podUID="203dd5bc-44ec-49b7-9065-d343c88157f1"
Jul 02 23:10:45.423833 ip-10-0-135-187 kubenswrapper[2580]: E0702 23:10:45.423780    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7qztm" podUID="8f153fd5-a05d-4f36-8295-6c95914702e9"
Jul 02 23:10:46.740877 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:46.740845    2580 generic.go:356] "Generic (PLEG): container finished" podID="d9adaa10-5793-4280-9f7f-b7ff28a63c56" containerID="505256ee2519aaa18a32d83ed0b7b00036e09cfb8c211b234c6029a9b426fbf4" exitCode=0
Jul 02 23:10:46.741594 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:46.740900    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ngnnt" event={"ID":"d9adaa10-5793-4280-9f7f-b7ff28a63c56","Type":"ContainerDied","Data":"505256ee2519aaa18a32d83ed0b7b00036e09cfb8c211b234c6029a9b426fbf4"}
Jul 02 23:10:47.423173 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:47.423139    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7qztm"
Jul 02 23:10:47.423173 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:47.423173    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x9hkk"
Jul 02 23:10:47.423406 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:47.423186    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w8bhs"
Jul 02 23:10:47.423406 ip-10-0-135-187 kubenswrapper[2580]: E0702 23:10:47.423280    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7qztm" podUID="8f153fd5-a05d-4f36-8295-6c95914702e9"
Jul 02 23:10:47.423406 ip-10-0-135-187 kubenswrapper[2580]: E0702 23:10:47.423398    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x9hkk" podUID="203dd5bc-44ec-49b7-9065-d343c88157f1"
Jul 02 23:10:47.423526 ip-10-0-135-187 kubenswrapper[2580]: E0702 23:10:47.423469    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w8bhs" podUID="f8448dd8-d309-4d65-89c1-a7f6acc365cf"
Jul 02 23:10:47.974694 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:47.974653    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:10:48.077969 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:48.077935    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:10:48.214304 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:48.214270    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pkq9n\" (UniqueName: \"kubernetes.io/projected/f8448dd8-d309-4d65-89c1-a7f6acc365cf-kube-api-access-pkq9n\") pod \"network-check-target-w8bhs\" (UID: \"f8448dd8-d309-4d65-89c1-a7f6acc365cf\") " pod="openshift-network-diagnostics/network-check-target-w8bhs"
Jul 02 23:10:48.214487 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:48.214318    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8f153fd5-a05d-4f36-8295-6c95914702e9-metrics-certs\") pod \"network-metrics-daemon-7qztm\" (UID: \"8f153fd5-a05d-4f36-8295-6c95914702e9\") " pod="openshift-multus/network-metrics-daemon-7qztm"
Jul 02 23:10:48.214487 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:48.214353    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/203dd5bc-44ec-49b7-9065-d343c88157f1-original-pull-secret\") pod \"global-pull-secret-syncer-x9hkk\" (UID: \"203dd5bc-44ec-49b7-9065-d343c88157f1\") " pod="kube-system/global-pull-secret-syncer-x9hkk"
Jul 02 23:10:48.214487 ip-10-0-135-187 kubenswrapper[2580]: E0702 23:10:48.214449    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 02 23:10:48.214487 ip-10-0-135-187 kubenswrapper[2580]: E0702 23:10:48.214481    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 23:10:48.214704 ip-10-0-135-187 kubenswrapper[2580]: E0702 23:10:48.214510    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/203dd5bc-44ec-49b7-9065-d343c88157f1-original-pull-secret podName:203dd5bc-44ec-49b7-9065-d343c88157f1 nodeName:}" failed. No retries permitted until 2026-07-02 23:11:20.214491064 +0000 UTC m=+66.231922255 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/203dd5bc-44ec-49b7-9065-d343c88157f1-original-pull-secret") pod "global-pull-secret-syncer-x9hkk" (UID: "203dd5bc-44ec-49b7-9065-d343c88157f1") : object "kube-system"/"original-pull-secret" not registered
Jul 02 23:10:48.214704 ip-10-0-135-187 kubenswrapper[2580]: E0702 23:10:48.214534    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8f153fd5-a05d-4f36-8295-6c95914702e9-metrics-certs podName:8f153fd5-a05d-4f36-8295-6c95914702e9 nodeName:}" failed. No retries permitted until 2026-07-02 23:11:20.214517751 +0000 UTC m=+66.231948933 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8f153fd5-a05d-4f36-8295-6c95914702e9-metrics-certs") pod "network-metrics-daemon-7qztm" (UID: "8f153fd5-a05d-4f36-8295-6c95914702e9") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 23:10:48.214704 ip-10-0-135-187 kubenswrapper[2580]: E0702 23:10:48.214450    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 02 23:10:48.214704 ip-10-0-135-187 kubenswrapper[2580]: E0702 23:10:48.214562    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 02 23:10:48.214704 ip-10-0-135-187 kubenswrapper[2580]: E0702 23:10:48.214574    2580 projected.go:196] Error preparing data for projected volume kube-api-access-pkq9n for pod openshift-network-diagnostics/network-check-target-w8bhs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 23:10:48.214704 ip-10-0-135-187 kubenswrapper[2580]: E0702 23:10:48.214616    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f8448dd8-d309-4d65-89c1-a7f6acc365cf-kube-api-access-pkq9n podName:f8448dd8-d309-4d65-89c1-a7f6acc365cf nodeName:}" failed. No retries permitted until 2026-07-02 23:11:20.214605555 +0000 UTC m=+66.232036734 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-pkq9n" (UniqueName: "kubernetes.io/projected/f8448dd8-d309-4d65-89c1-a7f6acc365cf-kube-api-access-pkq9n") pod "network-check-target-w8bhs" (UID: "f8448dd8-d309-4d65-89c1-a7f6acc365cf") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 23:10:49.074444 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:49.074384    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:10:49.174404 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:49.174364    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:10:49.284921 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:49.284893    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-187.ec2.internal" event="NodeReady"
Jul 02 23:10:49.285098 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:49.285033    2580 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 02 23:10:49.336330 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:49.336257    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-z7rcb"]
Jul 02 23:10:49.338920 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:49.338900    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-xk6lv"]
Jul 02 23:10:49.339041 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:49.338964    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-z7rcb"
Jul 02 23:10:49.340554 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:49.340537    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-xk6lv"
Jul 02 23:10:49.341893 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:49.341856    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 02 23:10:49.341989 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:49.341920    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 02 23:10:49.341989 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:49.341931    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-bnq4k\""
Jul 02 23:10:49.343158 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:49.343130    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 02 23:10:49.343257 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:49.343187    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 02 23:10:49.343257 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:49.343215    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 02 23:10:49.343519 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:49.343501    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-l7f7m\""
Jul 02 23:10:49.347135 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:49.347114    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-xk6lv"]
Jul 02 23:10:49.350114 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:49.350085    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-z7rcb"]
Jul 02 23:10:49.423169 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:49.423141    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x9hkk"
Jul 02 23:10:49.423169 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:49.423165    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w8bhs"
Jul 02 23:10:49.423425 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:49.423147    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7qztm"
Jul 02 23:10:49.426868 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:49.426845    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 02 23:10:49.426992 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:49.426962    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 02 23:10:49.427117 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:49.427102    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-mp9kj\""
Jul 02 23:10:49.427195 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:49.427179    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-flmt2\""
Jul 02 23:10:49.427254 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:49.427205    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 02 23:10:49.427651 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:49.427633    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 02 23:10:49.524632 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:49.524597    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/51071c9b-e670-4233-b73b-4a26ebbc009d-config-volume\") pod \"dns-default-z7rcb\" (UID: \"51071c9b-e670-4233-b73b-4a26ebbc009d\") " pod="openshift-dns/dns-default-z7rcb"
Jul 02 23:10:49.524802 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:49.524638    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/51071c9b-e670-4233-b73b-4a26ebbc009d-tmp-dir\") pod \"dns-default-z7rcb\" (UID: \"51071c9b-e670-4233-b73b-4a26ebbc009d\") " pod="openshift-dns/dns-default-z7rcb"
Jul 02 23:10:49.524802 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:49.524665    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-plbks\" (UniqueName: \"kubernetes.io/projected/51071c9b-e670-4233-b73b-4a26ebbc009d-kube-api-access-plbks\") pod \"dns-default-z7rcb\" (UID: \"51071c9b-e670-4233-b73b-4a26ebbc009d\") " pod="openshift-dns/dns-default-z7rcb"
Jul 02 23:10:49.524802 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:49.524758    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bk7mz\" (UniqueName: \"kubernetes.io/projected/5bebd72f-9864-4ea8-b1ab-279ec44f241c-kube-api-access-bk7mz\") pod \"ingress-canary-xk6lv\" (UID: \"5bebd72f-9864-4ea8-b1ab-279ec44f241c\") " pod="openshift-ingress-canary/ingress-canary-xk6lv"
Jul 02 23:10:49.524963 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:49.524827    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5bebd72f-9864-4ea8-b1ab-279ec44f241c-cert\") pod \"ingress-canary-xk6lv\" (UID: \"5bebd72f-9864-4ea8-b1ab-279ec44f241c\") " pod="openshift-ingress-canary/ingress-canary-xk6lv"
Jul 02 23:10:49.524963 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:49.524858    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/51071c9b-e670-4233-b73b-4a26ebbc009d-metrics-tls\") pod \"dns-default-z7rcb\" (UID: \"51071c9b-e670-4233-b73b-4a26ebbc009d\") " pod="openshift-dns/dns-default-z7rcb"
Jul 02 23:10:49.625597 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:49.625512    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bk7mz\" (UniqueName: \"kubernetes.io/projected/5bebd72f-9864-4ea8-b1ab-279ec44f241c-kube-api-access-bk7mz\") pod \"ingress-canary-xk6lv\" (UID: \"5bebd72f-9864-4ea8-b1ab-279ec44f241c\") " pod="openshift-ingress-canary/ingress-canary-xk6lv"
Jul 02 23:10:49.625597 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:49.625572    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5bebd72f-9864-4ea8-b1ab-279ec44f241c-cert\") pod \"ingress-canary-xk6lv\" (UID: \"5bebd72f-9864-4ea8-b1ab-279ec44f241c\") " pod="openshift-ingress-canary/ingress-canary-xk6lv"
Jul 02 23:10:49.625818 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:49.625600    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/51071c9b-e670-4233-b73b-4a26ebbc009d-metrics-tls\") pod \"dns-default-z7rcb\" (UID: \"51071c9b-e670-4233-b73b-4a26ebbc009d\") " pod="openshift-dns/dns-default-z7rcb"
Jul 02 23:10:49.625818 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:49.625679    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/51071c9b-e670-4233-b73b-4a26ebbc009d-config-volume\") pod \"dns-default-z7rcb\" (UID: \"51071c9b-e670-4233-b73b-4a26ebbc009d\") " pod="openshift-dns/dns-default-z7rcb"
Jul 02 23:10:49.625818 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:49.625702    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/51071c9b-e670-4233-b73b-4a26ebbc009d-tmp-dir\") pod \"dns-default-z7rcb\" (UID: \"51071c9b-e670-4233-b73b-4a26ebbc009d\") " pod="openshift-dns/dns-default-z7rcb"
Jul 02 23:10:49.625818 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:49.625725    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-plbks\" (UniqueName: \"kubernetes.io/projected/51071c9b-e670-4233-b73b-4a26ebbc009d-kube-api-access-plbks\") pod \"dns-default-z7rcb\" (UID: \"51071c9b-e670-4233-b73b-4a26ebbc009d\") " pod="openshift-dns/dns-default-z7rcb"
Jul 02 23:10:49.625818 ip-10-0-135-187 kubenswrapper[2580]: E0702 23:10:49.625746    2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 02 23:10:49.625818 ip-10-0-135-187 kubenswrapper[2580]: E0702 23:10:49.625813    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/51071c9b-e670-4233-b73b-4a26ebbc009d-metrics-tls podName:51071c9b-e670-4233-b73b-4a26ebbc009d nodeName:}" failed. No retries permitted until 2026-07-02 23:10:50.125793467 +0000 UTC m=+36.143224644 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/51071c9b-e670-4233-b73b-4a26ebbc009d-metrics-tls") pod "dns-default-z7rcb" (UID: "51071c9b-e670-4233-b73b-4a26ebbc009d") : secret "dns-default-metrics-tls" not found
Jul 02 23:10:49.626228 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:49.626206    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/51071c9b-e670-4233-b73b-4a26ebbc009d-tmp-dir\") pod \"dns-default-z7rcb\" (UID: \"51071c9b-e670-4233-b73b-4a26ebbc009d\") " pod="openshift-dns/dns-default-z7rcb"
Jul 02 23:10:49.626442 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:49.626424    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/51071c9b-e670-4233-b73b-4a26ebbc009d-config-volume\") pod \"dns-default-z7rcb\" (UID: \"51071c9b-e670-4233-b73b-4a26ebbc009d\") " pod="openshift-dns/dns-default-z7rcb"
Jul 02 23:10:49.630384 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:49.630185    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5bebd72f-9864-4ea8-b1ab-279ec44f241c-cert\") pod \"ingress-canary-xk6lv\" (UID: \"5bebd72f-9864-4ea8-b1ab-279ec44f241c\") " pod="openshift-ingress-canary/ingress-canary-xk6lv"
Jul 02 23:10:49.635129 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:49.635107    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bk7mz\" (UniqueName: \"kubernetes.io/projected/5bebd72f-9864-4ea8-b1ab-279ec44f241c-kube-api-access-bk7mz\") pod \"ingress-canary-xk6lv\" (UID: \"5bebd72f-9864-4ea8-b1ab-279ec44f241c\") " pod="openshift-ingress-canary/ingress-canary-xk6lv"
Jul 02 23:10:49.635508 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:49.635488    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-plbks\" (UniqueName: \"kubernetes.io/projected/51071c9b-e670-4233-b73b-4a26ebbc009d-kube-api-access-plbks\") pod \"dns-default-z7rcb\" (UID: \"51071c9b-e670-4233-b73b-4a26ebbc009d\") " pod="openshift-dns/dns-default-z7rcb"
Jul 02 23:10:49.658197 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:49.658172    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-xk6lv"
Jul 02 23:10:50.128049 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:50.128009    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/51071c9b-e670-4233-b73b-4a26ebbc009d-metrics-tls\") pod \"dns-default-z7rcb\" (UID: \"51071c9b-e670-4233-b73b-4a26ebbc009d\") " pod="openshift-dns/dns-default-z7rcb"
Jul 02 23:10:50.128480 ip-10-0-135-187 kubenswrapper[2580]: E0702 23:10:50.128143    2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 02 23:10:50.128480 ip-10-0-135-187 kubenswrapper[2580]: E0702 23:10:50.128201    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/51071c9b-e670-4233-b73b-4a26ebbc009d-metrics-tls podName:51071c9b-e670-4233-b73b-4a26ebbc009d nodeName:}" failed. No retries permitted until 2026-07-02 23:10:51.128186243 +0000 UTC m=+37.145617441 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/51071c9b-e670-4233-b73b-4a26ebbc009d-metrics-tls") pod "dns-default-z7rcb" (UID: "51071c9b-e670-4233-b73b-4a26ebbc009d") : secret "dns-default-metrics-tls" not found
Jul 02 23:10:50.655430 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:50.654207    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-xk6lv"]
Jul 02 23:10:50.657161 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:50.657135    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5bebd72f_9864_4ea8_b1ab_279ec44f241c.slice/crio-f06a7122936e733af1d80a01898be5a2c0a7e6267880d2bbb2bb9132aca0d6c7 WatchSource:0}: Error finding container f06a7122936e733af1d80a01898be5a2c0a7e6267880d2bbb2bb9132aca0d6c7: Status 404 returned error can't find the container with id f06a7122936e733af1d80a01898be5a2c0a7e6267880d2bbb2bb9132aca0d6c7
Jul 02 23:10:50.756936 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:50.756878    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ngnnt" event={"ID":"d9adaa10-5793-4280-9f7f-b7ff28a63c56","Type":"ContainerStarted","Data":"75583d9c4ea5bd6f2273c301d60045a88ecb6862810680f0a7bddd7bc1ba9c4e"}
Jul 02 23:10:50.758143 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:50.758116    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-xk6lv" event={"ID":"5bebd72f-9864-4ea8-b1ab-279ec44f241c","Type":"ContainerStarted","Data":"f06a7122936e733af1d80a01898be5a2c0a7e6267880d2bbb2bb9132aca0d6c7"}
Jul 02 23:10:51.135563 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:51.135526    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/51071c9b-e670-4233-b73b-4a26ebbc009d-metrics-tls\") pod \"dns-default-z7rcb\" (UID: \"51071c9b-e670-4233-b73b-4a26ebbc009d\") " pod="openshift-dns/dns-default-z7rcb"
Jul 02 23:10:51.135924 ip-10-0-135-187 kubenswrapper[2580]: E0702 23:10:51.135635    2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 02 23:10:51.135924 ip-10-0-135-187 kubenswrapper[2580]: E0702 23:10:51.135701    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/51071c9b-e670-4233-b73b-4a26ebbc009d-metrics-tls podName:51071c9b-e670-4233-b73b-4a26ebbc009d nodeName:}" failed. No retries permitted until 2026-07-02 23:10:53.135686622 +0000 UTC m=+39.153117797 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/51071c9b-e670-4233-b73b-4a26ebbc009d-metrics-tls") pod "dns-default-z7rcb" (UID: "51071c9b-e670-4233-b73b-4a26ebbc009d") : secret "dns-default-metrics-tls" not found
Jul 02 23:10:51.764197 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:51.764161    2580 generic.go:356] "Generic (PLEG): container finished" podID="d9adaa10-5793-4280-9f7f-b7ff28a63c56" containerID="75583d9c4ea5bd6f2273c301d60045a88ecb6862810680f0a7bddd7bc1ba9c4e" exitCode=0
Jul 02 23:10:51.764403 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:51.764236    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ngnnt" event={"ID":"d9adaa10-5793-4280-9f7f-b7ff28a63c56","Type":"ContainerDied","Data":"75583d9c4ea5bd6f2273c301d60045a88ecb6862810680f0a7bddd7bc1ba9c4e"}
Jul 02 23:10:52.769604 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:52.769429    2580 generic.go:356] "Generic (PLEG): container finished" podID="d9adaa10-5793-4280-9f7f-b7ff28a63c56" containerID="d64e63f72bfef3283ca3ac7adc79101ae809a49a7dc442f37a2dbf6e0c8d8b85" exitCode=0
Jul 02 23:10:52.769968 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:52.769512    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ngnnt" event={"ID":"d9adaa10-5793-4280-9f7f-b7ff28a63c56","Type":"ContainerDied","Data":"d64e63f72bfef3283ca3ac7adc79101ae809a49a7dc442f37a2dbf6e0c8d8b85"}
Jul 02 23:10:53.014414 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:53.014381    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:10:53.114111 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:53.114083    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:10:53.146367 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:53.146341    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/51071c9b-e670-4233-b73b-4a26ebbc009d-metrics-tls\") pod \"dns-default-z7rcb\" (UID: \"51071c9b-e670-4233-b73b-4a26ebbc009d\") " pod="openshift-dns/dns-default-z7rcb"
Jul 02 23:10:53.146508 ip-10-0-135-187 kubenswrapper[2580]: E0702 23:10:53.146490    2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 02 23:10:53.146561 ip-10-0-135-187 kubenswrapper[2580]: E0702 23:10:53.146552    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/51071c9b-e670-4233-b73b-4a26ebbc009d-metrics-tls podName:51071c9b-e670-4233-b73b-4a26ebbc009d nodeName:}" failed. No retries permitted until 2026-07-02 23:10:57.146534558 +0000 UTC m=+43.163965737 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/51071c9b-e670-4233-b73b-4a26ebbc009d-metrics-tls") pod "dns-default-z7rcb" (UID: "51071c9b-e670-4233-b73b-4a26ebbc009d") : secret "dns-default-metrics-tls" not found
Jul 02 23:10:53.214631 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:53.214592    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:10:53.333837 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:53.333798    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:10:53.398837 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:53.398812    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:10:53.776204 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:53.773796    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-xk6lv" event={"ID":"5bebd72f-9864-4ea8-b1ab-279ec44f241c","Type":"ContainerStarted","Data":"2d23863e039cae5b6543d22d576fba7dbcefd7f6c0edb9d44825e854ae006b02"}
Jul 02 23:10:53.778640 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:53.778615    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ngnnt" event={"ID":"d9adaa10-5793-4280-9f7f-b7ff28a63c56","Type":"ContainerStarted","Data":"1824b8fa44e980098300f2eaa7b2a6f19f2ae7b9b91be8eda60d92b1a0ba586c"}
Jul 02 23:10:53.796274 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:53.796217    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-xk6lv" podStartSLOduration=2.432662062 podStartE2EDuration="4.796204724s" totalImagesPullingTime="2.363542662s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:10:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:10:53.794454617 +0000 UTC m=+39.811885825" watchObservedRunningTime="2026-07-02 23:10:53.796204724 +0000 UTC m=+39.813635922"
Jul 02 23:10:53.833768 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:53.833720    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-ngnnt" podStartSLOduration=9.695519922999999 podStartE2EDuration="38.833702202s" totalImagesPullingTime="29.138182279s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 23:10:15 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:10:53.831619614 +0000 UTC m=+39.849050813" watchObservedRunningTime="2026-07-02 23:10:53.833702202 +0000 UTC m=+39.851133401"
Jul 02 23:10:53.837272 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:53.837227    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:10:53.955643 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:53.955609    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:10:54.024817 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:54.024783    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:10:54.509724 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:54.509684    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:10:54.631096 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:54.631064    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:10:54.710500 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:54.710459    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:10:54.787386 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:54.787359    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-b9mj9"]
Jul 02 23:10:54.821689 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:54.821663    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-b9mj9"]
Jul 02 23:10:54.821797 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:54.821752    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-b9mj9"
Jul 02 23:10:54.824917 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:54.824897    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Jul 02 23:10:54.826201 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:54.826181    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-64txp\""
Jul 02 23:10:54.826329 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:54.826182    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Jul 02 23:10:54.830280 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:54.830261    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:10:54.860750 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:54.860725    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6m68l\" (UniqueName: \"kubernetes.io/projected/cc311281-241c-408b-867d-01ae62962aae-kube-api-access-6m68l\") pod \"migrator-d57d58cc9-b9mj9\" (UID: \"cc311281-241c-408b-867d-01ae62962aae\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-b9mj9"
Jul 02 23:10:54.890822 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:54.890801    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:10:54.961889 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:54.961858    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6m68l\" (UniqueName: \"kubernetes.io/projected/cc311281-241c-408b-867d-01ae62962aae-kube-api-access-6m68l\") pod \"migrator-d57d58cc9-b9mj9\" (UID: \"cc311281-241c-408b-867d-01ae62962aae\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-b9mj9"
Jul 02 23:10:54.971664 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:54.971635    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6m68l\" (UniqueName: \"kubernetes.io/projected/cc311281-241c-408b-867d-01ae62962aae-kube-api-access-6m68l\") pod \"migrator-d57d58cc9-b9mj9\" (UID: \"cc311281-241c-408b-867d-01ae62962aae\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-b9mj9"
Jul 02 23:10:55.129876 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:55.129800    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-b9mj9"
Jul 02 23:10:55.274551 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:55.274519    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-b9mj9"]
Jul 02 23:10:55.277530 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:55.277505    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc311281_241c_408b_867d_01ae62962aae.slice/crio-47c7c332a44142f7399b211bb0e39164807b611387ec78eee6bbe4a783c9ab67 WatchSource:0}: Error finding container 47c7c332a44142f7399b211bb0e39164807b611387ec78eee6bbe4a783c9ab67: Status 404 returned error can't find the container with id 47c7c332a44142f7399b211bb0e39164807b611387ec78eee6bbe4a783c9ab67
Jul 02 23:10:55.298096 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:55.298070    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:10:55.394431 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:55.394347    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:10:55.784835 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:55.784805    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-b9mj9" event={"ID":"cc311281-241c-408b-867d-01ae62962aae","Type":"ContainerStarted","Data":"47c7c332a44142f7399b211bb0e39164807b611387ec78eee6bbe4a783c9ab67"}
Jul 02 23:10:56.325772 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:56.325735    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-rfzg8"]
Jul 02 23:10:56.350342 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:56.350312    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-rfzg8"
Jul 02 23:10:56.359156 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:56.359134    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 02 23:10:56.359285 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:56.359137    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 02 23:10:56.360386 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:56.360365    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 02 23:10:56.360516 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:56.360389    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-xgtgg\""
Jul 02 23:10:56.361830 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:56.361807    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-rfzg8"]
Jul 02 23:10:56.362015 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:56.361999    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 02 23:10:56.372711 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:56.372690    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/5e89b5ea-9091-4b4e-b4af-917db3d3cf7f-data-volume\") pod \"insights-runtime-extractor-rfzg8\" (UID: \"5e89b5ea-9091-4b4e-b4af-917db3d3cf7f\") " pod="openshift-insights/insights-runtime-extractor-rfzg8"
Jul 02 23:10:56.372804 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:56.372716    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5e89b5ea-9091-4b4e-b4af-917db3d3cf7f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rfzg8\" (UID: \"5e89b5ea-9091-4b4e-b4af-917db3d3cf7f\") " pod="openshift-insights/insights-runtime-extractor-rfzg8"
Jul 02 23:10:56.372804 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:56.372755    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jvdjc\" (UniqueName: \"kubernetes.io/projected/5e89b5ea-9091-4b4e-b4af-917db3d3cf7f-kube-api-access-jvdjc\") pod \"insights-runtime-extractor-rfzg8\" (UID: \"5e89b5ea-9091-4b4e-b4af-917db3d3cf7f\") " pod="openshift-insights/insights-runtime-extractor-rfzg8"
Jul 02 23:10:56.372892 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:56.372841    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/5e89b5ea-9091-4b4e-b4af-917db3d3cf7f-crio-socket\") pod \"insights-runtime-extractor-rfzg8\" (UID: \"5e89b5ea-9091-4b4e-b4af-917db3d3cf7f\") " pod="openshift-insights/insights-runtime-extractor-rfzg8"
Jul 02 23:10:56.372892 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:56.372867    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5e89b5ea-9091-4b4e-b4af-917db3d3cf7f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rfzg8\" (UID: \"5e89b5ea-9091-4b4e-b4af-917db3d3cf7f\") " pod="openshift-insights/insights-runtime-extractor-rfzg8"
Jul 02 23:10:56.374592 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:56.374560    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:10:56.458455 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:56.458422    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:10:56.473534 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:56.473504    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/5e89b5ea-9091-4b4e-b4af-917db3d3cf7f-data-volume\") pod \"insights-runtime-extractor-rfzg8\" (UID: \"5e89b5ea-9091-4b4e-b4af-917db3d3cf7f\") " pod="openshift-insights/insights-runtime-extractor-rfzg8"
Jul 02 23:10:56.473691 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:56.473545    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5e89b5ea-9091-4b4e-b4af-917db3d3cf7f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rfzg8\" (UID: \"5e89b5ea-9091-4b4e-b4af-917db3d3cf7f\") " pod="openshift-insights/insights-runtime-extractor-rfzg8"
Jul 02 23:10:56.473691 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:56.473611    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jvdjc\" (UniqueName: \"kubernetes.io/projected/5e89b5ea-9091-4b4e-b4af-917db3d3cf7f-kube-api-access-jvdjc\") pod \"insights-runtime-extractor-rfzg8\" (UID: \"5e89b5ea-9091-4b4e-b4af-917db3d3cf7f\") " pod="openshift-insights/insights-runtime-extractor-rfzg8"
Jul 02 23:10:56.473691 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:56.473631    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/5e89b5ea-9091-4b4e-b4af-917db3d3cf7f-crio-socket\") pod \"insights-runtime-extractor-rfzg8\" (UID: \"5e89b5ea-9091-4b4e-b4af-917db3d3cf7f\") " pod="openshift-insights/insights-runtime-extractor-rfzg8"
Jul 02 23:10:56.473691 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:56.473658    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5e89b5ea-9091-4b4e-b4af-917db3d3cf7f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rfzg8\" (UID: \"5e89b5ea-9091-4b4e-b4af-917db3d3cf7f\") " pod="openshift-insights/insights-runtime-extractor-rfzg8"
Jul 02 23:10:56.473907 ip-10-0-135-187 kubenswrapper[2580]: E0702 23:10:56.473711    2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 02 23:10:56.473907 ip-10-0-135-187 kubenswrapper[2580]: E0702 23:10:56.473774    2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 02 23:10:56.473907 ip-10-0-135-187 kubenswrapper[2580]: E0702 23:10:56.473790    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5e89b5ea-9091-4b4e-b4af-917db3d3cf7f-kube-rbac-proxy-cm podName:5e89b5ea-9091-4b4e-b4af-917db3d3cf7f nodeName:}" failed. No retries permitted until 2026-07-02 23:10:56.973769858 +0000 UTC m=+42.991201052 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/5e89b5ea-9091-4b4e-b4af-917db3d3cf7f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-rfzg8" (UID: "5e89b5ea-9091-4b4e-b4af-917db3d3cf7f") : configmap "kube-rbac-proxy" not found
Jul 02 23:10:56.473907 ip-10-0-135-187 kubenswrapper[2580]: E0702 23:10:56.473820    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e89b5ea-9091-4b4e-b4af-917db3d3cf7f-insights-runtime-extractor-tls podName:5e89b5ea-9091-4b4e-b4af-917db3d3cf7f nodeName:}" failed. No retries permitted until 2026-07-02 23:10:56.973807911 +0000 UTC m=+42.991239089 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/5e89b5ea-9091-4b4e-b4af-917db3d3cf7f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-rfzg8" (UID: "5e89b5ea-9091-4b4e-b4af-917db3d3cf7f") : secret "insights-runtime-extractor-tls" not found
Jul 02 23:10:56.473907 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:56.473844    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/5e89b5ea-9091-4b4e-b4af-917db3d3cf7f-crio-socket\") pod \"insights-runtime-extractor-rfzg8\" (UID: \"5e89b5ea-9091-4b4e-b4af-917db3d3cf7f\") " pod="openshift-insights/insights-runtime-extractor-rfzg8"
Jul 02 23:10:56.473907 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:56.473898    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/5e89b5ea-9091-4b4e-b4af-917db3d3cf7f-data-volume\") pod \"insights-runtime-extractor-rfzg8\" (UID: \"5e89b5ea-9091-4b4e-b4af-917db3d3cf7f\") " pod="openshift-insights/insights-runtime-extractor-rfzg8"
Jul 02 23:10:56.483215 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:56.483184    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jvdjc\" (UniqueName: \"kubernetes.io/projected/5e89b5ea-9091-4b4e-b4af-917db3d3cf7f-kube-api-access-jvdjc\") pod \"insights-runtime-extractor-rfzg8\" (UID: \"5e89b5ea-9091-4b4e-b4af-917db3d3cf7f\") " pod="openshift-insights/insights-runtime-extractor-rfzg8"
Jul 02 23:10:56.890468 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:56.890433    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-758f599c5-br44j"]
Jul 02 23:10:56.915787 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:56.915760    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-758f599c5-br44j"]
Jul 02 23:10:56.915905 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:56.915855    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-758f599c5-br44j"
Jul 02 23:10:56.918794 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:56.918768    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Jul 02 23:10:56.920128 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:56.920107    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Jul 02 23:10:56.920128 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:56.920123    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-h5lxk\""
Jul 02 23:10:56.920281 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:56.920107    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Jul 02 23:10:56.920281 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:56.920185    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Jul 02 23:10:56.926066 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:56.926042    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:10:56.976953 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:56.976924    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/8ac177a8-15fb-4128-b303-81a8437a7387-signing-cabundle\") pod \"service-ca-758f599c5-br44j\" (UID: \"8ac177a8-15fb-4128-b303-81a8437a7387\") " pod="openshift-service-ca/service-ca-758f599c5-br44j"
Jul 02 23:10:56.977124 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:56.976986    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-szdl8\" (UniqueName: \"kubernetes.io/projected/8ac177a8-15fb-4128-b303-81a8437a7387-kube-api-access-szdl8\") pod \"service-ca-758f599c5-br44j\" (UID: \"8ac177a8-15fb-4128-b303-81a8437a7387\") " pod="openshift-service-ca/service-ca-758f599c5-br44j"
Jul 02 23:10:56.977124 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:56.977015    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5e89b5ea-9091-4b4e-b4af-917db3d3cf7f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rfzg8\" (UID: \"5e89b5ea-9091-4b4e-b4af-917db3d3cf7f\") " pod="openshift-insights/insights-runtime-extractor-rfzg8"
Jul 02 23:10:56.977124 ip-10-0-135-187 kubenswrapper[2580]: E0702 23:10:56.977115    2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 02 23:10:56.977305 ip-10-0-135-187 kubenswrapper[2580]: E0702 23:10:56.977189    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5e89b5ea-9091-4b4e-b4af-917db3d3cf7f-kube-rbac-proxy-cm podName:5e89b5ea-9091-4b4e-b4af-917db3d3cf7f nodeName:}" failed. No retries permitted until 2026-07-02 23:10:57.977173675 +0000 UTC m=+43.994604850 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/5e89b5ea-9091-4b4e-b4af-917db3d3cf7f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-rfzg8" (UID: "5e89b5ea-9091-4b4e-b4af-917db3d3cf7f") : configmap "kube-rbac-proxy" not found
Jul 02 23:10:56.977305 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:56.977116    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5e89b5ea-9091-4b4e-b4af-917db3d3cf7f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rfzg8\" (UID: \"5e89b5ea-9091-4b4e-b4af-917db3d3cf7f\") " pod="openshift-insights/insights-runtime-extractor-rfzg8"
Jul 02 23:10:56.977305 ip-10-0-135-187 kubenswrapper[2580]: E0702 23:10:56.977202    2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 02 23:10:56.977305 ip-10-0-135-187 kubenswrapper[2580]: E0702 23:10:56.977305    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e89b5ea-9091-4b4e-b4af-917db3d3cf7f-insights-runtime-extractor-tls podName:5e89b5ea-9091-4b4e-b4af-917db3d3cf7f nodeName:}" failed. No retries permitted until 2026-07-02 23:10:57.977290808 +0000 UTC m=+43.994721983 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/5e89b5ea-9091-4b4e-b4af-917db3d3cf7f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-rfzg8" (UID: "5e89b5ea-9091-4b4e-b4af-917db3d3cf7f") : secret "insights-runtime-extractor-tls" not found
Jul 02 23:10:56.977457 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:56.977341    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/8ac177a8-15fb-4128-b303-81a8437a7387-signing-key\") pod \"service-ca-758f599c5-br44j\" (UID: \"8ac177a8-15fb-4128-b303-81a8437a7387\") " pod="openshift-service-ca/service-ca-758f599c5-br44j"
Jul 02 23:10:57.026508 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:57.026482    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:10:57.078546 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:57.078518    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/8ac177a8-15fb-4128-b303-81a8437a7387-signing-key\") pod \"service-ca-758f599c5-br44j\" (UID: \"8ac177a8-15fb-4128-b303-81a8437a7387\") " pod="openshift-service-ca/service-ca-758f599c5-br44j"
Jul 02 23:10:57.078674 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:57.078554    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/8ac177a8-15fb-4128-b303-81a8437a7387-signing-cabundle\") pod \"service-ca-758f599c5-br44j\" (UID: \"8ac177a8-15fb-4128-b303-81a8437a7387\") " pod="openshift-service-ca/service-ca-758f599c5-br44j"
Jul 02 23:10:57.078674 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:57.078584    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-szdl8\" (UniqueName: \"kubernetes.io/projected/8ac177a8-15fb-4128-b303-81a8437a7387-kube-api-access-szdl8\") pod \"service-ca-758f599c5-br44j\" (UID: \"8ac177a8-15fb-4128-b303-81a8437a7387\") " pod="openshift-service-ca/service-ca-758f599c5-br44j"
Jul 02 23:10:57.079209 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:57.079185    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/8ac177a8-15fb-4128-b303-81a8437a7387-signing-cabundle\") pod \"service-ca-758f599c5-br44j\" (UID: \"8ac177a8-15fb-4128-b303-81a8437a7387\") " pod="openshift-service-ca/service-ca-758f599c5-br44j"
Jul 02 23:10:57.080791 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:57.080774    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/8ac177a8-15fb-4128-b303-81a8437a7387-signing-key\") pod \"service-ca-758f599c5-br44j\" (UID: \"8ac177a8-15fb-4128-b303-81a8437a7387\") " pod="openshift-service-ca/service-ca-758f599c5-br44j"
Jul 02 23:10:57.087193 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:57.087171    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-szdl8\" (UniqueName: \"kubernetes.io/projected/8ac177a8-15fb-4128-b303-81a8437a7387-kube-api-access-szdl8\") pod \"service-ca-758f599c5-br44j\" (UID: \"8ac177a8-15fb-4128-b303-81a8437a7387\") " pod="openshift-service-ca/service-ca-758f599c5-br44j"
Jul 02 23:10:57.180026 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:57.180003    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/51071c9b-e670-4233-b73b-4a26ebbc009d-metrics-tls\") pod \"dns-default-z7rcb\" (UID: \"51071c9b-e670-4233-b73b-4a26ebbc009d\") " pod="openshift-dns/dns-default-z7rcb"
Jul 02 23:10:57.180157 ip-10-0-135-187 kubenswrapper[2580]: E0702 23:10:57.180141    2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 02 23:10:57.180227 ip-10-0-135-187 kubenswrapper[2580]: E0702 23:10:57.180214    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/51071c9b-e670-4233-b73b-4a26ebbc009d-metrics-tls podName:51071c9b-e670-4233-b73b-4a26ebbc009d nodeName:}" failed. No retries permitted until 2026-07-02 23:11:05.180192698 +0000 UTC m=+51.197623881 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/51071c9b-e670-4233-b73b-4a26ebbc009d-metrics-tls") pod "dns-default-z7rcb" (UID: "51071c9b-e670-4233-b73b-4a26ebbc009d") : secret "dns-default-metrics-tls" not found
Jul 02 23:10:57.224296 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:57.224269    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-758f599c5-br44j"
Jul 02 23:10:57.377423 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:57.377400    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-758f599c5-br44j"]
Jul 02 23:10:57.379863 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:10:57.379828    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ac177a8_15fb_4128_b303_81a8437a7387.slice/crio-52c975b66e5d0a28fb71b80574ae230229688d69c5b785e88ac5d3035c07affe WatchSource:0}: Error finding container 52c975b66e5d0a28fb71b80574ae230229688d69c5b785e88ac5d3035c07affe: Status 404 returned error can't find the container with id 52c975b66e5d0a28fb71b80574ae230229688d69c5b785e88ac5d3035c07affe
Jul 02 23:10:57.790386 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:57.790347    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-b9mj9" event={"ID":"cc311281-241c-408b-867d-01ae62962aae","Type":"ContainerStarted","Data":"23dd9ccaab835d8f3f4f681f862b9027fdd80af07cb7a0f97a1f01b9ec0adcf2"}
Jul 02 23:10:57.790548 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:57.790412    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-b9mj9" event={"ID":"cc311281-241c-408b-867d-01ae62962aae","Type":"ContainerStarted","Data":"4b459dd217ef8473726af603b4173c7b7717c6bcbd05847b4656585313ae786d"}
Jul 02 23:10:57.791473 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:57.791441    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-758f599c5-br44j" event={"ID":"8ac177a8-15fb-4128-b303-81a8437a7387","Type":"ContainerStarted","Data":"52c975b66e5d0a28fb71b80574ae230229688d69c5b785e88ac5d3035c07affe"}
Jul 02 23:10:57.811562 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:57.811519    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-b9mj9" podStartSLOduration=1.9845458759999999 podStartE2EDuration="3.811505905s" totalImagesPullingTime="1.826960029s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:10:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:10:57.809842728 +0000 UTC m=+43.827273927" watchObservedRunningTime="2026-07-02 23:10:57.811505905 +0000 UTC m=+43.828937103"
Jul 02 23:10:57.848394 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:57.848358    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:10:57.973055 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:57.973016    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:10:57.986136 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:57.986104    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5e89b5ea-9091-4b4e-b4af-917db3d3cf7f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rfzg8\" (UID: \"5e89b5ea-9091-4b4e-b4af-917db3d3cf7f\") " pod="openshift-insights/insights-runtime-extractor-rfzg8"
Jul 02 23:10:57.986335 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:57.986196    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5e89b5ea-9091-4b4e-b4af-917db3d3cf7f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rfzg8\" (UID: \"5e89b5ea-9091-4b4e-b4af-917db3d3cf7f\") " pod="openshift-insights/insights-runtime-extractor-rfzg8"
Jul 02 23:10:57.986335 ip-10-0-135-187 kubenswrapper[2580]: E0702 23:10:57.986227    2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 02 23:10:57.986335 ip-10-0-135-187 kubenswrapper[2580]: E0702 23:10:57.986304    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5e89b5ea-9091-4b4e-b4af-917db3d3cf7f-kube-rbac-proxy-cm podName:5e89b5ea-9091-4b4e-b4af-917db3d3cf7f nodeName:}" failed. No retries permitted until 2026-07-02 23:10:59.986284884 +0000 UTC m=+46.003716074 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/5e89b5ea-9091-4b4e-b4af-917db3d3cf7f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-rfzg8" (UID: "5e89b5ea-9091-4b4e-b4af-917db3d3cf7f") : configmap "kube-rbac-proxy" not found
Jul 02 23:10:57.986505 ip-10-0-135-187 kubenswrapper[2580]: E0702 23:10:57.986352    2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 02 23:10:57.986505 ip-10-0-135-187 kubenswrapper[2580]: E0702 23:10:57.986404    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e89b5ea-9091-4b4e-b4af-917db3d3cf7f-insights-runtime-extractor-tls podName:5e89b5ea-9091-4b4e-b4af-917db3d3cf7f nodeName:}" failed. No retries permitted until 2026-07-02 23:10:59.986389736 +0000 UTC m=+46.003820928 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/5e89b5ea-9091-4b4e-b4af-917db3d3cf7f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-rfzg8" (UID: "5e89b5ea-9091-4b4e-b4af-917db3d3cf7f") : secret "insights-runtime-extractor-tls" not found
Jul 02 23:10:58.087794 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:58.087707    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:10:59.288599 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:59.288567    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-pbxh5_82fa80d2-d1b6-4aed-bd41-c32e9589c4b5/dns-node-resolver/0.log"
Jul 02 23:10:59.798151 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:10:59.798121    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-758f599c5-br44j" event={"ID":"8ac177a8-15fb-4128-b303-81a8437a7387","Type":"ContainerStarted","Data":"d1e2acc183b0ada6ad9dce899508a993ad2ec14c776ae993bde12b4fa550cbb6"}
Jul 02 23:11:00.002850 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:00.002768    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5e89b5ea-9091-4b4e-b4af-917db3d3cf7f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rfzg8\" (UID: \"5e89b5ea-9091-4b4e-b4af-917db3d3cf7f\") " pod="openshift-insights/insights-runtime-extractor-rfzg8"
Jul 02 23:11:00.002850 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:00.002837    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5e89b5ea-9091-4b4e-b4af-917db3d3cf7f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rfzg8\" (UID: \"5e89b5ea-9091-4b4e-b4af-917db3d3cf7f\") " pod="openshift-insights/insights-runtime-extractor-rfzg8"
Jul 02 23:11:00.003037 ip-10-0-135-187 kubenswrapper[2580]: E0702 23:11:00.002899    2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 02 23:11:00.003037 ip-10-0-135-187 kubenswrapper[2580]: E0702 23:11:00.002905    2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 02 23:11:00.003037 ip-10-0-135-187 kubenswrapper[2580]: E0702 23:11:00.002947    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5e89b5ea-9091-4b4e-b4af-917db3d3cf7f-kube-rbac-proxy-cm podName:5e89b5ea-9091-4b4e-b4af-917db3d3cf7f nodeName:}" failed. No retries permitted until 2026-07-02 23:11:04.002933286 +0000 UTC m=+50.020364461 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/5e89b5ea-9091-4b4e-b4af-917db3d3cf7f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-rfzg8" (UID: "5e89b5ea-9091-4b4e-b4af-917db3d3cf7f") : configmap "kube-rbac-proxy" not found
Jul 02 23:11:00.003037 ip-10-0-135-187 kubenswrapper[2580]: E0702 23:11:00.002959    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e89b5ea-9091-4b4e-b4af-917db3d3cf7f-insights-runtime-extractor-tls podName:5e89b5ea-9091-4b4e-b4af-917db3d3cf7f nodeName:}" failed. No retries permitted until 2026-07-02 23:11:04.002953221 +0000 UTC m=+50.020384398 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/5e89b5ea-9091-4b4e-b4af-917db3d3cf7f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-rfzg8" (UID: "5e89b5ea-9091-4b4e-b4af-917db3d3cf7f") : secret "insights-runtime-extractor-tls" not found
Jul 02 23:11:00.287388 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:00.287362    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-zd96c_d394571a-8c62-4248-a9eb-9b165f3dfea3/node-ca/0.log"
Jul 02 23:11:00.713750 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:00.713650    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:11:00.811390 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:00.811358    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:11:00.936256 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:00.936206    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:11:01.036200 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:01.036091    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:11:01.087071 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:01.087051    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-xk6lv_5bebd72f-9864-4ea8-b1ab-279ec44f241c/serve-healthcheck-canary/0.log"
Jul 02 23:11:01.135633 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:01.135605    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:11:01.241007 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:01.240974    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:11:01.304560 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:01.304494    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-b9mj9_cc311281-241c-408b-867d-01ae62962aae/migrator/0.log"
Jul 02 23:11:01.469785 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:01.469743    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:11:01.489831 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:01.489811    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-b9mj9_cc311281-241c-408b-867d-01ae62962aae/graceful-termination/0.log"
Jul 02 23:11:02.287134 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:02.287099    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:11:02.853015 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:02.852984    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:11:03.079403 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:03.079374    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:11:03.444347 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:03.444301    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:11:03.643161 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:03.643135    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:11:04.033892 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:04.033862    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5e89b5ea-9091-4b4e-b4af-917db3d3cf7f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rfzg8\" (UID: \"5e89b5ea-9091-4b4e-b4af-917db3d3cf7f\") " pod="openshift-insights/insights-runtime-extractor-rfzg8"
Jul 02 23:11:04.034080 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:04.033918    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5e89b5ea-9091-4b4e-b4af-917db3d3cf7f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rfzg8\" (UID: \"5e89b5ea-9091-4b4e-b4af-917db3d3cf7f\") " pod="openshift-insights/insights-runtime-extractor-rfzg8"
Jul 02 23:11:04.034080 ip-10-0-135-187 kubenswrapper[2580]: E0702 23:11:04.033995    2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 02 23:11:04.034080 ip-10-0-135-187 kubenswrapper[2580]: E0702 23:11:04.034039    2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 02 23:11:04.034080 ip-10-0-135-187 kubenswrapper[2580]: E0702 23:11:04.034068    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5e89b5ea-9091-4b4e-b4af-917db3d3cf7f-kube-rbac-proxy-cm podName:5e89b5ea-9091-4b4e-b4af-917db3d3cf7f nodeName:}" failed. No retries permitted until 2026-07-02 23:11:12.034048854 +0000 UTC m=+58.051480030 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/5e89b5ea-9091-4b4e-b4af-917db3d3cf7f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-rfzg8" (UID: "5e89b5ea-9091-4b4e-b4af-917db3d3cf7f") : configmap "kube-rbac-proxy" not found
Jul 02 23:11:04.034321 ip-10-0-135-187 kubenswrapper[2580]: E0702 23:11:04.034091    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e89b5ea-9091-4b4e-b4af-917db3d3cf7f-insights-runtime-extractor-tls podName:5e89b5ea-9091-4b4e-b4af-917db3d3cf7f nodeName:}" failed. No retries permitted until 2026-07-02 23:11:12.034081804 +0000 UTC m=+58.051512979 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/5e89b5ea-9091-4b4e-b4af-917db3d3cf7f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-rfzg8" (UID: "5e89b5ea-9091-4b4e-b4af-917db3d3cf7f") : secret "insights-runtime-extractor-tls" not found
Jul 02 23:11:04.052225 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:04.052197    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:11:04.444742 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:04.444654    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:11:04.644044 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:04.644009    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:11:04.851355 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:04.851312    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:11:05.046116 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:05.046066    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:11:05.242914 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:05.242835    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/51071c9b-e670-4233-b73b-4a26ebbc009d-metrics-tls\") pod \"dns-default-z7rcb\" (UID: \"51071c9b-e670-4233-b73b-4a26ebbc009d\") " pod="openshift-dns/dns-default-z7rcb"
Jul 02 23:11:05.245149 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:05.245123    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/51071c9b-e670-4233-b73b-4a26ebbc009d-metrics-tls\") pod \"dns-default-z7rcb\" (UID: \"51071c9b-e670-4233-b73b-4a26ebbc009d\") " pod="openshift-dns/dns-default-z7rcb"
Jul 02 23:11:05.252109 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:05.252083    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-z7rcb"
Jul 02 23:11:05.387991 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:05.387938    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-758f599c5-br44j" podStartSLOduration=7.102440297 podStartE2EDuration="9.387921096s" totalImagesPullingTime="2.285480799s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:10:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:10:59.81367151 +0000 UTC m=+45.831102709" watchObservedRunningTime="2026-07-02 23:11:05.387921096 +0000 UTC m=+51.405352301"
Jul 02 23:11:05.388673 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:05.388644    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-z7rcb"]
Jul 02 23:11:05.391649 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:11:05.391618    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod51071c9b_e670_4233_b73b_4a26ebbc009d.slice/crio-caebb475a7b5cac0023cdee85dc6d4742643d255fbb8899489133b5bf0c475c5 WatchSource:0}: Error finding container caebb475a7b5cac0023cdee85dc6d4742643d255fbb8899489133b5bf0c475c5: Status 404 returned error can't find the container with id caebb475a7b5cac0023cdee85dc6d4742643d255fbb8899489133b5bf0c475c5
Jul 02 23:11:05.444274 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:05.444233    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:11:05.545512 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:05.545486    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:11:05.644867 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:05.644837    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:11:05.813520 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:05.813451    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-z7rcb" event={"ID":"51071c9b-e670-4233-b73b-4a26ebbc009d","Type":"ContainerStarted","Data":"caebb475a7b5cac0023cdee85dc6d4742643d255fbb8899489133b5bf0c475c5"}
Jul 02 23:11:06.050378 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:06.050343    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:11:06.649476 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:06.649442    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:11:06.961886 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:06.961799    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:11:07.247234 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:07.247153    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:11:07.443622 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:07.443593    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:11:07.822204 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:07.822175    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-z7rcb" event={"ID":"51071c9b-e670-4233-b73b-4a26ebbc009d","Type":"ContainerStarted","Data":"69b38ba86f79270eb42d31c066d36e7902d49466fe79d82f9c3fb1ce01dbd6a4"}
Jul 02 23:11:07.822651 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:07.822226    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-z7rcb" event={"ID":"51071c9b-e670-4233-b73b-4a26ebbc009d","Type":"ContainerStarted","Data":"3a91c8559220ee96daea9d909e12f6cc45b7354b01a88e4a24287f569201e4c7"}
Jul 02 23:11:07.822651 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:07.822347    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-z7rcb"
Jul 02 23:11:07.850811 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:07.850777    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:11:08.046375 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:08.046343    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:11:08.446829 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:08.446754    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:11:09.054505 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:09.054471    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:11:09.240621 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:09.240591    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:11:09.651262 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:09.651205    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:11:09.752437 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:09.752399    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:11:09.852986 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:09.852952    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:11:10.042856 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:10.042824    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:11:10.441896 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:10.441813    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:11:11.053811 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:11.053766    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:11:11.247236 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:11.247175    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:11:11.445514 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:11.445433    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:11:12.094153 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:12.094118    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5e89b5ea-9091-4b4e-b4af-917db3d3cf7f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rfzg8\" (UID: \"5e89b5ea-9091-4b4e-b4af-917db3d3cf7f\") " pod="openshift-insights/insights-runtime-extractor-rfzg8"
Jul 02 23:11:12.094327 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:12.094176    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5e89b5ea-9091-4b4e-b4af-917db3d3cf7f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rfzg8\" (UID: \"5e89b5ea-9091-4b4e-b4af-917db3d3cf7f\") " pod="openshift-insights/insights-runtime-extractor-rfzg8"
Jul 02 23:11:12.094656 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:12.094629    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5e89b5ea-9091-4b4e-b4af-917db3d3cf7f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rfzg8\" (UID: \"5e89b5ea-9091-4b4e-b4af-917db3d3cf7f\") " pod="openshift-insights/insights-runtime-extractor-rfzg8"
Jul 02 23:11:12.096307 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:12.096289    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5e89b5ea-9091-4b4e-b4af-917db3d3cf7f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rfzg8\" (UID: \"5e89b5ea-9091-4b4e-b4af-917db3d3cf7f\") " pod="openshift-insights/insights-runtime-extractor-rfzg8"
Jul 02 23:11:12.258785 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:12.258755    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-rfzg8"
Jul 02 23:11:12.373806 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:12.373718    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-z7rcb" podStartSLOduration=21.248040266 podStartE2EDuration="23.373702722s" totalImagesPullingTime="2.125662456s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:10:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:11:07.839812276 +0000 UTC m=+53.857243477" watchObservedRunningTime="2026-07-02 23:11:12.373702722 +0000 UTC m=+58.391133920"
Jul 02 23:11:12.374439 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:12.374422    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-rfzg8"]
Jul 02 23:11:12.376706 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:11:12.376680    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e89b5ea_9091_4b4e_b4af_917db3d3cf7f.slice/crio-806d259197d9b928714f5188e7f59ceb0843f56991943115d1f429d1e0801b30 WatchSource:0}: Error finding container 806d259197d9b928714f5188e7f59ceb0843f56991943115d1f429d1e0801b30: Status 404 returned error can't find the container with id 806d259197d9b928714f5188e7f59ceb0843f56991943115d1f429d1e0801b30
Jul 02 23:11:12.844993 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:12.844954    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-rfzg8" event={"ID":"5e89b5ea-9091-4b4e-b4af-917db3d3cf7f","Type":"ContainerStarted","Data":"806d259197d9b928714f5188e7f59ceb0843f56991943115d1f429d1e0801b30"}
Jul 02 23:11:13.089206 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:13.089040    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:11:13.240635 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:13.240542    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:11:13.365039 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:13.364948    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:11:13.580724 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:13.580681    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:11:13.741200 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:13.741151    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:11:13.806622 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:13.806594    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:11:13.942587 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:13.942506    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:11:14.028369 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:14.028339    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:11:14.755170 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:14.755135    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:11:15.154813 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:15.154764    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:11:15.255824 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:15.255793    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:11:15.354767 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:15.354736    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:11:15.583814 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:15.583784    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-56bd75fbf4-7xf9c"]
Jul 02 23:11:15.628939 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:15.628907    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-769dbf8948-6xk8l"]
Jul 02 23:11:15.629107 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:15.629039    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-56bd75fbf4-7xf9c"
Jul 02 23:11:15.636910 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:15.634872    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 02 23:11:15.636910 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:15.635059    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 02 23:11:15.636910 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:15.635145    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 02 23:11:15.636910 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:15.636495    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-ccxb6\""
Jul 02 23:11:15.636910 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:15.636721    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Jul 02 23:11:15.665837 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:15.665801    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-56bd75fbf4-7xf9c"]
Jul 02 23:11:15.665837 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:15.665835    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-769dbf8948-6xk8l"]
Jul 02 23:11:15.666024 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:15.665924    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-769dbf8948-6xk8l"
Jul 02 23:11:15.671779 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:15.671759    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Jul 02 23:11:15.722707 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:15.722677    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-88f5c7b8f-l5qsg"]
Jul 02 23:11:15.723027 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:15.723002    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8hfcs\" (UniqueName: \"kubernetes.io/projected/89abdee5-4df3-48d3-95ad-9ff4ce026697-kube-api-access-8hfcs\") pod \"klusterlet-addon-workmgr-769dbf8948-6xk8l\" (UID: \"89abdee5-4df3-48d3-95ad-9ff4ce026697\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-769dbf8948-6xk8l"
Jul 02 23:11:15.723110 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:15.723041    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/89abdee5-4df3-48d3-95ad-9ff4ce026697-tmp\") pod \"klusterlet-addon-workmgr-769dbf8948-6xk8l\" (UID: \"89abdee5-4df3-48d3-95ad-9ff4ce026697\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-769dbf8948-6xk8l"
Jul 02 23:11:15.723110 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:15.723066    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e011d6ac-4556-40e1-8c70-5e60693ac718-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-56bd75fbf4-7xf9c\" (UID: \"e011d6ac-4556-40e1-8c70-5e60693ac718\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-56bd75fbf4-7xf9c"
Jul 02 23:11:15.723110 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:15.723094    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/89abdee5-4df3-48d3-95ad-9ff4ce026697-klusterlet-config\") pod \"klusterlet-addon-workmgr-769dbf8948-6xk8l\" (UID: \"89abdee5-4df3-48d3-95ad-9ff4ce026697\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-769dbf8948-6xk8l"
Jul 02 23:11:15.723264 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:15.723116    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-znkzr\" (UniqueName: \"kubernetes.io/projected/e011d6ac-4556-40e1-8c70-5e60693ac718-kube-api-access-znkzr\") pod \"managed-serviceaccount-addon-agent-56bd75fbf4-7xf9c\" (UID: \"e011d6ac-4556-40e1-8c70-5e60693ac718\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-56bd75fbf4-7xf9c"
Jul 02 23:11:15.726654 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:15.726632    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-88f5c7b8f-l5qsg"
Jul 02 23:11:15.730733 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:15.730496    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 02 23:11:15.730733 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:15.730543    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 02 23:11:15.730733 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:15.730726    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 02 23:11:15.731133 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:15.731109    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-4dq8g\""
Jul 02 23:11:15.737078 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:15.737059    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 02 23:11:15.744114 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:15.744089    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-88f5c7b8f-l5qsg"]
Jul 02 23:11:15.745306 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:15.745274    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:11:15.749016 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:15.748997    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-xxshk"
Jul 02 23:11:15.824149 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:15.824116    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-znkzr\" (UniqueName: \"kubernetes.io/projected/e011d6ac-4556-40e1-8c70-5e60693ac718-kube-api-access-znkzr\") pod \"managed-serviceaccount-addon-agent-56bd75fbf4-7xf9c\" (UID: \"e011d6ac-4556-40e1-8c70-5e60693ac718\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-56bd75fbf4-7xf9c"
Jul 02 23:11:15.824374 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:15.824287    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8hfcs\" (UniqueName: \"kubernetes.io/projected/89abdee5-4df3-48d3-95ad-9ff4ce026697-kube-api-access-8hfcs\") pod \"klusterlet-addon-workmgr-769dbf8948-6xk8l\" (UID: \"89abdee5-4df3-48d3-95ad-9ff4ce026697\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-769dbf8948-6xk8l"
Jul 02 23:11:15.824374 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:15.824329    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e011d6ac-4556-40e1-8c70-5e60693ac718-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-56bd75fbf4-7xf9c\" (UID: \"e011d6ac-4556-40e1-8c70-5e60693ac718\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-56bd75fbf4-7xf9c"
Jul 02 23:11:15.824374 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:15.824363    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/87da2637-90d0-45b1-b8eb-49ac54703eed-image-registry-private-configuration\") pod \"image-registry-88f5c7b8f-l5qsg\" (UID: \"87da2637-90d0-45b1-b8eb-49ac54703eed\") " pod="openshift-image-registry/image-registry-88f5c7b8f-l5qsg"
Jul 02 23:11:15.824560 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:15.824391    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/87da2637-90d0-45b1-b8eb-49ac54703eed-bound-sa-token\") pod \"image-registry-88f5c7b8f-l5qsg\" (UID: \"87da2637-90d0-45b1-b8eb-49ac54703eed\") " pod="openshift-image-registry/image-registry-88f5c7b8f-l5qsg"
Jul 02 23:11:15.824560 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:15.824491    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/87da2637-90d0-45b1-b8eb-49ac54703eed-trusted-ca\") pod \"image-registry-88f5c7b8f-l5qsg\" (UID: \"87da2637-90d0-45b1-b8eb-49ac54703eed\") " pod="openshift-image-registry/image-registry-88f5c7b8f-l5qsg"
Jul 02 23:11:15.824560 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:15.824519    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/87da2637-90d0-45b1-b8eb-49ac54703eed-installation-pull-secrets\") pod \"image-registry-88f5c7b8f-l5qsg\" (UID: \"87da2637-90d0-45b1-b8eb-49ac54703eed\") " pod="openshift-image-registry/image-registry-88f5c7b8f-l5qsg"
Jul 02 23:11:15.824712 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:15.824576    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/87da2637-90d0-45b1-b8eb-49ac54703eed-registry-certificates\") pod \"image-registry-88f5c7b8f-l5qsg\" (UID: \"87da2637-90d0-45b1-b8eb-49ac54703eed\") " pod="openshift-image-registry/image-registry-88f5c7b8f-l5qsg"
Jul 02 23:11:15.824712 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:15.824647    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/87da2637-90d0-45b1-b8eb-49ac54703eed-ca-trust-extracted\") pod \"image-registry-88f5c7b8f-l5qsg\" (UID: \"87da2637-90d0-45b1-b8eb-49ac54703eed\") " pod="openshift-image-registry/image-registry-88f5c7b8f-l5qsg"
Jul 02 23:11:15.824712 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:15.824680    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/89abdee5-4df3-48d3-95ad-9ff4ce026697-tmp\") pod \"klusterlet-addon-workmgr-769dbf8948-6xk8l\" (UID: \"89abdee5-4df3-48d3-95ad-9ff4ce026697\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-769dbf8948-6xk8l"
Jul 02 23:11:15.824865 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:15.824711    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2vlz2\" (UniqueName: \"kubernetes.io/projected/87da2637-90d0-45b1-b8eb-49ac54703eed-kube-api-access-2vlz2\") pod \"image-registry-88f5c7b8f-l5qsg\" (UID: \"87da2637-90d0-45b1-b8eb-49ac54703eed\") " pod="openshift-image-registry/image-registry-88f5c7b8f-l5qsg"
Jul 02 23:11:15.824865 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:15.824743    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/89abdee5-4df3-48d3-95ad-9ff4ce026697-klusterlet-config\") pod \"klusterlet-addon-workmgr-769dbf8948-6xk8l\" (UID: \"89abdee5-4df3-48d3-95ad-9ff4ce026697\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-769dbf8948-6xk8l"
Jul 02 23:11:15.824865 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:15.824826    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/87da2637-90d0-45b1-b8eb-49ac54703eed-registry-tls\") pod \"image-registry-88f5c7b8f-l5qsg\" (UID: \"87da2637-90d0-45b1-b8eb-49ac54703eed\") " pod="openshift-image-registry/image-registry-88f5c7b8f-l5qsg"
Jul 02 23:11:15.825038 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:15.825016    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/89abdee5-4df3-48d3-95ad-9ff4ce026697-tmp\") pod \"klusterlet-addon-workmgr-769dbf8948-6xk8l\" (UID: \"89abdee5-4df3-48d3-95ad-9ff4ce026697\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-769dbf8948-6xk8l"
Jul 02 23:11:15.827103 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:15.827082    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e011d6ac-4556-40e1-8c70-5e60693ac718-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-56bd75fbf4-7xf9c\" (UID: \"e011d6ac-4556-40e1-8c70-5e60693ac718\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-56bd75fbf4-7xf9c"
Jul 02 23:11:15.827539 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:15.827518    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/89abdee5-4df3-48d3-95ad-9ff4ce026697-klusterlet-config\") pod \"klusterlet-addon-workmgr-769dbf8948-6xk8l\" (UID: \"89abdee5-4df3-48d3-95ad-9ff4ce026697\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-769dbf8948-6xk8l"
Jul 02 23:11:15.838423 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:15.838349    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-znkzr\" (UniqueName: \"kubernetes.io/projected/e011d6ac-4556-40e1-8c70-5e60693ac718-kube-api-access-znkzr\") pod \"managed-serviceaccount-addon-agent-56bd75fbf4-7xf9c\" (UID: \"e011d6ac-4556-40e1-8c70-5e60693ac718\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-56bd75fbf4-7xf9c"
Jul 02 23:11:15.838941 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:15.838921    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8hfcs\" (UniqueName: \"kubernetes.io/projected/89abdee5-4df3-48d3-95ad-9ff4ce026697-kube-api-access-8hfcs\") pod \"klusterlet-addon-workmgr-769dbf8948-6xk8l\" (UID: \"89abdee5-4df3-48d3-95ad-9ff4ce026697\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-769dbf8948-6xk8l"
Jul 02 23:11:15.844129 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:15.844046    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:11:15.925981 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:15.925939    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/87da2637-90d0-45b1-b8eb-49ac54703eed-ca-trust-extracted\") pod \"image-registry-88f5c7b8f-l5qsg\" (UID: \"87da2637-90d0-45b1-b8eb-49ac54703eed\") " pod="openshift-image-registry/image-registry-88f5c7b8f-l5qsg"
Jul 02 23:11:15.925981 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:15.925982    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2vlz2\" (UniqueName: \"kubernetes.io/projected/87da2637-90d0-45b1-b8eb-49ac54703eed-kube-api-access-2vlz2\") pod \"image-registry-88f5c7b8f-l5qsg\" (UID: \"87da2637-90d0-45b1-b8eb-49ac54703eed\") " pod="openshift-image-registry/image-registry-88f5c7b8f-l5qsg"
Jul 02 23:11:15.926211 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:15.926022    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/87da2637-90d0-45b1-b8eb-49ac54703eed-registry-tls\") pod \"image-registry-88f5c7b8f-l5qsg\" (UID: \"87da2637-90d0-45b1-b8eb-49ac54703eed\") " pod="openshift-image-registry/image-registry-88f5c7b8f-l5qsg"
Jul 02 23:11:15.926211 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:15.926068    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/87da2637-90d0-45b1-b8eb-49ac54703eed-image-registry-private-configuration\") pod \"image-registry-88f5c7b8f-l5qsg\" (UID: \"87da2637-90d0-45b1-b8eb-49ac54703eed\") " pod="openshift-image-registry/image-registry-88f5c7b8f-l5qsg"
Jul 02 23:11:15.926211 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:15.926100    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/87da2637-90d0-45b1-b8eb-49ac54703eed-bound-sa-token\") pod \"image-registry-88f5c7b8f-l5qsg\" (UID: \"87da2637-90d0-45b1-b8eb-49ac54703eed\") " pod="openshift-image-registry/image-registry-88f5c7b8f-l5qsg"
Jul 02 23:11:15.926211 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:15.926140    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/87da2637-90d0-45b1-b8eb-49ac54703eed-trusted-ca\") pod \"image-registry-88f5c7b8f-l5qsg\" (UID: \"87da2637-90d0-45b1-b8eb-49ac54703eed\") " pod="openshift-image-registry/image-registry-88f5c7b8f-l5qsg"
Jul 02 23:11:15.926211 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:15.926162    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/87da2637-90d0-45b1-b8eb-49ac54703eed-installation-pull-secrets\") pod \"image-registry-88f5c7b8f-l5qsg\" (UID: \"87da2637-90d0-45b1-b8eb-49ac54703eed\") " pod="openshift-image-registry/image-registry-88f5c7b8f-l5qsg"
Jul 02 23:11:15.926211 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:15.926195    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/87da2637-90d0-45b1-b8eb-49ac54703eed-registry-certificates\") pod \"image-registry-88f5c7b8f-l5qsg\" (UID: \"87da2637-90d0-45b1-b8eb-49ac54703eed\") " pod="openshift-image-registry/image-registry-88f5c7b8f-l5qsg"
Jul 02 23:11:15.926541 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:15.926392    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/87da2637-90d0-45b1-b8eb-49ac54703eed-ca-trust-extracted\") pod \"image-registry-88f5c7b8f-l5qsg\" (UID: \"87da2637-90d0-45b1-b8eb-49ac54703eed\") " pod="openshift-image-registry/image-registry-88f5c7b8f-l5qsg"
Jul 02 23:11:15.927063 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:15.927036    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/87da2637-90d0-45b1-b8eb-49ac54703eed-registry-certificates\") pod \"image-registry-88f5c7b8f-l5qsg\" (UID: \"87da2637-90d0-45b1-b8eb-49ac54703eed\") " pod="openshift-image-registry/image-registry-88f5c7b8f-l5qsg"
Jul 02 23:11:15.927384 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:15.927357    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/87da2637-90d0-45b1-b8eb-49ac54703eed-trusted-ca\") pod \"image-registry-88f5c7b8f-l5qsg\" (UID: \"87da2637-90d0-45b1-b8eb-49ac54703eed\") " pod="openshift-image-registry/image-registry-88f5c7b8f-l5qsg"
Jul 02 23:11:15.929195 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:15.929170    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/87da2637-90d0-45b1-b8eb-49ac54703eed-installation-pull-secrets\") pod \"image-registry-88f5c7b8f-l5qsg\" (UID: \"87da2637-90d0-45b1-b8eb-49ac54703eed\") " pod="openshift-image-registry/image-registry-88f5c7b8f-l5qsg"
Jul 02 23:11:15.929306 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:15.929236    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/87da2637-90d0-45b1-b8eb-49ac54703eed-registry-tls\") pod \"image-registry-88f5c7b8f-l5qsg\" (UID: \"87da2637-90d0-45b1-b8eb-49ac54703eed\") " pod="openshift-image-registry/image-registry-88f5c7b8f-l5qsg"
Jul 02 23:11:15.929362 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:15.929303    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/87da2637-90d0-45b1-b8eb-49ac54703eed-image-registry-private-configuration\") pod \"image-registry-88f5c7b8f-l5qsg\" (UID: \"87da2637-90d0-45b1-b8eb-49ac54703eed\") " pod="openshift-image-registry/image-registry-88f5c7b8f-l5qsg"
Jul 02 23:11:15.942318 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:15.942284    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:11:15.942785 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:15.942761    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/87da2637-90d0-45b1-b8eb-49ac54703eed-bound-sa-token\") pod \"image-registry-88f5c7b8f-l5qsg\" (UID: \"87da2637-90d0-45b1-b8eb-49ac54703eed\") " pod="openshift-image-registry/image-registry-88f5c7b8f-l5qsg"
Jul 02 23:11:15.943099 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:15.943075    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2vlz2\" (UniqueName: \"kubernetes.io/projected/87da2637-90d0-45b1-b8eb-49ac54703eed-kube-api-access-2vlz2\") pod \"image-registry-88f5c7b8f-l5qsg\" (UID: \"87da2637-90d0-45b1-b8eb-49ac54703eed\") " pod="openshift-image-registry/image-registry-88f5c7b8f-l5qsg"
Jul 02 23:11:15.947699 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:15.947680    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-56bd75fbf4-7xf9c"
Jul 02 23:11:15.976390 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:15.976363    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-769dbf8948-6xk8l"
Jul 02 23:11:16.029130 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:16.029098    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:11:16.038007 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:16.037985    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-88f5c7b8f-l5qsg"
Jul 02 23:11:16.108931 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:16.108849    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:11:16.442001 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:16.441973    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-769dbf8948-6xk8l"]
Jul 02 23:11:16.445456 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:11:16.445434    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod89abdee5_4df3_48d3_95ad_9ff4ce026697.slice/crio-2e887d23a1d9ecc878ee6005f77b85a7e88b0b7740df36305069e6f81f63b53e WatchSource:0}: Error finding container 2e887d23a1d9ecc878ee6005f77b85a7e88b0b7740df36305069e6f81f63b53e: Status 404 returned error can't find the container with id 2e887d23a1d9ecc878ee6005f77b85a7e88b0b7740df36305069e6f81f63b53e
Jul 02 23:11:16.671057 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:16.671033    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-56bd75fbf4-7xf9c"]
Jul 02 23:11:16.673499 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:11:16.673460    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode011d6ac_4556_40e1_8c70_5e60693ac718.slice/crio-818f6835628a896eeb50ca51ef0b361a94dfa55172e2a20afa5223299527788a WatchSource:0}: Error finding container 818f6835628a896eeb50ca51ef0b361a94dfa55172e2a20afa5223299527788a: Status 404 returned error can't find the container with id 818f6835628a896eeb50ca51ef0b361a94dfa55172e2a20afa5223299527788a
Jul 02 23:11:16.677661 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:16.677640    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-88f5c7b8f-l5qsg"]
Jul 02 23:11:16.680147 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:11:16.680125    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87da2637_90d0_45b1_b8eb_49ac54703eed.slice/crio-ee21f437c06f93837e80efc289d1dd0f571148515843a7307f8243c8a754454d WatchSource:0}: Error finding container ee21f437c06f93837e80efc289d1dd0f571148515843a7307f8243c8a754454d: Status 404 returned error can't find the container with id ee21f437c06f93837e80efc289d1dd0f571148515843a7307f8243c8a754454d
Jul 02 23:11:16.858229 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:16.858198    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-769dbf8948-6xk8l" event={"ID":"89abdee5-4df3-48d3-95ad-9ff4ce026697","Type":"ContainerStarted","Data":"2e887d23a1d9ecc878ee6005f77b85a7e88b0b7740df36305069e6f81f63b53e"}
Jul 02 23:11:16.859967 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:16.859928    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-rfzg8" event={"ID":"5e89b5ea-9091-4b4e-b4af-917db3d3cf7f","Type":"ContainerStarted","Data":"0a90b643329ca27faf69cbb431655bbfeceba8833379a1eeec8050aa2e99c671"}
Jul 02 23:11:16.861106 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:16.861075    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-56bd75fbf4-7xf9c" event={"ID":"e011d6ac-4556-40e1-8c70-5e60693ac718","Type":"ContainerStarted","Data":"818f6835628a896eeb50ca51ef0b361a94dfa55172e2a20afa5223299527788a"}
Jul 02 23:11:16.862566 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:16.862536    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-88f5c7b8f-l5qsg" event={"ID":"87da2637-90d0-45b1-b8eb-49ac54703eed","Type":"ContainerStarted","Data":"3cf854fe7d423fb4b83922c95688c29818c1eaa0e720b40d277816d0c9484b3c"}
Jul 02 23:11:16.862645 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:16.862587    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-88f5c7b8f-l5qsg" event={"ID":"87da2637-90d0-45b1-b8eb-49ac54703eed","Type":"ContainerStarted","Data":"ee21f437c06f93837e80efc289d1dd0f571148515843a7307f8243c8a754454d"}
Jul 02 23:11:16.862701 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:16.862682    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-88f5c7b8f-l5qsg"
Jul 02 23:11:16.886729 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:16.886671    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-88f5c7b8f-l5qsg" podStartSLOduration=1.8866502779999998 podStartE2EDuration="1.886650278s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:11:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:11:16.885379165 +0000 UTC m=+62.902810365" watchObservedRunningTime="2026-07-02 23:11:16.886650278 +0000 UTC m=+62.904081521"
Jul 02 23:11:16.999939 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:16.999910    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:11:17.093684 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:17.093652    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:11:17.827646 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:17.827613    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-z7rcb"
Jul 02 23:11:17.872261 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:17.872165    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-rfzg8" event={"ID":"5e89b5ea-9091-4b4e-b4af-917db3d3cf7f","Type":"ContainerStarted","Data":"00148068611f633a912b599fde1e59820bab607293b1bcc6a8b4751a882ad7f5"}
Jul 02 23:11:18.012447 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:18.012412    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:11:18.089576 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:18.089500    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:11:19.060042 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:19.059993    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:11:19.171278 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:19.171227    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:11:20.267213 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:20.267169    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8f153fd5-a05d-4f36-8295-6c95914702e9-metrics-certs\") pod \"network-metrics-daemon-7qztm\" (UID: \"8f153fd5-a05d-4f36-8295-6c95914702e9\") " pod="openshift-multus/network-metrics-daemon-7qztm"
Jul 02 23:11:20.267694 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:20.267231    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/203dd5bc-44ec-49b7-9065-d343c88157f1-original-pull-secret\") pod \"global-pull-secret-syncer-x9hkk\" (UID: \"203dd5bc-44ec-49b7-9065-d343c88157f1\") " pod="kube-system/global-pull-secret-syncer-x9hkk"
Jul 02 23:11:20.267694 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:20.267291    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pkq9n\" (UniqueName: \"kubernetes.io/projected/f8448dd8-d309-4d65-89c1-a7f6acc365cf-kube-api-access-pkq9n\") pod \"network-check-target-w8bhs\" (UID: \"f8448dd8-d309-4d65-89c1-a7f6acc365cf\") " pod="openshift-network-diagnostics/network-check-target-w8bhs"
Jul 02 23:11:20.270107 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:20.270076    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 02 23:11:20.271486 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:20.271456    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 02 23:11:20.271601 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:20.271458    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 02 23:11:20.280629 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:20.280611    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 02 23:11:20.280747 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:20.280682    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/203dd5bc-44ec-49b7-9065-d343c88157f1-original-pull-secret\") pod \"global-pull-secret-syncer-x9hkk\" (UID: \"203dd5bc-44ec-49b7-9065-d343c88157f1\") " pod="kube-system/global-pull-secret-syncer-x9hkk"
Jul 02 23:11:20.280805 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:20.280766    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8f153fd5-a05d-4f36-8295-6c95914702e9-metrics-certs\") pod \"network-metrics-daemon-7qztm\" (UID: \"8f153fd5-a05d-4f36-8295-6c95914702e9\") " pod="openshift-multus/network-metrics-daemon-7qztm"
Jul 02 23:11:20.290595 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:20.290577    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pkq9n\" (UniqueName: \"kubernetes.io/projected/f8448dd8-d309-4d65-89c1-a7f6acc365cf-kube-api-access-pkq9n\") pod \"network-check-target-w8bhs\" (UID: \"f8448dd8-d309-4d65-89c1-a7f6acc365cf\") " pod="openshift-network-diagnostics/network-check-target-w8bhs"
Jul 02 23:11:20.334149 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:20.334124    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x9hkk"
Jul 02 23:11:20.343137 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:20.343116    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-mp9kj\""
Jul 02 23:11:20.347953 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:20.347935    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-flmt2\""
Jul 02 23:11:20.350355 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:20.350335    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w8bhs"
Jul 02 23:11:20.356040 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:20.356015    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7qztm"
Jul 02 23:11:21.064255 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:21.064178    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-x9hkk"]
Jul 02 23:11:21.068169 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:11:21.068120    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod203dd5bc_44ec_49b7_9065_d343c88157f1.slice/crio-1c1ace3ccd4d9049bf8040e1c9f4de2f347c76ff66c2301ce7529fb0ff9ad06a WatchSource:0}: Error finding container 1c1ace3ccd4d9049bf8040e1c9f4de2f347c76ff66c2301ce7529fb0ff9ad06a: Status 404 returned error can't find the container with id 1c1ace3ccd4d9049bf8040e1c9f4de2f347c76ff66c2301ce7529fb0ff9ad06a
Jul 02 23:11:21.082586 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:21.082565    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-w8bhs"]
Jul 02 23:11:21.085138 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:11:21.085117    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8448dd8_d309_4d65_89c1_a7f6acc365cf.slice/crio-73807d2b5b61e6a1a5e9608ee36c3c11c6d50bc65bed470c7d85db6b909bb42d WatchSource:0}: Error finding container 73807d2b5b61e6a1a5e9608ee36c3c11c6d50bc65bed470c7d85db6b909bb42d: Status 404 returned error can't find the container with id 73807d2b5b61e6a1a5e9608ee36c3c11c6d50bc65bed470c7d85db6b909bb42d
Jul 02 23:11:21.104824 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:21.103971    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-7qztm"]
Jul 02 23:11:21.108347 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:11:21.108314    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f153fd5_a05d_4f36_8295_6c95914702e9.slice/crio-fb42c51b4ceb0178d35474cd9b723c95ba96bf594d0fd4fec3ad539079d619f5 WatchSource:0}: Error finding container fb42c51b4ceb0178d35474cd9b723c95ba96bf594d0fd4fec3ad539079d619f5: Status 404 returned error can't find the container with id fb42c51b4ceb0178d35474cd9b723c95ba96bf594d0fd4fec3ad539079d619f5
Jul 02 23:11:21.888376 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:21.888328    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-w8bhs" event={"ID":"f8448dd8-d309-4d65-89c1-a7f6acc365cf","Type":"ContainerStarted","Data":"73807d2b5b61e6a1a5e9608ee36c3c11c6d50bc65bed470c7d85db6b909bb42d"}
Jul 02 23:11:21.889887 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:21.889813    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-x9hkk" event={"ID":"203dd5bc-44ec-49b7-9065-d343c88157f1","Type":"ContainerStarted","Data":"1c1ace3ccd4d9049bf8040e1c9f4de2f347c76ff66c2301ce7529fb0ff9ad06a"}
Jul 02 23:11:21.892534 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:21.892394    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-rfzg8" event={"ID":"5e89b5ea-9091-4b4e-b4af-917db3d3cf7f","Type":"ContainerStarted","Data":"f75a18e694d147eda7db03339aa37c966acadcb12dc975c8ae63639375fd39ed"}
Jul 02 23:11:21.894311 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:21.894283    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-7qztm" event={"ID":"8f153fd5-a05d-4f36-8295-6c95914702e9","Type":"ContainerStarted","Data":"fb42c51b4ceb0178d35474cd9b723c95ba96bf594d0fd4fec3ad539079d619f5"}
Jul 02 23:11:21.896203 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:21.896175    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-769dbf8948-6xk8l" event={"ID":"89abdee5-4df3-48d3-95ad-9ff4ce026697","Type":"ContainerStarted","Data":"e63f13703005c6833063c282dae14ddab07c05ca9e6a9dafb58ece171224bb52"}
Jul 02 23:11:21.896657 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:21.896615    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-769dbf8948-6xk8l"
Jul 02 23:11:21.898523 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:21.898489    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-769dbf8948-6xk8l"
Jul 02 23:11:21.930742 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:21.929730    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-769dbf8948-6xk8l" podStartSLOduration=2.437327365 podStartE2EDuration="6.929711331s" totalImagesPullingTime="4.492383966s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:11:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:11:21.929155478 +0000 UTC m=+67.946586678" watchObservedRunningTime="2026-07-02 23:11:21.929711331 +0000 UTC m=+67.947142524"
Jul 02 23:11:21.930742 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:21.930105    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-rfzg8" podStartSLOduration=17.515583749 podStartE2EDuration="25.930094043s" totalImagesPullingTime="8.414510294s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 23:10:56 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:11:21.912847872 +0000 UTC m=+67.930279071" watchObservedRunningTime="2026-07-02 23:11:21.930094043 +0000 UTC m=+67.947525242"
Jul 02 23:11:22.170219 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:22.170099    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:11:22.233768 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:22.233739    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:11:23.907595 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:23.907562    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-7qztm" event={"ID":"8f153fd5-a05d-4f36-8295-6c95914702e9","Type":"ContainerStarted","Data":"3d3704474d4318aff2ed9a7be6bf4e1d4b700f830e6aec356327c86604a783f7"}
Jul 02 23:11:23.908082 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:23.907626    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-7qztm" event={"ID":"8f153fd5-a05d-4f36-8295-6c95914702e9","Type":"ContainerStarted","Data":"3d723ed1d63c2132897e92e60e46541fd7d2838e23f0b71621a2343bdd423004"}
Jul 02 23:11:23.910086 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:23.910007    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-56bd75fbf4-7xf9c" event={"ID":"e011d6ac-4556-40e1-8c70-5e60693ac718","Type":"ContainerStarted","Data":"aa0edcaeca9cf0a9b8547311c4130789e42d555345e861c79add95977c60f256"}
Jul 02 23:11:23.926598 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:23.926547    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-7qztm" podStartSLOduration=67.073381966 podStartE2EDuration="1m8.926528822s" totalImagesPullingTime="1.853146856s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:10:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:11:23.926310391 +0000 UTC m=+69.943741585" watchObservedRunningTime="2026-07-02 23:11:23.926528822 +0000 UTC m=+69.943960024"
Jul 02 23:11:23.943300 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:23.943223    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-56bd75fbf4-7xf9c" podStartSLOduration=2.659844152 podStartE2EDuration="8.943203945s" totalImagesPullingTime="6.283359793s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:11:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:11:23.942101487 +0000 UTC m=+69.959532686" watchObservedRunningTime="2026-07-02 23:11:23.943203945 +0000 UTC m=+69.960635145"
Jul 02 23:11:24.029211 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:24.029156    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:11:24.126505 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:24.126462    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:11:24.227279 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:24.227186    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:11:25.782402 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:25.782374    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:11:25.920053 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:25.920005    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-w8bhs" event={"ID":"f8448dd8-d309-4d65-89c1-a7f6acc365cf","Type":"ContainerStarted","Data":"c9ab2558109747c404c220e767aa4bf4406b44cd66137e233ba936b34ea3734e"}
Jul 02 23:11:25.920235 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:25.920134    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-w8bhs"
Jul 02 23:11:25.921622 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:25.921593    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-x9hkk" event={"ID":"203dd5bc-44ec-49b7-9065-d343c88157f1","Type":"ContainerStarted","Data":"c1ecdb202c6ffb08e91aa9680c7786420fe7adce80cb364248eab98f1c2c99fd"}
Jul 02 23:11:25.937079 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:25.937038    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-w8bhs" podStartSLOduration=66.253844161 podStartE2EDuration="1m10.937026206s" totalImagesPullingTime="4.683182045s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:10:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:11:25.935457353 +0000 UTC m=+71.952888583" watchObservedRunningTime="2026-07-02 23:11:25.937026206 +0000 UTC m=+71.954457407"
Jul 02 23:11:26.214639 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:26.214603    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:11:26.314707 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:26.314678    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:11:26.465127 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:26.465049    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:11:26.568448 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:26.568416    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:11:26.649044 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:26.649010    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:11:26.912917 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:26.912890    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:11:27.785538 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:27.785507    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:11:27.853811 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:27.853785    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:11:28.144950 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:28.144865    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:11:28.204319 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:28.204291    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:11:30.229202 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:30.229170    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:11:30.330519 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:30.330490    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:11:30.805713 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:30.805679    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:11:30.906818 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:30.906784    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:11:30.965135 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:30.965100    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:11:33.383207 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:33.383167    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:11:33.488153 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:33.488117    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:11:37.877306 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:37.877181    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-88f5c7b8f-l5qsg"
Jul 02 23:11:37.903863 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:37.903818    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-x9hkk" podStartSLOduration=78.200943623 podStartE2EDuration="1m22.903803022s" totalImagesPullingTime="4.702859399s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 23:10:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:11:25.950893142 +0000 UTC m=+71.968324341" watchObservedRunningTime="2026-07-02 23:11:37.903803022 +0000 UTC m=+83.921234228"
Jul 02 23:11:38.113935 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:38.113878    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:11:38.219956 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:38.219858    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:11:38.350914 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:38.350881    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:11:38.449594 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:38.449559    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:11:38.681284 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:38.681234    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:11:38.855027 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:38.854995    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:11:38.992942 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:38.992851    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:11:39.310867 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:39.310838    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:11:39.411904 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:39.411871    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:11:39.776364 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:39.776322    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:11:40.398957 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:40.398920    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:11:40.462016 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:40.461981    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:11:41.219517 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:41.219481    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:11:41.316293 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:41.316234    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:11:41.810590 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:41.810561    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:11:43.358063 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:43.358031    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:11:43.422638 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:43.422606    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:11:43.869410 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:43.869371    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:11:43.968573 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:43.968537    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:11:44.126667 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:44.126561    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:11:44.191454 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:44.191423    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-jwnbq"]
Jul 02 23:11:44.194911 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:44.194892    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-jwnbq"
Jul 02 23:11:44.198925 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:44.198907    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 02 23:11:44.200642 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:44.200335    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 02 23:11:44.200642 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:44.200371    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 02 23:11:44.200642 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:44.200378    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-558vz\""
Jul 02 23:11:44.200642 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:44.200446    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Jul 02 23:11:44.200642 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:44.200509    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Jul 02 23:11:44.209878 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:44.209860    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-jwnbq"]
Jul 02 23:11:44.212465 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:44.212443    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-bxm98"]
Jul 02 23:11:44.214810 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:44.214793    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-bxm98"
Jul 02 23:11:44.218367 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:44.218350    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 02 23:11:44.218651 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:44.218517    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 02 23:11:44.218651 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:44.218533    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-bdzrc\""
Jul 02 23:11:44.218792 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:44.218722    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 02 23:11:44.249705 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:44.249677    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:11:44.339938 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:44.339910    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:11:44.342938 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:44.342909    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/706d7077-97df-485d-8390-a438278ddcab-node-exporter-textfile\") pod \"node-exporter-bxm98\" (UID: \"706d7077-97df-485d-8390-a438278ddcab\") " pod="openshift-monitoring/node-exporter-bxm98"
Jul 02 23:11:44.343067 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:44.342948    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9sxzs\" (UniqueName: \"kubernetes.io/projected/8dff8496-a608-4f62-a76f-66916a6a5680-kube-api-access-9sxzs\") pod \"openshift-state-metrics-54cf96dfcf-jwnbq\" (UID: \"8dff8496-a608-4f62-a76f-66916a6a5680\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-jwnbq"
Jul 02 23:11:44.343067 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:44.342981    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8dff8496-a608-4f62-a76f-66916a6a5680-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-jwnbq\" (UID: \"8dff8496-a608-4f62-a76f-66916a6a5680\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-jwnbq"
Jul 02 23:11:44.343067 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:44.343014    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/706d7077-97df-485d-8390-a438278ddcab-node-exporter-accelerators-collector-config\") pod \"node-exporter-bxm98\" (UID: \"706d7077-97df-485d-8390-a438278ddcab\") " pod="openshift-monitoring/node-exporter-bxm98"
Jul 02 23:11:44.343067 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:44.343042    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/706d7077-97df-485d-8390-a438278ddcab-node-exporter-wtmp\") pod \"node-exporter-bxm98\" (UID: \"706d7077-97df-485d-8390-a438278ddcab\") " pod="openshift-monitoring/node-exporter-bxm98"
Jul 02 23:11:44.343317 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:44.343067    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/706d7077-97df-485d-8390-a438278ddcab-sys\") pod \"node-exporter-bxm98\" (UID: \"706d7077-97df-485d-8390-a438278ddcab\") " pod="openshift-monitoring/node-exporter-bxm98"
Jul 02 23:11:44.343317 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:44.343097    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/706d7077-97df-485d-8390-a438278ddcab-metrics-client-ca\") pod \"node-exporter-bxm98\" (UID: \"706d7077-97df-485d-8390-a438278ddcab\") " pod="openshift-monitoring/node-exporter-bxm98"
Jul 02 23:11:44.343317 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:44.343126    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/706d7077-97df-485d-8390-a438278ddcab-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-bxm98\" (UID: \"706d7077-97df-485d-8390-a438278ddcab\") " pod="openshift-monitoring/node-exporter-bxm98"
Jul 02 23:11:44.343317 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:44.343154    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/706d7077-97df-485d-8390-a438278ddcab-node-exporter-tls\") pod \"node-exporter-bxm98\" (UID: \"706d7077-97df-485d-8390-a438278ddcab\") " pod="openshift-monitoring/node-exporter-bxm98"
Jul 02 23:11:44.343317 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:44.343181    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kf2t2\" (UniqueName: \"kubernetes.io/projected/706d7077-97df-485d-8390-a438278ddcab-kube-api-access-kf2t2\") pod \"node-exporter-bxm98\" (UID: \"706d7077-97df-485d-8390-a438278ddcab\") " pod="openshift-monitoring/node-exporter-bxm98"
Jul 02 23:11:44.343317 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:44.343207    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/8dff8496-a608-4f62-a76f-66916a6a5680-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-jwnbq\" (UID: \"8dff8496-a608-4f62-a76f-66916a6a5680\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-jwnbq"
Jul 02 23:11:44.343317 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:44.343233    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8dff8496-a608-4f62-a76f-66916a6a5680-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-jwnbq\" (UID: \"8dff8496-a608-4f62-a76f-66916a6a5680\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-jwnbq"
Jul 02 23:11:44.343317 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:44.343279    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/706d7077-97df-485d-8390-a438278ddcab-root\") pod \"node-exporter-bxm98\" (UID: \"706d7077-97df-485d-8390-a438278ddcab\") " pod="openshift-monitoring/node-exporter-bxm98"
Jul 02 23:11:44.440781 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:44.440691    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:11:44.443677 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:44.443647    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/706d7077-97df-485d-8390-a438278ddcab-sys\") pod \"node-exporter-bxm98\" (UID: \"706d7077-97df-485d-8390-a438278ddcab\") " pod="openshift-monitoring/node-exporter-bxm98"
Jul 02 23:11:44.443810 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:44.443692    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/706d7077-97df-485d-8390-a438278ddcab-metrics-client-ca\") pod \"node-exporter-bxm98\" (UID: \"706d7077-97df-485d-8390-a438278ddcab\") " pod="openshift-monitoring/node-exporter-bxm98"
Jul 02 23:11:44.443810 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:44.443725    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/706d7077-97df-485d-8390-a438278ddcab-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-bxm98\" (UID: \"706d7077-97df-485d-8390-a438278ddcab\") " pod="openshift-monitoring/node-exporter-bxm98"
Jul 02 23:11:44.443810 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:44.443753    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/706d7077-97df-485d-8390-a438278ddcab-node-exporter-tls\") pod \"node-exporter-bxm98\" (UID: \"706d7077-97df-485d-8390-a438278ddcab\") " pod="openshift-monitoring/node-exporter-bxm98"
Jul 02 23:11:44.443810 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:44.443778    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kf2t2\" (UniqueName: \"kubernetes.io/projected/706d7077-97df-485d-8390-a438278ddcab-kube-api-access-kf2t2\") pod \"node-exporter-bxm98\" (UID: \"706d7077-97df-485d-8390-a438278ddcab\") " pod="openshift-monitoring/node-exporter-bxm98"
Jul 02 23:11:44.443810 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:44.443803    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/8dff8496-a608-4f62-a76f-66916a6a5680-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-jwnbq\" (UID: \"8dff8496-a608-4f62-a76f-66916a6a5680\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-jwnbq"
Jul 02 23:11:44.444005 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:44.443826    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8dff8496-a608-4f62-a76f-66916a6a5680-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-jwnbq\" (UID: \"8dff8496-a608-4f62-a76f-66916a6a5680\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-jwnbq"
Jul 02 23:11:44.444005 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:44.443859    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/706d7077-97df-485d-8390-a438278ddcab-root\") pod \"node-exporter-bxm98\" (UID: \"706d7077-97df-485d-8390-a438278ddcab\") " pod="openshift-monitoring/node-exporter-bxm98"
Jul 02 23:11:44.444005 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:44.443898    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/706d7077-97df-485d-8390-a438278ddcab-node-exporter-textfile\") pod \"node-exporter-bxm98\" (UID: \"706d7077-97df-485d-8390-a438278ddcab\") " pod="openshift-monitoring/node-exporter-bxm98"
Jul 02 23:11:44.444005 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:44.443925    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9sxzs\" (UniqueName: \"kubernetes.io/projected/8dff8496-a608-4f62-a76f-66916a6a5680-kube-api-access-9sxzs\") pod \"openshift-state-metrics-54cf96dfcf-jwnbq\" (UID: \"8dff8496-a608-4f62-a76f-66916a6a5680\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-jwnbq"
Jul 02 23:11:44.444005 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:44.443953    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8dff8496-a608-4f62-a76f-66916a6a5680-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-jwnbq\" (UID: \"8dff8496-a608-4f62-a76f-66916a6a5680\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-jwnbq"
Jul 02 23:11:44.444005 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:44.443988    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/706d7077-97df-485d-8390-a438278ddcab-node-exporter-accelerators-collector-config\") pod \"node-exporter-bxm98\" (UID: \"706d7077-97df-485d-8390-a438278ddcab\") " pod="openshift-monitoring/node-exporter-bxm98"
Jul 02 23:11:44.444202 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:44.444015    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/706d7077-97df-485d-8390-a438278ddcab-node-exporter-wtmp\") pod \"node-exporter-bxm98\" (UID: \"706d7077-97df-485d-8390-a438278ddcab\") " pod="openshift-monitoring/node-exporter-bxm98"
Jul 02 23:11:44.444202 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:44.444170    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/706d7077-97df-485d-8390-a438278ddcab-node-exporter-wtmp\") pod \"node-exporter-bxm98\" (UID: \"706d7077-97df-485d-8390-a438278ddcab\") " pod="openshift-monitoring/node-exporter-bxm98"
Jul 02 23:11:44.444280 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:44.444214    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/706d7077-97df-485d-8390-a438278ddcab-sys\") pod \"node-exporter-bxm98\" (UID: \"706d7077-97df-485d-8390-a438278ddcab\") " pod="openshift-monitoring/node-exporter-bxm98"
Jul 02 23:11:44.444783 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:44.444763    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/706d7077-97df-485d-8390-a438278ddcab-metrics-client-ca\") pod \"node-exporter-bxm98\" (UID: \"706d7077-97df-485d-8390-a438278ddcab\") " pod="openshift-monitoring/node-exporter-bxm98"
Jul 02 23:11:44.445178 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:44.445155    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/706d7077-97df-485d-8390-a438278ddcab-root\") pod \"node-exporter-bxm98\" (UID: \"706d7077-97df-485d-8390-a438278ddcab\") " pod="openshift-monitoring/node-exporter-bxm98"
Jul 02 23:11:44.445403 ip-10-0-135-187 kubenswrapper[2580]: E0702 23:11:44.445385    2580 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 02 23:11:44.445881 ip-10-0-135-187 kubenswrapper[2580]: E0702 23:11:44.445864    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/706d7077-97df-485d-8390-a438278ddcab-node-exporter-tls podName:706d7077-97df-485d-8390-a438278ddcab nodeName:}" failed. No retries permitted until 2026-07-02 23:11:44.945843534 +0000 UTC m=+90.963274727 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/706d7077-97df-485d-8390-a438278ddcab-node-exporter-tls") pod "node-exporter-bxm98" (UID: "706d7077-97df-485d-8390-a438278ddcab") : secret "node-exporter-tls" not found
Jul 02 23:11:44.446186 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:44.445475    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/706d7077-97df-485d-8390-a438278ddcab-node-exporter-textfile\") pod \"node-exporter-bxm98\" (UID: \"706d7077-97df-485d-8390-a438278ddcab\") " pod="openshift-monitoring/node-exporter-bxm98"
Jul 02 23:11:44.446319 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:44.446207    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/706d7077-97df-485d-8390-a438278ddcab-node-exporter-accelerators-collector-config\") pod \"node-exporter-bxm98\" (UID: \"706d7077-97df-485d-8390-a438278ddcab\") " pod="openshift-monitoring/node-exporter-bxm98"
Jul 02 23:11:44.446319 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:44.446308    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8dff8496-a608-4f62-a76f-66916a6a5680-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-jwnbq\" (UID: \"8dff8496-a608-4f62-a76f-66916a6a5680\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-jwnbq"
Jul 02 23:11:44.447696 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:44.447672    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/706d7077-97df-485d-8390-a438278ddcab-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-bxm98\" (UID: \"706d7077-97df-485d-8390-a438278ddcab\") " pod="openshift-monitoring/node-exporter-bxm98"
Jul 02 23:11:44.448489 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:44.448462    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/8dff8496-a608-4f62-a76f-66916a6a5680-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-jwnbq\" (UID: \"8dff8496-a608-4f62-a76f-66916a6a5680\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-jwnbq"
Jul 02 23:11:44.448874 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:44.448852    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8dff8496-a608-4f62-a76f-66916a6a5680-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-jwnbq\" (UID: \"8dff8496-a608-4f62-a76f-66916a6a5680\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-jwnbq"
Jul 02 23:11:44.464261 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:44.464223    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kf2t2\" (UniqueName: \"kubernetes.io/projected/706d7077-97df-485d-8390-a438278ddcab-kube-api-access-kf2t2\") pod \"node-exporter-bxm98\" (UID: \"706d7077-97df-485d-8390-a438278ddcab\") " pod="openshift-monitoring/node-exporter-bxm98"
Jul 02 23:11:44.466392 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:44.466367    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9sxzs\" (UniqueName: \"kubernetes.io/projected/8dff8496-a608-4f62-a76f-66916a6a5680-kube-api-access-9sxzs\") pod \"openshift-state-metrics-54cf96dfcf-jwnbq\" (UID: \"8dff8496-a608-4f62-a76f-66916a6a5680\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-jwnbq"
Jul 02 23:11:44.504289 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:44.504263    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-jwnbq"
Jul 02 23:11:44.603880 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:44.603823    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:11:44.674596 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:44.674563    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-jwnbq"]
Jul 02 23:11:44.677225 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:11:44.677199    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8dff8496_a608_4f62_a76f_66916a6a5680.slice/crio-d58df004dde58dff08fca5e41f58432d9bb12d023fac39d919d9bd0f2c5dec3f WatchSource:0}: Error finding container d58df004dde58dff08fca5e41f58432d9bb12d023fac39d919d9bd0f2c5dec3f: Status 404 returned error can't find the container with id d58df004dde58dff08fca5e41f58432d9bb12d023fac39d919d9bd0f2c5dec3f
Jul 02 23:11:44.879090 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:44.879056    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:11:44.948622 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:44.948594    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/706d7077-97df-485d-8390-a438278ddcab-node-exporter-tls\") pod \"node-exporter-bxm98\" (UID: \"706d7077-97df-485d-8390-a438278ddcab\") " pod="openshift-monitoring/node-exporter-bxm98"
Jul 02 23:11:44.950904 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:44.950885    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/706d7077-97df-485d-8390-a438278ddcab-node-exporter-tls\") pod \"node-exporter-bxm98\" (UID: \"706d7077-97df-485d-8390-a438278ddcab\") " pod="openshift-monitoring/node-exporter-bxm98"
Jul 02 23:11:44.977861 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:44.977778    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:11:44.981464 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:44.981443    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-jwnbq" event={"ID":"8dff8496-a608-4f62-a76f-66916a6a5680","Type":"ContainerStarted","Data":"b921d7e36c87f23dcd4258ab38ef26d70a1b884f170c4cbdf850560dc4f43e69"}
Jul 02 23:11:44.981536 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:44.981493    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-jwnbq" event={"ID":"8dff8496-a608-4f62-a76f-66916a6a5680","Type":"ContainerStarted","Data":"d82897c44eadf84324013ebb33b57bcd140737c7a870dd7924f5159269725619"}
Jul 02 23:11:44.981536 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:44.981514    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-jwnbq" event={"ID":"8dff8496-a608-4f62-a76f-66916a6a5680","Type":"ContainerStarted","Data":"d58df004dde58dff08fca5e41f58432d9bb12d023fac39d919d9bd0f2c5dec3f"}
Jul 02 23:11:45.124288 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:45.124236    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-bxm98"
Jul 02 23:11:45.133576 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:11:45.133552    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod706d7077_97df_485d_8390_a438278ddcab.slice/crio-3b708e338fcf5109e52c992a3029ed5cb67e8d216f6115976304986cf4949ddd WatchSource:0}: Error finding container 3b708e338fcf5109e52c992a3029ed5cb67e8d216f6115976304986cf4949ddd: Status 404 returned error can't find the container with id 3b708e338fcf5109e52c992a3029ed5cb67e8d216f6115976304986cf4949ddd
Jul 02 23:11:45.135712 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:45.135682    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:11:45.268389 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:45.268293    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:11:45.273757 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:45.273733    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 02 23:11:45.276168 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:45.276151    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 02 23:11:45.280178 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:45.280155    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 02 23:11:45.280685 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:45.280669    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 02 23:11:45.280782 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:45.280766    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 02 23:11:45.280993 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:45.280979    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 02 23:11:45.281067 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:45.280982    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 02 23:11:45.281511 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:45.281491    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-9sdrn\""
Jul 02 23:11:45.281511 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:45.281507    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 02 23:11:45.281671 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:45.281508    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 02 23:11:45.281671 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:45.281538    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 02 23:11:45.281846 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:45.281828    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 02 23:11:45.315126 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:45.315101    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 02 23:11:45.351891 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:45.351867    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/6dc35317-db4f-4ac4-be90-b14d7cd9117e-config-volume\") pod \"alertmanager-main-0\" (UID: \"6dc35317-db4f-4ac4-be90-b14d7cd9117e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 23:11:45.352036 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:45.351902    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6dc35317-db4f-4ac4-be90-b14d7cd9117e-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"6dc35317-db4f-4ac4-be90-b14d7cd9117e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 23:11:45.352036 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:45.351932    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6dc35317-db4f-4ac4-be90-b14d7cd9117e-config-out\") pod \"alertmanager-main-0\" (UID: \"6dc35317-db4f-4ac4-be90-b14d7cd9117e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 23:11:45.352036 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:45.352021    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6dc35317-db4f-4ac4-be90-b14d7cd9117e-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"6dc35317-db4f-4ac4-be90-b14d7cd9117e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 23:11:45.352167 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:45.352046    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/6dc35317-db4f-4ac4-be90-b14d7cd9117e-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"6dc35317-db4f-4ac4-be90-b14d7cd9117e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 23:11:45.352167 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:45.352072    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6dc35317-db4f-4ac4-be90-b14d7cd9117e-web-config\") pod \"alertmanager-main-0\" (UID: \"6dc35317-db4f-4ac4-be90-b14d7cd9117e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 23:11:45.352167 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:45.352102    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/6dc35317-db4f-4ac4-be90-b14d7cd9117e-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"6dc35317-db4f-4ac4-be90-b14d7cd9117e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 23:11:45.352288 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:45.352215    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6dc35317-db4f-4ac4-be90-b14d7cd9117e-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"6dc35317-db4f-4ac4-be90-b14d7cd9117e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 23:11:45.352288 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:45.352261    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kn4k7\" (UniqueName: \"kubernetes.io/projected/6dc35317-db4f-4ac4-be90-b14d7cd9117e-kube-api-access-kn4k7\") pod \"alertmanager-main-0\" (UID: \"6dc35317-db4f-4ac4-be90-b14d7cd9117e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 23:11:45.352350 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:45.352306    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/6dc35317-db4f-4ac4-be90-b14d7cd9117e-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"6dc35317-db4f-4ac4-be90-b14d7cd9117e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 23:11:45.352350 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:45.352343    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6dc35317-db4f-4ac4-be90-b14d7cd9117e-tls-assets\") pod \"alertmanager-main-0\" (UID: \"6dc35317-db4f-4ac4-be90-b14d7cd9117e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 23:11:45.352413 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:45.352367    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6dc35317-db4f-4ac4-be90-b14d7cd9117e-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"6dc35317-db4f-4ac4-be90-b14d7cd9117e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 23:11:45.352413 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:45.352387    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/6dc35317-db4f-4ac4-be90-b14d7cd9117e-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"6dc35317-db4f-4ac4-be90-b14d7cd9117e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 23:11:45.453181 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:45.453147    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6dc35317-db4f-4ac4-be90-b14d7cd9117e-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"6dc35317-db4f-4ac4-be90-b14d7cd9117e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 23:11:45.453675 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:45.453195    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kn4k7\" (UniqueName: \"kubernetes.io/projected/6dc35317-db4f-4ac4-be90-b14d7cd9117e-kube-api-access-kn4k7\") pod \"alertmanager-main-0\" (UID: \"6dc35317-db4f-4ac4-be90-b14d7cd9117e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 23:11:45.453675 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:45.453226    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/6dc35317-db4f-4ac4-be90-b14d7cd9117e-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"6dc35317-db4f-4ac4-be90-b14d7cd9117e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 23:11:45.453675 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:45.453271    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6dc35317-db4f-4ac4-be90-b14d7cd9117e-tls-assets\") pod \"alertmanager-main-0\" (UID: \"6dc35317-db4f-4ac4-be90-b14d7cd9117e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 23:11:45.453675 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:45.453297    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6dc35317-db4f-4ac4-be90-b14d7cd9117e-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"6dc35317-db4f-4ac4-be90-b14d7cd9117e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 23:11:45.453675 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:45.453324    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/6dc35317-db4f-4ac4-be90-b14d7cd9117e-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"6dc35317-db4f-4ac4-be90-b14d7cd9117e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 23:11:45.453675 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:45.453358    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/6dc35317-db4f-4ac4-be90-b14d7cd9117e-config-volume\") pod \"alertmanager-main-0\" (UID: \"6dc35317-db4f-4ac4-be90-b14d7cd9117e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 23:11:45.453675 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:45.453383    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6dc35317-db4f-4ac4-be90-b14d7cd9117e-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"6dc35317-db4f-4ac4-be90-b14d7cd9117e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 23:11:45.453675 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:45.453412    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6dc35317-db4f-4ac4-be90-b14d7cd9117e-config-out\") pod \"alertmanager-main-0\" (UID: \"6dc35317-db4f-4ac4-be90-b14d7cd9117e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 23:11:45.453675 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:45.453460    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6dc35317-db4f-4ac4-be90-b14d7cd9117e-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"6dc35317-db4f-4ac4-be90-b14d7cd9117e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 23:11:45.453675 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:45.453486    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/6dc35317-db4f-4ac4-be90-b14d7cd9117e-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"6dc35317-db4f-4ac4-be90-b14d7cd9117e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 23:11:45.453675 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:45.453521    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6dc35317-db4f-4ac4-be90-b14d7cd9117e-web-config\") pod \"alertmanager-main-0\" (UID: \"6dc35317-db4f-4ac4-be90-b14d7cd9117e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 23:11:45.453675 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:45.453560    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/6dc35317-db4f-4ac4-be90-b14d7cd9117e-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"6dc35317-db4f-4ac4-be90-b14d7cd9117e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 23:11:45.453675 ip-10-0-135-187 kubenswrapper[2580]: E0702 23:11:45.453680    2580 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found
Jul 02 23:11:45.454361 ip-10-0-135-187 kubenswrapper[2580]: E0702 23:11:45.453738    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6dc35317-db4f-4ac4-be90-b14d7cd9117e-secret-alertmanager-main-tls podName:6dc35317-db4f-4ac4-be90-b14d7cd9117e nodeName:}" failed. No retries permitted until 2026-07-02 23:11:45.953717342 +0000 UTC m=+91.971148523 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/6dc35317-db4f-4ac4-be90-b14d7cd9117e-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "6dc35317-db4f-4ac4-be90-b14d7cd9117e") : secret "alertmanager-main-tls" not found
Jul 02 23:11:45.454361 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:45.454063    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/6dc35317-db4f-4ac4-be90-b14d7cd9117e-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"6dc35317-db4f-4ac4-be90-b14d7cd9117e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 23:11:45.454590 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:45.454565    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6dc35317-db4f-4ac4-be90-b14d7cd9117e-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"6dc35317-db4f-4ac4-be90-b14d7cd9117e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 23:11:45.455319 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:45.455166    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6dc35317-db4f-4ac4-be90-b14d7cd9117e-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"6dc35317-db4f-4ac4-be90-b14d7cd9117e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 23:11:45.458269 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:45.458234    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6dc35317-db4f-4ac4-be90-b14d7cd9117e-web-config\") pod \"alertmanager-main-0\" (UID: \"6dc35317-db4f-4ac4-be90-b14d7cd9117e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 23:11:45.458585 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:45.458563    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/6dc35317-db4f-4ac4-be90-b14d7cd9117e-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"6dc35317-db4f-4ac4-be90-b14d7cd9117e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 23:11:45.460331 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:45.460308    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6dc35317-db4f-4ac4-be90-b14d7cd9117e-config-out\") pod \"alertmanager-main-0\" (UID: \"6dc35317-db4f-4ac4-be90-b14d7cd9117e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 23:11:45.460497 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:45.460459    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/6dc35317-db4f-4ac4-be90-b14d7cd9117e-config-volume\") pod \"alertmanager-main-0\" (UID: \"6dc35317-db4f-4ac4-be90-b14d7cd9117e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 23:11:45.460670 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:45.460647    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6dc35317-db4f-4ac4-be90-b14d7cd9117e-tls-assets\") pod \"alertmanager-main-0\" (UID: \"6dc35317-db4f-4ac4-be90-b14d7cd9117e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 23:11:45.460735 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:45.460688    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6dc35317-db4f-4ac4-be90-b14d7cd9117e-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"6dc35317-db4f-4ac4-be90-b14d7cd9117e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 23:11:45.462569 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:45.462550    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6dc35317-db4f-4ac4-be90-b14d7cd9117e-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"6dc35317-db4f-4ac4-be90-b14d7cd9117e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 23:11:45.462939 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:45.462918    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/6dc35317-db4f-4ac4-be90-b14d7cd9117e-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"6dc35317-db4f-4ac4-be90-b14d7cd9117e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 23:11:45.463317 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:45.463298    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kn4k7\" (UniqueName: \"kubernetes.io/projected/6dc35317-db4f-4ac4-be90-b14d7cd9117e-kube-api-access-kn4k7\") pod \"alertmanager-main-0\" (UID: \"6dc35317-db4f-4ac4-be90-b14d7cd9117e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 23:11:45.787792 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:45.787734    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:11:45.958182 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:45.958143    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/6dc35317-db4f-4ac4-be90-b14d7cd9117e-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"6dc35317-db4f-4ac4-be90-b14d7cd9117e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 23:11:45.960866 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:45.960840    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/6dc35317-db4f-4ac4-be90-b14d7cd9117e-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"6dc35317-db4f-4ac4-be90-b14d7cd9117e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 23:11:45.987110 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:45.987073    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bxm98" event={"ID":"706d7077-97df-485d-8390-a438278ddcab","Type":"ContainerStarted","Data":"3b708e338fcf5109e52c992a3029ed5cb67e8d216f6115976304986cf4949ddd"}
Jul 02 23:11:46.185461 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:46.185437    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 02 23:11:46.396121 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:46.396081    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 02 23:11:46.397379 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:11:46.397347    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6dc35317_db4f_4ac4_be90_b14d7cd9117e.slice/crio-0247b934a943bf06c2d7bf92f9e063e4329f800de42752bccdfbb93520468575 WatchSource:0}: Error finding container 0247b934a943bf06c2d7bf92f9e063e4329f800de42752bccdfbb93520468575: Status 404 returned error can't find the container with id 0247b934a943bf06c2d7bf92f9e063e4329f800de42752bccdfbb93520468575
Jul 02 23:11:46.992728 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:46.992695    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-jwnbq" event={"ID":"8dff8496-a608-4f62-a76f-66916a6a5680","Type":"ContainerStarted","Data":"689e4438d6046ef1c58df680f53133ae2aede4a20deac338f87cbd172fc615b9"}
Jul 02 23:11:46.994376 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:46.994351    2580 generic.go:356] "Generic (PLEG): container finished" podID="706d7077-97df-485d-8390-a438278ddcab" containerID="aafafc1aef0438a6909e6f67b4db44f0540f0932c00f56eb05cce3fd7327fb9f" exitCode=0
Jul 02 23:11:46.994510 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:46.994382    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bxm98" event={"ID":"706d7077-97df-485d-8390-a438278ddcab","Type":"ContainerDied","Data":"aafafc1aef0438a6909e6f67b4db44f0540f0932c00f56eb05cce3fd7327fb9f"}
Jul 02 23:11:46.995496 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:46.995472    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6dc35317-db4f-4ac4-be90-b14d7cd9117e","Type":"ContainerStarted","Data":"0247b934a943bf06c2d7bf92f9e063e4329f800de42752bccdfbb93520468575"}
Jul 02 23:11:47.011940 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:47.011902    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-jwnbq" podStartSLOduration=1.69360739 podStartE2EDuration="3.011887235s" totalImagesPullingTime="1.318279845s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:11:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:11:47.010954919 +0000 UTC m=+93.028386117" watchObservedRunningTime="2026-07-02 23:11:47.011887235 +0000 UTC m=+93.029318432"
Jul 02 23:11:47.065524 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:47.065483    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:11:47.163954 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:47.163904    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:11:47.362465 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:47.362428    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:11:47.459599 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:47.459566    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:11:48.001276 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:48.001172    2580 generic.go:356] "Generic (PLEG): container finished" podID="6dc35317-db4f-4ac4-be90-b14d7cd9117e" containerID="564313f836662127c8a3862098305f4ff73cd3fbc674dfb80d810f97b3e7d829" exitCode=0
Jul 02 23:11:48.001761 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:48.001274    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6dc35317-db4f-4ac4-be90-b14d7cd9117e","Type":"ContainerDied","Data":"564313f836662127c8a3862098305f4ff73cd3fbc674dfb80d810f97b3e7d829"}
Jul 02 23:11:48.003617 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:48.003596    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bxm98" event={"ID":"706d7077-97df-485d-8390-a438278ddcab","Type":"ContainerStarted","Data":"6cff63bb3b08d13b517c4d3de2ab78455310046a45dca6fbcfd96e730dc832ef"}
Jul 02 23:11:48.003733 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:48.003638    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bxm98" event={"ID":"706d7077-97df-485d-8390-a438278ddcab","Type":"ContainerStarted","Data":"c232bbeed51c9750631fb4580d62024083fcb278015b0b18fd441e3a282747b1"}
Jul 02 23:11:48.051836 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:48.051797    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-bxm98" podStartSLOduration=2.85687537 podStartE2EDuration="4.051784303s" totalImagesPullingTime="1.125056654s" totalInitContainerRuntime="69.852279ms" isStatefulPod=true podCreationTimestamp="2026-07-02 23:11:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:11:48.051675885 +0000 UTC m=+94.069107083" watchObservedRunningTime="2026-07-02 23:11:48.051784303 +0000 UTC m=+94.069215548"
Jul 02 23:11:48.895481 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:48.895435    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:11:48.987701 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:48.987665    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:11:49.087801 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:49.087760    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:11:49.187891 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:49.187765    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:11:49.340494 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:49.340461    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-859fd98467-hj2fr"]
Jul 02 23:11:49.343326 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:49.343303    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-859fd98467-hj2fr"
Jul 02 23:11:49.346465 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:49.346443    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Jul 02 23:11:49.346465 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:49.346456    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Jul 02 23:11:49.346640 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:49.346504    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Jul 02 23:11:49.346640 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:49.346543    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Jul 02 23:11:49.346640 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:49.346460    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-pnw2c\""
Jul 02 23:11:49.346814 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:49.346799    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Jul 02 23:11:49.352440 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:49.352416    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Jul 02 23:11:49.356436 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:49.356360    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-859fd98467-hj2fr"]
Jul 02 23:11:49.483608 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:49.483579    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:11:49.487587 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:49.487562    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/2e81d3b8-0805-4030-b254-0917876875d1-telemeter-client-tls\") pod \"telemeter-client-859fd98467-hj2fr\" (UID: \"2e81d3b8-0805-4030-b254-0917876875d1\") " pod="openshift-monitoring/telemeter-client-859fd98467-hj2fr"
Jul 02 23:11:49.487674 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:49.487604    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n8f68\" (UniqueName: \"kubernetes.io/projected/2e81d3b8-0805-4030-b254-0917876875d1-kube-api-access-n8f68\") pod \"telemeter-client-859fd98467-hj2fr\" (UID: \"2e81d3b8-0805-4030-b254-0917876875d1\") " pod="openshift-monitoring/telemeter-client-859fd98467-hj2fr"
Jul 02 23:11:49.487674 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:49.487639    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/2e81d3b8-0805-4030-b254-0917876875d1-federate-client-tls\") pod \"telemeter-client-859fd98467-hj2fr\" (UID: \"2e81d3b8-0805-4030-b254-0917876875d1\") " pod="openshift-monitoring/telemeter-client-859fd98467-hj2fr"
Jul 02 23:11:49.487674 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:49.487662    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2e81d3b8-0805-4030-b254-0917876875d1-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-859fd98467-hj2fr\" (UID: \"2e81d3b8-0805-4030-b254-0917876875d1\") " pod="openshift-monitoring/telemeter-client-859fd98467-hj2fr"
Jul 02 23:11:49.487848 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:49.487733    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/2e81d3b8-0805-4030-b254-0917876875d1-secret-telemeter-client\") pod \"telemeter-client-859fd98467-hj2fr\" (UID: \"2e81d3b8-0805-4030-b254-0917876875d1\") " pod="openshift-monitoring/telemeter-client-859fd98467-hj2fr"
Jul 02 23:11:49.487848 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:49.487766    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2e81d3b8-0805-4030-b254-0917876875d1-telemeter-trusted-ca-bundle\") pod \"telemeter-client-859fd98467-hj2fr\" (UID: \"2e81d3b8-0805-4030-b254-0917876875d1\") " pod="openshift-monitoring/telemeter-client-859fd98467-hj2fr"
Jul 02 23:11:49.487848 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:49.487798    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2e81d3b8-0805-4030-b254-0917876875d1-metrics-client-ca\") pod \"telemeter-client-859fd98467-hj2fr\" (UID: \"2e81d3b8-0805-4030-b254-0917876875d1\") " pod="openshift-monitoring/telemeter-client-859fd98467-hj2fr"
Jul 02 23:11:49.487848 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:49.487828    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2e81d3b8-0805-4030-b254-0917876875d1-serving-certs-ca-bundle\") pod \"telemeter-client-859fd98467-hj2fr\" (UID: \"2e81d3b8-0805-4030-b254-0917876875d1\") " pod="openshift-monitoring/telemeter-client-859fd98467-hj2fr"
Jul 02 23:11:49.588406 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:49.588381    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/2e81d3b8-0805-4030-b254-0917876875d1-federate-client-tls\") pod \"telemeter-client-859fd98467-hj2fr\" (UID: \"2e81d3b8-0805-4030-b254-0917876875d1\") " pod="openshift-monitoring/telemeter-client-859fd98467-hj2fr"
Jul 02 23:11:49.588521 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:49.588417    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2e81d3b8-0805-4030-b254-0917876875d1-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-859fd98467-hj2fr\" (UID: \"2e81d3b8-0805-4030-b254-0917876875d1\") " pod="openshift-monitoring/telemeter-client-859fd98467-hj2fr"
Jul 02 23:11:49.588620 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:49.588542    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/2e81d3b8-0805-4030-b254-0917876875d1-secret-telemeter-client\") pod \"telemeter-client-859fd98467-hj2fr\" (UID: \"2e81d3b8-0805-4030-b254-0917876875d1\") " pod="openshift-monitoring/telemeter-client-859fd98467-hj2fr"
Jul 02 23:11:49.588620 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:49.588573    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2e81d3b8-0805-4030-b254-0917876875d1-telemeter-trusted-ca-bundle\") pod \"telemeter-client-859fd98467-hj2fr\" (UID: \"2e81d3b8-0805-4030-b254-0917876875d1\") " pod="openshift-monitoring/telemeter-client-859fd98467-hj2fr"
Jul 02 23:11:49.588620 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:49.588609    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2e81d3b8-0805-4030-b254-0917876875d1-metrics-client-ca\") pod \"telemeter-client-859fd98467-hj2fr\" (UID: \"2e81d3b8-0805-4030-b254-0917876875d1\") " pod="openshift-monitoring/telemeter-client-859fd98467-hj2fr"
Jul 02 23:11:49.588778 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:49.588632    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2e81d3b8-0805-4030-b254-0917876875d1-serving-certs-ca-bundle\") pod \"telemeter-client-859fd98467-hj2fr\" (UID: \"2e81d3b8-0805-4030-b254-0917876875d1\") " pod="openshift-monitoring/telemeter-client-859fd98467-hj2fr"
Jul 02 23:11:49.588778 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:49.588672    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/2e81d3b8-0805-4030-b254-0917876875d1-telemeter-client-tls\") pod \"telemeter-client-859fd98467-hj2fr\" (UID: \"2e81d3b8-0805-4030-b254-0917876875d1\") " pod="openshift-monitoring/telemeter-client-859fd98467-hj2fr"
Jul 02 23:11:49.588778 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:49.588697    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n8f68\" (UniqueName: \"kubernetes.io/projected/2e81d3b8-0805-4030-b254-0917876875d1-kube-api-access-n8f68\") pod \"telemeter-client-859fd98467-hj2fr\" (UID: \"2e81d3b8-0805-4030-b254-0917876875d1\") " pod="openshift-monitoring/telemeter-client-859fd98467-hj2fr"
Jul 02 23:11:49.589572 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:49.589545    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2e81d3b8-0805-4030-b254-0917876875d1-serving-certs-ca-bundle\") pod \"telemeter-client-859fd98467-hj2fr\" (UID: \"2e81d3b8-0805-4030-b254-0917876875d1\") " pod="openshift-monitoring/telemeter-client-859fd98467-hj2fr"
Jul 02 23:11:49.589783 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:49.589569    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2e81d3b8-0805-4030-b254-0917876875d1-telemeter-trusted-ca-bundle\") pod \"telemeter-client-859fd98467-hj2fr\" (UID: \"2e81d3b8-0805-4030-b254-0917876875d1\") " pod="openshift-monitoring/telemeter-client-859fd98467-hj2fr"
Jul 02 23:11:49.589783 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:49.589726    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2e81d3b8-0805-4030-b254-0917876875d1-metrics-client-ca\") pod \"telemeter-client-859fd98467-hj2fr\" (UID: \"2e81d3b8-0805-4030-b254-0917876875d1\") " pod="openshift-monitoring/telemeter-client-859fd98467-hj2fr"
Jul 02 23:11:49.591089 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:49.591058    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2e81d3b8-0805-4030-b254-0917876875d1-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-859fd98467-hj2fr\" (UID: \"2e81d3b8-0805-4030-b254-0917876875d1\") " pod="openshift-monitoring/telemeter-client-859fd98467-hj2fr"
Jul 02 23:11:49.591175 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:49.591099    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/2e81d3b8-0805-4030-b254-0917876875d1-secret-telemeter-client\") pod \"telemeter-client-859fd98467-hj2fr\" (UID: \"2e81d3b8-0805-4030-b254-0917876875d1\") " pod="openshift-monitoring/telemeter-client-859fd98467-hj2fr"
Jul 02 23:11:49.591217 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:49.591209    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/2e81d3b8-0805-4030-b254-0917876875d1-federate-client-tls\") pod \"telemeter-client-859fd98467-hj2fr\" (UID: \"2e81d3b8-0805-4030-b254-0917876875d1\") " pod="openshift-monitoring/telemeter-client-859fd98467-hj2fr"
Jul 02 23:11:49.591487 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:49.591465    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/2e81d3b8-0805-4030-b254-0917876875d1-telemeter-client-tls\") pod \"telemeter-client-859fd98467-hj2fr\" (UID: \"2e81d3b8-0805-4030-b254-0917876875d1\") " pod="openshift-monitoring/telemeter-client-859fd98467-hj2fr"
Jul 02 23:11:49.599202 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:49.599183    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n8f68\" (UniqueName: \"kubernetes.io/projected/2e81d3b8-0805-4030-b254-0917876875d1-kube-api-access-n8f68\") pod \"telemeter-client-859fd98467-hj2fr\" (UID: \"2e81d3b8-0805-4030-b254-0917876875d1\") " pod="openshift-monitoring/telemeter-client-859fd98467-hj2fr"
Jul 02 23:11:49.654587 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:49.654568    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-859fd98467-hj2fr"
Jul 02 23:11:49.797139 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:49.797110    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-859fd98467-hj2fr"]
Jul 02 23:11:49.799929 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:11:49.799897    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e81d3b8_0805_4030_b254_0917876875d1.slice/crio-1cc02ed31548225e2a7d4b62777d9377d2e262098e4ea1572ab935a4864107af WatchSource:0}: Error finding container 1cc02ed31548225e2a7d4b62777d9377d2e262098e4ea1572ab935a4864107af: Status 404 returned error can't find the container with id 1cc02ed31548225e2a7d4b62777d9377d2e262098e4ea1572ab935a4864107af
Jul 02 23:11:50.013521 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:50.013423    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-859fd98467-hj2fr" event={"ID":"2e81d3b8-0805-4030-b254-0917876875d1","Type":"ContainerStarted","Data":"1cc02ed31548225e2a7d4b62777d9377d2e262098e4ea1572ab935a4864107af"}
Jul 02 23:11:50.016299 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:50.016272    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6dc35317-db4f-4ac4-be90-b14d7cd9117e","Type":"ContainerStarted","Data":"a38679c5c9bc549a32f5f59f70c9a5b1df35b223b09aa5edb69484028dfe769a"}
Jul 02 23:11:50.016411 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:50.016330    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6dc35317-db4f-4ac4-be90-b14d7cd9117e","Type":"ContainerStarted","Data":"5f1e224e956d15f7e295939ba51ad26d3c43fc6491c255f46df5214ead78eb29"}
Jul 02 23:11:50.016411 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:50.016355    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6dc35317-db4f-4ac4-be90-b14d7cd9117e","Type":"ContainerStarted","Data":"809cf0e9c7f16e9770d3a0727a1a5ae230997a86125e77dd2a040461d2e2e94c"}
Jul 02 23:11:50.016411 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:50.016379    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6dc35317-db4f-4ac4-be90-b14d7cd9117e","Type":"ContainerStarted","Data":"85e2fab7c5c5f3cd17662b1c1043dd5a5cc9903f9e56cd80b8645c8752cefc36"}
Jul 02 23:11:50.016411 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:50.016410    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6dc35317-db4f-4ac4-be90-b14d7cd9117e","Type":"ContainerStarted","Data":"c9a479b7ab83fab26ad8e77aa3e7c4268b28445e0e5c042ec6ea326a4333f57b"}
Jul 02 23:11:50.306506 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:50.306477    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 02 23:11:50.309692 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:50.309671    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 23:11:50.310634 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:50.310611    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:11:50.313409 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:50.313390    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 02 23:11:50.313616 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:50.313578    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-kfngr\""
Jul 02 23:11:50.313735 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:50.313709    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 02 23:11:50.314025 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:50.314007    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 02 23:11:50.314724 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:50.314694    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 02 23:11:50.314724 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:50.314707    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 02 23:11:50.314724 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:50.314720    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 02 23:11:50.314930 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:50.314735    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 02 23:11:50.314930 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:50.314770    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 02 23:11:50.315012 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:50.314930    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-9ilkup4vt4urq\""
Jul 02 23:11:50.315065 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:50.315014    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 02 23:11:50.315213 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:50.315196    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 02 23:11:50.315418 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:50.315398    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 02 23:11:50.316891 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:50.316877    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 02 23:11:50.318184 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:50.318164    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 02 23:11:50.318184 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:50.318180    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 02 23:11:50.318447 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:50.318431    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 02 23:11:50.336159 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:50.336136    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 02 23:11:50.397315 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:50.397094    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fc98ab98-c759-47a1-bb7f-6b1f2bfd69a8-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fc98ab98-c759-47a1-bb7f-6b1f2bfd69a8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 23:11:50.397315 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:50.397138    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/fc98ab98-c759-47a1-bb7f-6b1f2bfd69a8-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"fc98ab98-c759-47a1-bb7f-6b1f2bfd69a8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 23:11:50.397315 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:50.397173    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fc98ab98-c759-47a1-bb7f-6b1f2bfd69a8-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fc98ab98-c759-47a1-bb7f-6b1f2bfd69a8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 23:11:50.397315 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:50.397200    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/fc98ab98-c759-47a1-bb7f-6b1f2bfd69a8-config-out\") pod \"prometheus-k8s-0\" (UID: \"fc98ab98-c759-47a1-bb7f-6b1f2bfd69a8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 23:11:50.397315 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:50.397230    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/fc98ab98-c759-47a1-bb7f-6b1f2bfd69a8-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"fc98ab98-c759-47a1-bb7f-6b1f2bfd69a8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 23:11:50.397315 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:50.397271    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/fc98ab98-c759-47a1-bb7f-6b1f2bfd69a8-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"fc98ab98-c759-47a1-bb7f-6b1f2bfd69a8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 23:11:50.397697 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:50.397342    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fc98ab98-c759-47a1-bb7f-6b1f2bfd69a8-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"fc98ab98-c759-47a1-bb7f-6b1f2bfd69a8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 23:11:50.397697 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:50.397392    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/fc98ab98-c759-47a1-bb7f-6b1f2bfd69a8-web-config\") pod \"prometheus-k8s-0\" (UID: \"fc98ab98-c759-47a1-bb7f-6b1f2bfd69a8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 23:11:50.397697 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:50.397422    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/fc98ab98-c759-47a1-bb7f-6b1f2bfd69a8-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"fc98ab98-c759-47a1-bb7f-6b1f2bfd69a8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 23:11:50.397697 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:50.397449    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fc98ab98-c759-47a1-bb7f-6b1f2bfd69a8-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"fc98ab98-c759-47a1-bb7f-6b1f2bfd69a8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 23:11:50.397697 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:50.397476    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/fc98ab98-c759-47a1-bb7f-6b1f2bfd69a8-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"fc98ab98-c759-47a1-bb7f-6b1f2bfd69a8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 23:11:50.397697 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:50.397514    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fc98ab98-c759-47a1-bb7f-6b1f2bfd69a8-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"fc98ab98-c759-47a1-bb7f-6b1f2bfd69a8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 23:11:50.397697 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:50.397538    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-57mbg\" (UniqueName: \"kubernetes.io/projected/fc98ab98-c759-47a1-bb7f-6b1f2bfd69a8-kube-api-access-57mbg\") pod \"prometheus-k8s-0\" (UID: \"fc98ab98-c759-47a1-bb7f-6b1f2bfd69a8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 23:11:50.397697 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:50.397592    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/fc98ab98-c759-47a1-bb7f-6b1f2bfd69a8-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"fc98ab98-c759-47a1-bb7f-6b1f2bfd69a8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 23:11:50.397697 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:50.397663    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/fc98ab98-c759-47a1-bb7f-6b1f2bfd69a8-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"fc98ab98-c759-47a1-bb7f-6b1f2bfd69a8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 23:11:50.397697 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:50.397688    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/fc98ab98-c759-47a1-bb7f-6b1f2bfd69a8-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"fc98ab98-c759-47a1-bb7f-6b1f2bfd69a8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 23:11:50.398425 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:50.397716    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fc98ab98-c759-47a1-bb7f-6b1f2bfd69a8-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fc98ab98-c759-47a1-bb7f-6b1f2bfd69a8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 23:11:50.398425 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:50.397741    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/fc98ab98-c759-47a1-bb7f-6b1f2bfd69a8-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"fc98ab98-c759-47a1-bb7f-6b1f2bfd69a8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 23:11:50.398425 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:50.397767    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/fc98ab98-c759-47a1-bb7f-6b1f2bfd69a8-config\") pod \"prometheus-k8s-0\" (UID: \"fc98ab98-c759-47a1-bb7f-6b1f2bfd69a8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 23:11:50.398425 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:50.397803    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/fc98ab98-c759-47a1-bb7f-6b1f2bfd69a8-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"fc98ab98-c759-47a1-bb7f-6b1f2bfd69a8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 23:11:50.499297 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:50.499266    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fc98ab98-c759-47a1-bb7f-6b1f2bfd69a8-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"fc98ab98-c759-47a1-bb7f-6b1f2bfd69a8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 23:11:50.499470 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:50.499307    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-57mbg\" (UniqueName: \"kubernetes.io/projected/fc98ab98-c759-47a1-bb7f-6b1f2bfd69a8-kube-api-access-57mbg\") pod \"prometheus-k8s-0\" (UID: \"fc98ab98-c759-47a1-bb7f-6b1f2bfd69a8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 23:11:50.499470 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:50.499333    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/fc98ab98-c759-47a1-bb7f-6b1f2bfd69a8-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"fc98ab98-c759-47a1-bb7f-6b1f2bfd69a8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 23:11:50.499470 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:50.499365    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/fc98ab98-c759-47a1-bb7f-6b1f2bfd69a8-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"fc98ab98-c759-47a1-bb7f-6b1f2bfd69a8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 23:11:50.499470 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:50.499386    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/fc98ab98-c759-47a1-bb7f-6b1f2bfd69a8-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"fc98ab98-c759-47a1-bb7f-6b1f2bfd69a8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 23:11:50.499470 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:50.499414    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fc98ab98-c759-47a1-bb7f-6b1f2bfd69a8-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fc98ab98-c759-47a1-bb7f-6b1f2bfd69a8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 23:11:50.499470 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:50.499441    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/fc98ab98-c759-47a1-bb7f-6b1f2bfd69a8-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"fc98ab98-c759-47a1-bb7f-6b1f2bfd69a8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 23:11:50.499470 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:50.499463    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/fc98ab98-c759-47a1-bb7f-6b1f2bfd69a8-config\") pod \"prometheus-k8s-0\" (UID: \"fc98ab98-c759-47a1-bb7f-6b1f2bfd69a8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 23:11:50.499820 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:50.499492    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/fc98ab98-c759-47a1-bb7f-6b1f2bfd69a8-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"fc98ab98-c759-47a1-bb7f-6b1f2bfd69a8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 23:11:50.499820 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:50.499560    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fc98ab98-c759-47a1-bb7f-6b1f2bfd69a8-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fc98ab98-c759-47a1-bb7f-6b1f2bfd69a8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 23:11:50.499820 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:50.499590    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/fc98ab98-c759-47a1-bb7f-6b1f2bfd69a8-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"fc98ab98-c759-47a1-bb7f-6b1f2bfd69a8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 23:11:50.499820 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:50.499626    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fc98ab98-c759-47a1-bb7f-6b1f2bfd69a8-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fc98ab98-c759-47a1-bb7f-6b1f2bfd69a8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 23:11:50.499820 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:50.499653    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/fc98ab98-c759-47a1-bb7f-6b1f2bfd69a8-config-out\") pod \"prometheus-k8s-0\" (UID: \"fc98ab98-c759-47a1-bb7f-6b1f2bfd69a8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 23:11:50.499820 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:50.499686    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/fc98ab98-c759-47a1-bb7f-6b1f2bfd69a8-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"fc98ab98-c759-47a1-bb7f-6b1f2bfd69a8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 23:11:50.499820 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:50.499714    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/fc98ab98-c759-47a1-bb7f-6b1f2bfd69a8-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"fc98ab98-c759-47a1-bb7f-6b1f2bfd69a8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 23:11:50.499820 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:50.499746    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fc98ab98-c759-47a1-bb7f-6b1f2bfd69a8-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"fc98ab98-c759-47a1-bb7f-6b1f2bfd69a8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 23:11:50.499820 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:50.499786    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/fc98ab98-c759-47a1-bb7f-6b1f2bfd69a8-web-config\") pod \"prometheus-k8s-0\" (UID: \"fc98ab98-c759-47a1-bb7f-6b1f2bfd69a8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 23:11:50.499820 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:50.499816    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/fc98ab98-c759-47a1-bb7f-6b1f2bfd69a8-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"fc98ab98-c759-47a1-bb7f-6b1f2bfd69a8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 23:11:50.500350 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:50.499842    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fc98ab98-c759-47a1-bb7f-6b1f2bfd69a8-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"fc98ab98-c759-47a1-bb7f-6b1f2bfd69a8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 23:11:50.500350 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:50.499871    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/fc98ab98-c759-47a1-bb7f-6b1f2bfd69a8-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"fc98ab98-c759-47a1-bb7f-6b1f2bfd69a8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 23:11:50.500907 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:50.500533    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fc98ab98-c759-47a1-bb7f-6b1f2bfd69a8-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fc98ab98-c759-47a1-bb7f-6b1f2bfd69a8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 23:11:50.500907 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:50.500704    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fc98ab98-c759-47a1-bb7f-6b1f2bfd69a8-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fc98ab98-c759-47a1-bb7f-6b1f2bfd69a8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 23:11:50.500907 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:50.500763    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fc98ab98-c759-47a1-bb7f-6b1f2bfd69a8-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"fc98ab98-c759-47a1-bb7f-6b1f2bfd69a8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 23:11:50.501147 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:50.500950    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fc98ab98-c759-47a1-bb7f-6b1f2bfd69a8-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fc98ab98-c759-47a1-bb7f-6b1f2bfd69a8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 23:11:50.501822 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:50.501793    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/fc98ab98-c759-47a1-bb7f-6b1f2bfd69a8-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"fc98ab98-c759-47a1-bb7f-6b1f2bfd69a8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 23:11:50.502122 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:50.502099    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/fc98ab98-c759-47a1-bb7f-6b1f2bfd69a8-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"fc98ab98-c759-47a1-bb7f-6b1f2bfd69a8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 23:11:50.502628 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:50.502601    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/fc98ab98-c759-47a1-bb7f-6b1f2bfd69a8-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"fc98ab98-c759-47a1-bb7f-6b1f2bfd69a8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 23:11:50.502718 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:50.502628    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/fc98ab98-c759-47a1-bb7f-6b1f2bfd69a8-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"fc98ab98-c759-47a1-bb7f-6b1f2bfd69a8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 23:11:50.503181 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:50.503126    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fc98ab98-c759-47a1-bb7f-6b1f2bfd69a8-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"fc98ab98-c759-47a1-bb7f-6b1f2bfd69a8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 23:11:50.503295 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:50.503269    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/fc98ab98-c759-47a1-bb7f-6b1f2bfd69a8-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"fc98ab98-c759-47a1-bb7f-6b1f2bfd69a8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 23:11:50.505149 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:50.505125    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/fc98ab98-c759-47a1-bb7f-6b1f2bfd69a8-config\") pod \"prometheus-k8s-0\" (UID: \"fc98ab98-c759-47a1-bb7f-6b1f2bfd69a8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 23:11:50.505269 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:50.505126    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/fc98ab98-c759-47a1-bb7f-6b1f2bfd69a8-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"fc98ab98-c759-47a1-bb7f-6b1f2bfd69a8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 23:11:50.505544 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:50.505502    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/fc98ab98-c759-47a1-bb7f-6b1f2bfd69a8-config-out\") pod \"prometheus-k8s-0\" (UID: \"fc98ab98-c759-47a1-bb7f-6b1f2bfd69a8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 23:11:50.505840 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:50.505816    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/fc98ab98-c759-47a1-bb7f-6b1f2bfd69a8-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"fc98ab98-c759-47a1-bb7f-6b1f2bfd69a8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 23:11:50.506268 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:50.506223    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/fc98ab98-c759-47a1-bb7f-6b1f2bfd69a8-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"fc98ab98-c759-47a1-bb7f-6b1f2bfd69a8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 23:11:50.506377 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:50.506336    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/fc98ab98-c759-47a1-bb7f-6b1f2bfd69a8-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"fc98ab98-c759-47a1-bb7f-6b1f2bfd69a8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 23:11:50.506840 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:50.506810    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/fc98ab98-c759-47a1-bb7f-6b1f2bfd69a8-web-config\") pod \"prometheus-k8s-0\" (UID: \"fc98ab98-c759-47a1-bb7f-6b1f2bfd69a8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 23:11:50.506999 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:50.506971    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fc98ab98-c759-47a1-bb7f-6b1f2bfd69a8-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"fc98ab98-c759-47a1-bb7f-6b1f2bfd69a8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 23:11:50.508077 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:50.508054    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/fc98ab98-c759-47a1-bb7f-6b1f2bfd69a8-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"fc98ab98-c759-47a1-bb7f-6b1f2bfd69a8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 23:11:50.509530 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:50.509511    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-57mbg\" (UniqueName: \"kubernetes.io/projected/fc98ab98-c759-47a1-bb7f-6b1f2bfd69a8-kube-api-access-57mbg\") pod \"prometheus-k8s-0\" (UID: \"fc98ab98-c759-47a1-bb7f-6b1f2bfd69a8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 23:11:50.620395 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:50.620308    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 23:11:50.770314 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:50.770281    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 02 23:11:50.772972 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:11:50.772946    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc98ab98_c759_47a1_bb7f_6b1f2bfd69a8.slice/crio-96357f168a2d3cfed209ce571e7a02af01743fd6809083f703f29334e4d3d410 WatchSource:0}: Error finding container 96357f168a2d3cfed209ce571e7a02af01743fd6809083f703f29334e4d3d410: Status 404 returned error can't find the container with id 96357f168a2d3cfed209ce571e7a02af01743fd6809083f703f29334e4d3d410
Jul 02 23:11:51.024406 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:51.024324    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6dc35317-db4f-4ac4-be90-b14d7cd9117e","Type":"ContainerStarted","Data":"bd4203295f74887da71ac16736263ccc1780e700fa5e48b3888a1642530c9f84"}
Jul 02 23:11:51.026089 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:51.026060    2580 generic.go:356] "Generic (PLEG): container finished" podID="fc98ab98-c759-47a1-bb7f-6b1f2bfd69a8" containerID="4c1871a4dcde5f4edc30a2734eb00cfbe29338bf2c7cdeca2d6d48326b1a3808" exitCode=0
Jul 02 23:11:51.026226 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:51.026151    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fc98ab98-c759-47a1-bb7f-6b1f2bfd69a8","Type":"ContainerDied","Data":"4c1871a4dcde5f4edc30a2734eb00cfbe29338bf2c7cdeca2d6d48326b1a3808"}
Jul 02 23:11:51.026226 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:51.026213    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fc98ab98-c759-47a1-bb7f-6b1f2bfd69a8","Type":"ContainerStarted","Data":"96357f168a2d3cfed209ce571e7a02af01743fd6809083f703f29334e4d3d410"}
Jul 02 23:11:51.062198 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:51.062138    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.728903578 podStartE2EDuration="6.062115075s" totalImagesPullingTime="3.317294136s" totalInitContainerRuntime="15.917361ms" isStatefulPod=false podCreationTimestamp="2026-07-02 23:11:45 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:11:51.058774792 +0000 UTC m=+97.076206001" watchObservedRunningTime="2026-07-02 23:11:51.062115075 +0000 UTC m=+97.079546275"
Jul 02 23:11:52.032421 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:52.032378    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-859fd98467-hj2fr" event={"ID":"2e81d3b8-0805-4030-b254-0917876875d1","Type":"ContainerStarted","Data":"df3b4211bd0bd0fdb889df0ff6b7a3ce75e5662d2e1d9d44f559716c80c50bb3"}
Jul 02 23:11:52.032899 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:52.032494    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-859fd98467-hj2fr" event={"ID":"2e81d3b8-0805-4030-b254-0917876875d1","Type":"ContainerStarted","Data":"cc2f32f6c191d992441078191e55e22f4b624de53fadeca2b2f7b2f0a53e00f1"}
Jul 02 23:11:52.032899 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:52.032527    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-859fd98467-hj2fr" event={"ID":"2e81d3b8-0805-4030-b254-0917876875d1","Type":"ContainerStarted","Data":"809b55699d06f5bda7012d8a4c39851eeab267c28d7ff659eb3af700922828d3"}
Jul 02 23:11:52.064628 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:52.064572    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-859fd98467-hj2fr" podStartSLOduration=1.297938593 podStartE2EDuration="3.064554795s" totalImagesPullingTime="1.766616202s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:11:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:11:52.063747985 +0000 UTC m=+98.081179184" watchObservedRunningTime="2026-07-02 23:11:52.064554795 +0000 UTC m=+98.081985999"
Jul 02 23:11:53.150213 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:53.150177    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:11:53.252513 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:53.252481    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:11:53.385760 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:53.385727    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:11:53.483188 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:53.483095    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:11:55.128590 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:55.128557    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:11:55.236902 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:55.236825    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:11:56.051928 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:56.051898    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fc98ab98-c759-47a1-bb7f-6b1f2bfd69a8","Type":"ContainerStarted","Data":"f80861ab403c7995f512bd766545f81682f9f43172d5dfaf7a1acfe61d4e19ee"}
Jul 02 23:11:56.052082 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:56.051960    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fc98ab98-c759-47a1-bb7f-6b1f2bfd69a8","Type":"ContainerStarted","Data":"00375932ee5e6259649e128f5e2229d11262db46148605bcd6700d26038f9dc0"}
Jul 02 23:11:56.927541 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:56.927508    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-w8bhs"
Jul 02 23:11:58.064995 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:58.064962    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fc98ab98-c759-47a1-bb7f-6b1f2bfd69a8","Type":"ContainerStarted","Data":"240becbd62c11e1bb9ceadf871a3fa757efc7902ea95cde4e6584ec032b4d7af"}
Jul 02 23:11:58.065478 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:58.065031    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fc98ab98-c759-47a1-bb7f-6b1f2bfd69a8","Type":"ContainerStarted","Data":"d10f7ecda9f49cb0bb454830aa5fe579b006482c8d9284cf3f1653ec192f7bd6"}
Jul 02 23:11:58.065478 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:58.065084    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fc98ab98-c759-47a1-bb7f-6b1f2bfd69a8","Type":"ContainerStarted","Data":"c93cafd71c72b191d4a788cb1c6ca022b87acdac1c559407571e7b6349eedbe0"}
Jul 02 23:11:58.065478 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:58.065166    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fc98ab98-c759-47a1-bb7f-6b1f2bfd69a8","Type":"ContainerStarted","Data":"fe398329afa073c0218d53831b8d898bc509a68e9b3b0eea9bf5f0703b5e9325"}
Jul 02 23:11:58.101334 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:11:58.101265    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=1.751359965 podStartE2EDuration="8.101222136s" totalImagesPullingTime="6.32752204s" totalInitContainerRuntime="22.340131ms" isStatefulPod=false podCreationTimestamp="2026-07-02 23:11:50 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:11:58.099565691 +0000 UTC m=+104.116996889" watchObservedRunningTime="2026-07-02 23:11:58.101222136 +0000 UTC m=+104.118653334"
Jul 02 23:12:00.621411 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:12:00.621378    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 23:12:04.380365 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:12:04.380331    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:12:04.443302 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:12:04.443268    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:12:04.502636 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:12:04.502591    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:12:08.329290 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:12:08.329228    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:12:08.382212 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:12:08.382179    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:12:16.435661 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:12:16.435627    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:12:23.330935 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:12:23.330895    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:12:23.391752 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:12:23.391718    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:12:50.621411 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:12:50.621379    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 23:12:50.640737 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:12:50.640713    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 23:12:51.279463 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:12:51.279437    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 23:13:00.196543 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:13:00.196510    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:13:00.252072 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:13:00.252047    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:13:10.031105 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:13:10.031027    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:13:12.182895 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:13:12.182859    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:13:12.245750 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:13:12.245718    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:13:13.330021 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:13:13.329988    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:13:13.463700 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:13:13.463666    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:13:14.094704 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:13:14.094661    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:13:14.150198 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:13:14.150166    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:13:23.329426 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:13:23.329389    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:13:23.429098 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:13:23.429067    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:13:23.529686 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:13:23.529651    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:13:24.644414 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:13:24.644374    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:13:24.744943 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:13:24.744907    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:13:24.814450 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:13:24.814406    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:13:32.081888 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:13:32.081855    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:13:32.137761 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:13:32.137732    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:14:01.884957 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:14:01.884910    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:14:01.986892 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:14:01.986861    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:14:15.568965 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:14:15.568928    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:14:23.939666 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:14:23.939629    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:14:24.752003 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:14:24.751962    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:14:27.561201 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:14:27.561161    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:14:27.658460 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:14:27.658428    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:14:29.568027 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:14:29.567992    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:14:29.661612 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:14:29.661584    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:14:30.236853 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:14:30.236795    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:14:30.380693 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:14:30.380654    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:14:31.562863 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:14:31.562833    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:14:31.964657 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:14:31.964579    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:14:34.539526 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:14:34.539491    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:14:34.639889 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:14:34.639858    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:14:36.852636 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:14:36.852551    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:14:36.953338 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:14:36.953306    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:14:37.263920 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:14:37.263844    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:14:40.167028 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:14:40.166989    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:14:40.942899 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:14:40.942866    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:14:41.044675 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:14:41.044642    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:14:49.677171 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:14:49.677135    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:14:49.774411 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:14:49.774378    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:14:51.887115 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:14:51.887084    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:15:04.393452 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:15:04.393421    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:15:04.492708 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:15:04.492676    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:15:04.985946 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:15:04.985906    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:15:05.321511 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:15:05.321478    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:15:05.422007 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:15:05.421978    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:15:05.487281 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:15:05.487234    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-79946c878f-cqkgw"]
Jul 02 23:15:05.489686 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:15:05.489666    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-79946c878f-cqkgw"
Jul 02 23:15:05.494587 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:15:05.494556    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 02 23:15:05.494587 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:15:05.494584    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 02 23:15:05.494775 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:15:05.494604    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 02 23:15:05.494939 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:15:05.494919    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-n47wn\""
Jul 02 23:15:05.495178 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:15:05.495164    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 02 23:15:05.508221 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:15:05.508198    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-79946c878f-cqkgw"]
Jul 02 23:15:05.613103 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:15:05.613020    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/455ff2b0-80e7-47c2-b6a3-fcbec945ec09-webhook-cert\") pod \"opendatahub-operator-controller-manager-79946c878f-cqkgw\" (UID: \"455ff2b0-80e7-47c2-b6a3-fcbec945ec09\") " pod="opendatahub/opendatahub-operator-controller-manager-79946c878f-cqkgw"
Jul 02 23:15:05.613103 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:15:05.613054    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/455ff2b0-80e7-47c2-b6a3-fcbec945ec09-tmp\") pod \"opendatahub-operator-controller-manager-79946c878f-cqkgw\" (UID: \"455ff2b0-80e7-47c2-b6a3-fcbec945ec09\") " pod="opendatahub/opendatahub-operator-controller-manager-79946c878f-cqkgw"
Jul 02 23:15:05.613103 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:15:05.613074    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8wlw7\" (UniqueName: \"kubernetes.io/projected/455ff2b0-80e7-47c2-b6a3-fcbec945ec09-kube-api-access-8wlw7\") pod \"opendatahub-operator-controller-manager-79946c878f-cqkgw\" (UID: \"455ff2b0-80e7-47c2-b6a3-fcbec945ec09\") " pod="opendatahub/opendatahub-operator-controller-manager-79946c878f-cqkgw"
Jul 02 23:15:05.613103 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:15:05.613100    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/455ff2b0-80e7-47c2-b6a3-fcbec945ec09-apiservice-cert\") pod \"opendatahub-operator-controller-manager-79946c878f-cqkgw\" (UID: \"455ff2b0-80e7-47c2-b6a3-fcbec945ec09\") " pod="opendatahub/opendatahub-operator-controller-manager-79946c878f-cqkgw"
Jul 02 23:15:05.613400 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:15:05.613224    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/455ff2b0-80e7-47c2-b6a3-fcbec945ec09-manifests\") pod \"opendatahub-operator-controller-manager-79946c878f-cqkgw\" (UID: \"455ff2b0-80e7-47c2-b6a3-fcbec945ec09\") " pod="opendatahub/opendatahub-operator-controller-manager-79946c878f-cqkgw"
Jul 02 23:15:05.634897 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:15:05.634862    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:15:05.714346 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:15:05.714314    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8wlw7\" (UniqueName: \"kubernetes.io/projected/455ff2b0-80e7-47c2-b6a3-fcbec945ec09-kube-api-access-8wlw7\") pod \"opendatahub-operator-controller-manager-79946c878f-cqkgw\" (UID: \"455ff2b0-80e7-47c2-b6a3-fcbec945ec09\") " pod="opendatahub/opendatahub-operator-controller-manager-79946c878f-cqkgw"
Jul 02 23:15:05.714515 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:15:05.714359    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/455ff2b0-80e7-47c2-b6a3-fcbec945ec09-apiservice-cert\") pod \"opendatahub-operator-controller-manager-79946c878f-cqkgw\" (UID: \"455ff2b0-80e7-47c2-b6a3-fcbec945ec09\") " pod="opendatahub/opendatahub-operator-controller-manager-79946c878f-cqkgw"
Jul 02 23:15:05.714515 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:15:05.714409    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/455ff2b0-80e7-47c2-b6a3-fcbec945ec09-manifests\") pod \"opendatahub-operator-controller-manager-79946c878f-cqkgw\" (UID: \"455ff2b0-80e7-47c2-b6a3-fcbec945ec09\") " pod="opendatahub/opendatahub-operator-controller-manager-79946c878f-cqkgw"
Jul 02 23:15:05.714515 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:15:05.714444    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/455ff2b0-80e7-47c2-b6a3-fcbec945ec09-webhook-cert\") pod \"opendatahub-operator-controller-manager-79946c878f-cqkgw\" (UID: \"455ff2b0-80e7-47c2-b6a3-fcbec945ec09\") " pod="opendatahub/opendatahub-operator-controller-manager-79946c878f-cqkgw"
Jul 02 23:15:05.714515 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:15:05.714460    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/455ff2b0-80e7-47c2-b6a3-fcbec945ec09-tmp\") pod \"opendatahub-operator-controller-manager-79946c878f-cqkgw\" (UID: \"455ff2b0-80e7-47c2-b6a3-fcbec945ec09\") " pod="opendatahub/opendatahub-operator-controller-manager-79946c878f-cqkgw"
Jul 02 23:15:05.714838 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:15:05.714811    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/455ff2b0-80e7-47c2-b6a3-fcbec945ec09-manifests\") pod \"opendatahub-operator-controller-manager-79946c878f-cqkgw\" (UID: \"455ff2b0-80e7-47c2-b6a3-fcbec945ec09\") " pod="opendatahub/opendatahub-operator-controller-manager-79946c878f-cqkgw"
Jul 02 23:15:05.716609 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:15:05.716583    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/455ff2b0-80e7-47c2-b6a3-fcbec945ec09-tmp\") pod \"opendatahub-operator-controller-manager-79946c878f-cqkgw\" (UID: \"455ff2b0-80e7-47c2-b6a3-fcbec945ec09\") " pod="opendatahub/opendatahub-operator-controller-manager-79946c878f-cqkgw"
Jul 02 23:15:05.716820 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:15:05.716802    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/455ff2b0-80e7-47c2-b6a3-fcbec945ec09-apiservice-cert\") pod \"opendatahub-operator-controller-manager-79946c878f-cqkgw\" (UID: \"455ff2b0-80e7-47c2-b6a3-fcbec945ec09\") " pod="opendatahub/opendatahub-operator-controller-manager-79946c878f-cqkgw"
Jul 02 23:15:05.716917 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:15:05.716895    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/455ff2b0-80e7-47c2-b6a3-fcbec945ec09-webhook-cert\") pod \"opendatahub-operator-controller-manager-79946c878f-cqkgw\" (UID: \"455ff2b0-80e7-47c2-b6a3-fcbec945ec09\") " pod="opendatahub/opendatahub-operator-controller-manager-79946c878f-cqkgw"
Jul 02 23:15:05.742604 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:15:05.742579    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8wlw7\" (UniqueName: \"kubernetes.io/projected/455ff2b0-80e7-47c2-b6a3-fcbec945ec09-kube-api-access-8wlw7\") pod \"opendatahub-operator-controller-manager-79946c878f-cqkgw\" (UID: \"455ff2b0-80e7-47c2-b6a3-fcbec945ec09\") " pod="opendatahub/opendatahub-operator-controller-manager-79946c878f-cqkgw"
Jul 02 23:15:05.748907 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:15:05.748878    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:15:05.799972 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:15:05.799944    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-79946c878f-cqkgw"
Jul 02 23:15:05.838896 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:15:05.838844    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:15:05.936839 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:15:05.936802    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:15:05.938030 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:15:05.938009    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-79946c878f-cqkgw"]
Jul 02 23:15:05.940425 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:15:05.940402    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod455ff2b0_80e7_47c2_b6a3_fcbec945ec09.slice/crio-cba40d791764aeef97ba8b941f6edee1614d647121348647a934599f88a50db5 WatchSource:0}: Error finding container cba40d791764aeef97ba8b941f6edee1614d647121348647a934599f88a50db5: Status 404 returned error can't find the container with id cba40d791764aeef97ba8b941f6edee1614d647121348647a934599f88a50db5
Jul 02 23:15:06.021276 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:15:06.021220    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:15:06.766224 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:15:06.766184    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-79946c878f-cqkgw" event={"ID":"455ff2b0-80e7-47c2-b6a3-fcbec945ec09","Type":"ContainerStarted","Data":"cba40d791764aeef97ba8b941f6edee1614d647121348647a934599f88a50db5"}
Jul 02 23:15:09.778957 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:15:09.778915    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-79946c878f-cqkgw" event={"ID":"455ff2b0-80e7-47c2-b6a3-fcbec945ec09","Type":"ContainerStarted","Data":"a86bba201e497a10831f33440fb128d15e4af1f0285aa1c15b5e88580a67d999"}
Jul 02 23:15:10.783835 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:15:10.783802    2580 generic.go:356] "Generic (PLEG): container finished" podID="455ff2b0-80e7-47c2-b6a3-fcbec945ec09" containerID="a86bba201e497a10831f33440fb128d15e4af1f0285aa1c15b5e88580a67d999" exitCode=0
Jul 02 23:15:10.784232 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:15:10.783894    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-79946c878f-cqkgw" event={"ID":"455ff2b0-80e7-47c2-b6a3-fcbec945ec09","Type":"ContainerDied","Data":"a86bba201e497a10831f33440fb128d15e4af1f0285aa1c15b5e88580a67d999"}
Jul 02 23:15:11.789763 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:15:11.789732    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-79946c878f-cqkgw" event={"ID":"455ff2b0-80e7-47c2-b6a3-fcbec945ec09","Type":"ContainerStarted","Data":"8f8b8dfd2a1a268f11a2c85e4d0836dc83ef6fe2234bca784e61a73b49792920"}
Jul 02 23:15:11.790143 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:15:11.789858    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-79946c878f-cqkgw"
Jul 02 23:15:11.818440 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:15:11.818391    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-79946c878f-cqkgw" podStartSLOduration=2.522933625 podStartE2EDuration="6.818376659s" totalImagesPullingTime="3.242552357s" totalInitContainerRuntime="1.052890677s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:15:05 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:15:11.815673794 +0000 UTC m=+297.833104995" watchObservedRunningTime="2026-07-02 23:15:11.818376659 +0000 UTC m=+297.835807936"
Jul 02 23:15:14.347275 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:15:14.347234    2580 kubelet.go:1648] "Image garbage collection succeeded"
Jul 02 23:15:16.578334 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:15:16.578302    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:15:16.678682 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:15:16.678646    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:15:22.796337 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:15:22.796307    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-79946c878f-cqkgw"
Jul 02 23:15:24.608690 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:15:24.608659    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:15:24.742751 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:15:24.742718    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:15:25.249935 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:15:25.249904    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:15:25.439467 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:15:25.439437    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:15:25.548162 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:15:25.548131    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:15:25.638058 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:15:25.638028    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:15:25.737662 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:15:25.737634    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:15:25.840420 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:15:25.840331    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:15:26.445891 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:15:26.445852    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:15:26.629054 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:15:26.629021    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:15:26.698361 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:15:26.698276    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:15:27.665738 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:15:27.665697    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:15:28.065093 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:15:28.065053    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:15:28.195796 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:15:28.195761    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-6898c65679-9rm6g"]
Jul 02 23:15:28.201942 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:15:28.201919    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6898c65679-9rm6g"
Jul 02 23:15:28.206157 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:15:28.206139    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 02 23:15:28.206508 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:15:28.206487    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 02 23:15:28.207362 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:15:28.207342    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 02 23:15:28.207633 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:15:28.207611    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 02 23:15:28.207633 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:15:28.207628    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-txmbk\""
Jul 02 23:15:28.207758 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:15:28.207649    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 02 23:15:28.213877 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:15:28.213851    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:15:28.231466 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:15:28.231445    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6898c65679-9rm6g"]
Jul 02 23:15:28.304313 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:15:28.304273    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/839c18b2-18bd-46cb-aa18-ab71e455522b-metrics-cert\") pod \"lws-controller-manager-6898c65679-9rm6g\" (UID: \"839c18b2-18bd-46cb-aa18-ab71e455522b\") " pod="openshift-lws-operator/lws-controller-manager-6898c65679-9rm6g"
Jul 02 23:15:28.304451 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:15:28.304316    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/839c18b2-18bd-46cb-aa18-ab71e455522b-cert\") pod \"lws-controller-manager-6898c65679-9rm6g\" (UID: \"839c18b2-18bd-46cb-aa18-ab71e455522b\") " pod="openshift-lws-operator/lws-controller-manager-6898c65679-9rm6g"
Jul 02 23:15:28.304451 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:15:28.304398    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/839c18b2-18bd-46cb-aa18-ab71e455522b-manager-config\") pod \"lws-controller-manager-6898c65679-9rm6g\" (UID: \"839c18b2-18bd-46cb-aa18-ab71e455522b\") " pod="openshift-lws-operator/lws-controller-manager-6898c65679-9rm6g"
Jul 02 23:15:28.304451 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:15:28.304429    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mkzqt\" (UniqueName: \"kubernetes.io/projected/839c18b2-18bd-46cb-aa18-ab71e455522b-kube-api-access-mkzqt\") pod \"lws-controller-manager-6898c65679-9rm6g\" (UID: \"839c18b2-18bd-46cb-aa18-ab71e455522b\") " pod="openshift-lws-operator/lws-controller-manager-6898c65679-9rm6g"
Jul 02 23:15:28.405582 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:15:28.405512    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/839c18b2-18bd-46cb-aa18-ab71e455522b-manager-config\") pod \"lws-controller-manager-6898c65679-9rm6g\" (UID: \"839c18b2-18bd-46cb-aa18-ab71e455522b\") " pod="openshift-lws-operator/lws-controller-manager-6898c65679-9rm6g"
Jul 02 23:15:28.405582 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:15:28.405550    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mkzqt\" (UniqueName: \"kubernetes.io/projected/839c18b2-18bd-46cb-aa18-ab71e455522b-kube-api-access-mkzqt\") pod \"lws-controller-manager-6898c65679-9rm6g\" (UID: \"839c18b2-18bd-46cb-aa18-ab71e455522b\") " pod="openshift-lws-operator/lws-controller-manager-6898c65679-9rm6g"
Jul 02 23:15:28.405737 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:15:28.405600    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/839c18b2-18bd-46cb-aa18-ab71e455522b-metrics-cert\") pod \"lws-controller-manager-6898c65679-9rm6g\" (UID: \"839c18b2-18bd-46cb-aa18-ab71e455522b\") " pod="openshift-lws-operator/lws-controller-manager-6898c65679-9rm6g"
Jul 02 23:15:28.405737 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:15:28.405616    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/839c18b2-18bd-46cb-aa18-ab71e455522b-cert\") pod \"lws-controller-manager-6898c65679-9rm6g\" (UID: \"839c18b2-18bd-46cb-aa18-ab71e455522b\") " pod="openshift-lws-operator/lws-controller-manager-6898c65679-9rm6g"
Jul 02 23:15:28.406151 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:15:28.406128    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/839c18b2-18bd-46cb-aa18-ab71e455522b-manager-config\") pod \"lws-controller-manager-6898c65679-9rm6g\" (UID: \"839c18b2-18bd-46cb-aa18-ab71e455522b\") " pod="openshift-lws-operator/lws-controller-manager-6898c65679-9rm6g"
Jul 02 23:15:28.408012 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:15:28.407990    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/839c18b2-18bd-46cb-aa18-ab71e455522b-cert\") pod \"lws-controller-manager-6898c65679-9rm6g\" (UID: \"839c18b2-18bd-46cb-aa18-ab71e455522b\") " pod="openshift-lws-operator/lws-controller-manager-6898c65679-9rm6g"
Jul 02 23:15:28.408098 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:15:28.408062    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/839c18b2-18bd-46cb-aa18-ab71e455522b-metrics-cert\") pod \"lws-controller-manager-6898c65679-9rm6g\" (UID: \"839c18b2-18bd-46cb-aa18-ab71e455522b\") " pod="openshift-lws-operator/lws-controller-manager-6898c65679-9rm6g"
Jul 02 23:15:28.414706 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:15:28.414688    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mkzqt\" (UniqueName: \"kubernetes.io/projected/839c18b2-18bd-46cb-aa18-ab71e455522b-kube-api-access-mkzqt\") pod \"lws-controller-manager-6898c65679-9rm6g\" (UID: \"839c18b2-18bd-46cb-aa18-ab71e455522b\") " pod="openshift-lws-operator/lws-controller-manager-6898c65679-9rm6g"
Jul 02 23:15:28.511815 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:15:28.511784    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6898c65679-9rm6g"
Jul 02 23:15:28.639334 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:15:28.639309    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6898c65679-9rm6g"]
Jul 02 23:15:28.641465 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:15:28.641438    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod839c18b2_18bd_46cb_aa18_ab71e455522b.slice/crio-d6f93b31ab0ee698369353bec4c657368ab4e36e66d5498d43f4b27b6de176a7 WatchSource:0}: Error finding container d6f93b31ab0ee698369353bec4c657368ab4e36e66d5498d43f4b27b6de176a7: Status 404 returned error can't find the container with id d6f93b31ab0ee698369353bec4c657368ab4e36e66d5498d43f4b27b6de176a7
Jul 02 23:15:28.643757 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:15:28.643736    2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 02 23:15:28.856191 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:15:28.856161    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6898c65679-9rm6g" event={"ID":"839c18b2-18bd-46cb-aa18-ab71e455522b","Type":"ContainerStarted","Data":"d6f93b31ab0ee698369353bec4c657368ab4e36e66d5498d43f4b27b6de176a7"}
Jul 02 23:15:32.876075 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:15:32.876041    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6898c65679-9rm6g" event={"ID":"839c18b2-18bd-46cb-aa18-ab71e455522b","Type":"ContainerStarted","Data":"33cec67ea056af445245cd17064cbb0dc65f48950909025c7794f49888f85a3f"}
Jul 02 23:15:32.876459 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:15:32.876140    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-6898c65679-9rm6g"
Jul 02 23:15:32.900820 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:15:32.900774    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-6898c65679-9rm6g" podStartSLOduration=1.612897529 podStartE2EDuration="4.900759951s" totalImagesPullingTime="3.287862422s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:15:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:15:32.898996664 +0000 UTC m=+318.916427861" watchObservedRunningTime="2026-07-02 23:15:32.900759951 +0000 UTC m=+318.918191149"
Jul 02 23:15:34.798664 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:15:34.798629    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-wprlm"]
Jul 02 23:15:34.801780 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:15:34.801763    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-wprlm"
Jul 02 23:15:34.808109 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:15:34.807633    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 02 23:15:34.808109 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:15:34.807845    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 02 23:15:34.808109 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:15:34.808038    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 02 23:15:34.808321 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:15:34.808155    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 02 23:15:34.808321 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:15:34.808164    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-w8gbr\""
Jul 02 23:15:34.808321 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:15:34.808300    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 02 23:15:34.809068 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:15:34.809054    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 02 23:15:34.826039 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:15:34.826012    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-wprlm"]
Jul 02 23:15:34.863839 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:15:34.863813    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/748e06e1-ff7a-4bc8-9e93-4a9e6d3a2f04-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-wprlm\" (UID: \"748e06e1-ff7a-4bc8-9e93-4a9e6d3a2f04\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-wprlm"
Jul 02 23:15:34.863968 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:15:34.863844    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/748e06e1-ff7a-4bc8-9e93-4a9e6d3a2f04-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-wprlm\" (UID: \"748e06e1-ff7a-4bc8-9e93-4a9e6d3a2f04\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-wprlm"
Jul 02 23:15:34.863968 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:15:34.863866    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/748e06e1-ff7a-4bc8-9e93-4a9e6d3a2f04-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-wprlm\" (UID: \"748e06e1-ff7a-4bc8-9e93-4a9e6d3a2f04\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-wprlm"
Jul 02 23:15:34.864043 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:15:34.863973    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/748e06e1-ff7a-4bc8-9e93-4a9e6d3a2f04-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-wprlm\" (UID: \"748e06e1-ff7a-4bc8-9e93-4a9e6d3a2f04\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-wprlm"
Jul 02 23:15:34.864043 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:15:34.864017    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/748e06e1-ff7a-4bc8-9e93-4a9e6d3a2f04-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-wprlm\" (UID: \"748e06e1-ff7a-4bc8-9e93-4a9e6d3a2f04\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-wprlm"
Jul 02 23:15:34.864105 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:15:34.864048    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/748e06e1-ff7a-4bc8-9e93-4a9e6d3a2f04-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-wprlm\" (UID: \"748e06e1-ff7a-4bc8-9e93-4a9e6d3a2f04\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-wprlm"
Jul 02 23:15:34.864105 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:15:34.864077    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tf4k2\" (UniqueName: \"kubernetes.io/projected/748e06e1-ff7a-4bc8-9e93-4a9e6d3a2f04-kube-api-access-tf4k2\") pod \"istiod-openshift-gateway-94bb8fbfd-wprlm\" (UID: \"748e06e1-ff7a-4bc8-9e93-4a9e6d3a2f04\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-wprlm"
Jul 02 23:15:34.964743 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:15:34.964708    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/748e06e1-ff7a-4bc8-9e93-4a9e6d3a2f04-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-wprlm\" (UID: \"748e06e1-ff7a-4bc8-9e93-4a9e6d3a2f04\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-wprlm"
Jul 02 23:15:34.964912 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:15:34.964757    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/748e06e1-ff7a-4bc8-9e93-4a9e6d3a2f04-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-wprlm\" (UID: \"748e06e1-ff7a-4bc8-9e93-4a9e6d3a2f04\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-wprlm"
Jul 02 23:15:34.964912 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:15:34.964781    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/748e06e1-ff7a-4bc8-9e93-4a9e6d3a2f04-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-wprlm\" (UID: \"748e06e1-ff7a-4bc8-9e93-4a9e6d3a2f04\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-wprlm"
Jul 02 23:15:34.964912 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:15:34.964813    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tf4k2\" (UniqueName: \"kubernetes.io/projected/748e06e1-ff7a-4bc8-9e93-4a9e6d3a2f04-kube-api-access-tf4k2\") pod \"istiod-openshift-gateway-94bb8fbfd-wprlm\" (UID: \"748e06e1-ff7a-4bc8-9e93-4a9e6d3a2f04\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-wprlm"
Jul 02 23:15:34.964912 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:15:34.964857    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/748e06e1-ff7a-4bc8-9e93-4a9e6d3a2f04-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-wprlm\" (UID: \"748e06e1-ff7a-4bc8-9e93-4a9e6d3a2f04\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-wprlm"
Jul 02 23:15:34.964912 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:15:34.964885    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/748e06e1-ff7a-4bc8-9e93-4a9e6d3a2f04-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-wprlm\" (UID: \"748e06e1-ff7a-4bc8-9e93-4a9e6d3a2f04\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-wprlm"
Jul 02 23:15:34.964912 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:15:34.964911    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/748e06e1-ff7a-4bc8-9e93-4a9e6d3a2f04-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-wprlm\" (UID: \"748e06e1-ff7a-4bc8-9e93-4a9e6d3a2f04\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-wprlm"
Jul 02 23:15:34.965520 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:15:34.965494    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/748e06e1-ff7a-4bc8-9e93-4a9e6d3a2f04-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-wprlm\" (UID: \"748e06e1-ff7a-4bc8-9e93-4a9e6d3a2f04\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-wprlm"
Jul 02 23:15:34.967115 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:15:34.967095    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/748e06e1-ff7a-4bc8-9e93-4a9e6d3a2f04-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-wprlm\" (UID: \"748e06e1-ff7a-4bc8-9e93-4a9e6d3a2f04\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-wprlm"
Jul 02 23:15:34.967292 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:15:34.967268    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/748e06e1-ff7a-4bc8-9e93-4a9e6d3a2f04-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-wprlm\" (UID: \"748e06e1-ff7a-4bc8-9e93-4a9e6d3a2f04\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-wprlm"
Jul 02 23:15:34.967466 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:15:34.967450    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/748e06e1-ff7a-4bc8-9e93-4a9e6d3a2f04-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-wprlm\" (UID: \"748e06e1-ff7a-4bc8-9e93-4a9e6d3a2f04\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-wprlm"
Jul 02 23:15:34.967525 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:15:34.967476    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/748e06e1-ff7a-4bc8-9e93-4a9e6d3a2f04-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-wprlm\" (UID: \"748e06e1-ff7a-4bc8-9e93-4a9e6d3a2f04\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-wprlm"
Jul 02 23:15:34.985262 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:15:34.985229    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/748e06e1-ff7a-4bc8-9e93-4a9e6d3a2f04-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-wprlm\" (UID: \"748e06e1-ff7a-4bc8-9e93-4a9e6d3a2f04\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-wprlm"
Jul 02 23:15:34.996795 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:15:34.996768    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tf4k2\" (UniqueName: \"kubernetes.io/projected/748e06e1-ff7a-4bc8-9e93-4a9e6d3a2f04-kube-api-access-tf4k2\") pod \"istiod-openshift-gateway-94bb8fbfd-wprlm\" (UID: \"748e06e1-ff7a-4bc8-9e93-4a9e6d3a2f04\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-wprlm"
Jul 02 23:15:35.110916 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:15:35.110837    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-wprlm"
Jul 02 23:15:35.215053 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:15:35.215007    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:15:35.353796 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:15:35.353750    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod748e06e1_ff7a_4bc8_9e93_4a9e6d3a2f04.slice/crio-c887a8a0e402ec4def3153369c734b73922efcac60b182ccb2427b120fcaa94a WatchSource:0}: Error finding container c887a8a0e402ec4def3153369c734b73922efcac60b182ccb2427b120fcaa94a: Status 404 returned error can't find the container with id c887a8a0e402ec4def3153369c734b73922efcac60b182ccb2427b120fcaa94a
Jul 02 23:15:35.354472 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:15:35.354447    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-wprlm"]
Jul 02 23:15:35.487318 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:15:35.487209    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:15:35.890502 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:15:35.890470    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-wprlm" event={"ID":"748e06e1-ff7a-4bc8-9e93-4a9e6d3a2f04","Type":"ContainerStarted","Data":"c887a8a0e402ec4def3153369c734b73922efcac60b182ccb2427b120fcaa94a"}
Jul 02 23:15:36.009411 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:15:36.009377    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:15:36.244017 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:15:36.243926    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:15:36.429122 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:15:36.429020    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:15:38.188468 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:15:38.188433    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 02 23:15:38.188730 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:15:38.188498    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 02 23:15:38.710227 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:15:38.710198    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:15:38.910391 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:15:38.910349    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-wprlm" event={"ID":"748e06e1-ff7a-4bc8-9e93-4a9e6d3a2f04","Type":"ContainerStarted","Data":"81c7b65f4cc6317743e99cd8b2f38afcdfb78927f4faf5e3764670da0d82e5b0"}
Jul 02 23:15:38.910569 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:15:38.910444    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-wprlm"
Jul 02 23:15:39.004446 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:15:39.004366    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:15:39.075147 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:15:39.075093    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-wprlm" podStartSLOduration=2.242832372 podStartE2EDuration="5.075077476s" totalImagesPullingTime="2.832245104s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:15:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:15:39.074708162 +0000 UTC m=+325.092139357" watchObservedRunningTime="2026-07-02 23:15:39.075077476 +0000 UTC m=+325.092508675"
Jul 02 23:15:39.218459 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:15:39.218410    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:15:39.343012 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:15:39.342983    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:15:39.512391 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:15:39.512357    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:15:39.652119 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:15:39.652028    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:15:39.917153 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:15:39.917072    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-wprlm"
Jul 02 23:15:39.917827 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:15:39.917798    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:15:43.882883 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:15:43.882852    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-6898c65679-9rm6g"
Jul 02 23:16:26.041422 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:16:26.041381    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:16:26.128870 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:16:26.128823    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:16:26.229867 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:16:26.229835    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:16:26.961585 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:16:26.961516    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:16:27.162304 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:16:27.162273    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:16:55.844705 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:16:55.844662    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:16:57.252943 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:16:57.252907    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:16:57.312893 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:16:57.312864    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:16:59.236002 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:16:59.235967    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:16:59.979061 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:16:59.979024    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:17:00.947563 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:17:00.947509    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:17:03.678184 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:17:03.678146    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:17:03.837552 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:17:03.837522    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:17:04.834373 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:17:04.834331    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:17:05.868953 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:17:05.868918    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:17:06.390603 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:17:06.390576    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:17:06.913299 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:17:06.913263    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:17:08.967408 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:17:08.967378    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:17:11.749796 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:17:11.749757    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:17:11.853693 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:17:11.853657    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:17:11.957725 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:17:11.957690    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:17:17.223429 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:17:17.223392    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:17:17.323904 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:17:17.323861    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:17:17.611709 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:17:17.611676    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:17:17.745307 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:17:17.745272    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:17:18.169539 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:17:18.169500    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:17:18.583658 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:17:18.583625    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:17:21.054257 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:17:21.054207    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:17:21.154097 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:17:21.154039    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:17:23.664856 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:17:23.664817    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:17:23.765276 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:17:23.765226    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:17:30.446935 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:17:30.446903    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8jf94"]
Jul 02 23:17:30.449780 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:17:30.449766    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8jf94"
Jul 02 23:17:30.453589 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:17:30.453568    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 02 23:17:30.453731 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:17:30.453712    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 02 23:17:30.453783 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:17:30.453746    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-tspvk\""
Jul 02 23:17:30.476755 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:17:30.476732    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8jf94"]
Jul 02 23:17:30.622806 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:17:30.622771    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dcpgz\" (UniqueName: \"kubernetes.io/projected/f65b5ecf-deb6-4e34-b4bb-dcccd29320bd-kube-api-access-dcpgz\") pod \"kuadrant-operator-controller-manager-86878c769f-8jf94\" (UID: \"f65b5ecf-deb6-4e34-b4bb-dcccd29320bd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8jf94"
Jul 02 23:17:30.622969 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:17:30.622949    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f65b5ecf-deb6-4e34-b4bb-dcccd29320bd-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-8jf94\" (UID: \"f65b5ecf-deb6-4e34-b4bb-dcccd29320bd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8jf94"
Jul 02 23:17:30.724002 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:17:30.723916    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f65b5ecf-deb6-4e34-b4bb-dcccd29320bd-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-8jf94\" (UID: \"f65b5ecf-deb6-4e34-b4bb-dcccd29320bd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8jf94"
Jul 02 23:17:30.724002 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:17:30.723961    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dcpgz\" (UniqueName: \"kubernetes.io/projected/f65b5ecf-deb6-4e34-b4bb-dcccd29320bd-kube-api-access-dcpgz\") pod \"kuadrant-operator-controller-manager-86878c769f-8jf94\" (UID: \"f65b5ecf-deb6-4e34-b4bb-dcccd29320bd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8jf94"
Jul 02 23:17:30.724303 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:17:30.724284    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f65b5ecf-deb6-4e34-b4bb-dcccd29320bd-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-8jf94\" (UID: \"f65b5ecf-deb6-4e34-b4bb-dcccd29320bd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8jf94"
Jul 02 23:17:30.739436 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:17:30.739405    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dcpgz\" (UniqueName: \"kubernetes.io/projected/f65b5ecf-deb6-4e34-b4bb-dcccd29320bd-kube-api-access-dcpgz\") pod \"kuadrant-operator-controller-manager-86878c769f-8jf94\" (UID: \"f65b5ecf-deb6-4e34-b4bb-dcccd29320bd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8jf94"
Jul 02 23:17:30.759097 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:17:30.759071    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8jf94"
Jul 02 23:17:30.882018 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:17:30.881983    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:17:30.908130 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:17:30.908102    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf65b5ecf_deb6_4e34_b4bb_dcccd29320bd.slice/crio-b9386026cd251a9fbd2eb88caaa0d765711db0fb7491184224db98ad18d24e8d WatchSource:0}: Error finding container b9386026cd251a9fbd2eb88caaa0d765711db0fb7491184224db98ad18d24e8d: Status 404 returned error can't find the container with id b9386026cd251a9fbd2eb88caaa0d765711db0fb7491184224db98ad18d24e8d
Jul 02 23:17:30.909827 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:17:30.909801    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8jf94"]
Jul 02 23:17:31.058002 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:17:31.057963    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:17:31.378687 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:17:31.378607    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8jf94" event={"ID":"f65b5ecf-deb6-4e34-b4bb-dcccd29320bd","Type":"ContainerStarted","Data":"b9386026cd251a9fbd2eb88caaa0d765711db0fb7491184224db98ad18d24e8d"}
Jul 02 23:17:35.398825 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:17:35.398788    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8jf94" event={"ID":"f65b5ecf-deb6-4e34-b4bb-dcccd29320bd","Type":"ContainerStarted","Data":"e59678318fd83e0bd8939795ebc8e3842181b11eea1bf93f6fb3f0f9f6c0407a"}
Jul 02 23:17:35.399275 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:17:35.398901    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8jf94"
Jul 02 23:17:35.426778 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:17:35.426728    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8jf94" podStartSLOduration=1.8747756930000001 podStartE2EDuration="5.426711506s" totalImagesPullingTime="3.551935813s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:17:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:17:35.425418576 +0000 UTC m=+441.442849774" watchObservedRunningTime="2026-07-02 23:17:35.426711506 +0000 UTC m=+441.444142703"
Jul 02 23:17:36.059340 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:17:36.059288    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:17:36.183850 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:17:36.183764    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:17:36.479884 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:17:36.479789    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:17:36.611258 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:17:36.611211    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:17:40.239739 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:17:40.239703    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:17:40.339854 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:17:40.339815    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:17:42.649422 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:17:42.649383    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:17:42.758138 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:17:42.758104    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:17:46.405728 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:17:46.405698    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8jf94"
Jul 02 23:17:59.206446 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:17:59.206413    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:17:59.306121 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:17:59.306084    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:18:03.027916 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:18:03.027871    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:18:03.218683 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:18:03.218647    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:18:04.872874 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:18:04.872830    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:18:05.013891 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:18:05.013853    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:18:05.107863 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:18:05.107822    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:18:05.872033 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:18:05.871978    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:18:05.969727 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:18:05.969696    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:18:13.075633 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:18:13.075601    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:18:13.136459 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:18:13.136432    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:18:26.402531 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:18:26.402493    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:18:38.251771 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:18:38.251738    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:18:38.351625 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:18:38.351595    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:18:44.706761 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:18:44.706709    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:18:44.832282 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:18:44.832229    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:18:44.895773 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:18:44.895745    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:18:48.308316 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:18:48.308278    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:18:48.400436 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:18:48.400408    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:19:20.930100 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:19:20.930069    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:19:21.334850 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:19:21.334819    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:19:21.398315 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:19:21.398279    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-6dcf8bb5cc-gm42x"]
Jul 02 23:19:21.401202 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:19:21.401187    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-6dcf8bb5cc-gm42x"
Jul 02 23:19:21.405412 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:19:21.405394    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\""
Jul 02 23:19:21.405507 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:19:21.405454    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-nmtfb\""
Jul 02 23:19:21.412223 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:19:21.412198    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-6dcf8bb5cc-gm42x"]
Jul 02 23:19:21.469236 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:19:21.469202    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/725f8bfd-92e5-4a8e-b7bd-03cd44b0ae15-openshift-service-ca\") pod \"maas-api-6dcf8bb5cc-gm42x\" (UID: \"725f8bfd-92e5-4a8e-b7bd-03cd44b0ae15\") " pod="opendatahub/maas-api-6dcf8bb5cc-gm42x"
Jul 02 23:19:21.469409 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:19:21.469262    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/725f8bfd-92e5-4a8e-b7bd-03cd44b0ae15-maas-api-tls\") pod \"maas-api-6dcf8bb5cc-gm42x\" (UID: \"725f8bfd-92e5-4a8e-b7bd-03cd44b0ae15\") " pod="opendatahub/maas-api-6dcf8bb5cc-gm42x"
Jul 02 23:19:21.469409 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:19:21.469325    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rln57\" (UniqueName: \"kubernetes.io/projected/725f8bfd-92e5-4a8e-b7bd-03cd44b0ae15-kube-api-access-rln57\") pod \"maas-api-6dcf8bb5cc-gm42x\" (UID: \"725f8bfd-92e5-4a8e-b7bd-03cd44b0ae15\") " pod="opendatahub/maas-api-6dcf8bb5cc-gm42x"
Jul 02 23:19:21.570173 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:19:21.570136    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/725f8bfd-92e5-4a8e-b7bd-03cd44b0ae15-openshift-service-ca\") pod \"maas-api-6dcf8bb5cc-gm42x\" (UID: \"725f8bfd-92e5-4a8e-b7bd-03cd44b0ae15\") " pod="opendatahub/maas-api-6dcf8bb5cc-gm42x"
Jul 02 23:19:21.570173 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:19:21.570177    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/725f8bfd-92e5-4a8e-b7bd-03cd44b0ae15-maas-api-tls\") pod \"maas-api-6dcf8bb5cc-gm42x\" (UID: \"725f8bfd-92e5-4a8e-b7bd-03cd44b0ae15\") " pod="opendatahub/maas-api-6dcf8bb5cc-gm42x"
Jul 02 23:19:21.570391 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:19:21.570216    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rln57\" (UniqueName: \"kubernetes.io/projected/725f8bfd-92e5-4a8e-b7bd-03cd44b0ae15-kube-api-access-rln57\") pod \"maas-api-6dcf8bb5cc-gm42x\" (UID: \"725f8bfd-92e5-4a8e-b7bd-03cd44b0ae15\") " pod="opendatahub/maas-api-6dcf8bb5cc-gm42x"
Jul 02 23:19:21.570391 ip-10-0-135-187 kubenswrapper[2580]: E0702 23:19:21.570329    2580 secret.go:189] Couldn't get secret opendatahub/maas-api-serving-cert: secret "maas-api-serving-cert" not found
Jul 02 23:19:21.570468 ip-10-0-135-187 kubenswrapper[2580]: E0702 23:19:21.570401    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/725f8bfd-92e5-4a8e-b7bd-03cd44b0ae15-maas-api-tls podName:725f8bfd-92e5-4a8e-b7bd-03cd44b0ae15 nodeName:}" failed. No retries permitted until 2026-07-02 23:19:22.070382941 +0000 UTC m=+548.087814131 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/725f8bfd-92e5-4a8e-b7bd-03cd44b0ae15-maas-api-tls") pod "maas-api-6dcf8bb5cc-gm42x" (UID: "725f8bfd-92e5-4a8e-b7bd-03cd44b0ae15") : secret "maas-api-serving-cert" not found
Jul 02 23:19:21.570935 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:19:21.570912    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/725f8bfd-92e5-4a8e-b7bd-03cd44b0ae15-openshift-service-ca\") pod \"maas-api-6dcf8bb5cc-gm42x\" (UID: \"725f8bfd-92e5-4a8e-b7bd-03cd44b0ae15\") " pod="opendatahub/maas-api-6dcf8bb5cc-gm42x"
Jul 02 23:19:21.579833 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:19:21.579806    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rln57\" (UniqueName: \"kubernetes.io/projected/725f8bfd-92e5-4a8e-b7bd-03cd44b0ae15-kube-api-access-rln57\") pod \"maas-api-6dcf8bb5cc-gm42x\" (UID: \"725f8bfd-92e5-4a8e-b7bd-03cd44b0ae15\") " pod="opendatahub/maas-api-6dcf8bb5cc-gm42x"
Jul 02 23:19:21.770672 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:19:21.770581    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:19:21.867923 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:19:21.867889    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:19:21.961563 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:19:21.961525    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:19:22.074260 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:19:22.074214    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/725f8bfd-92e5-4a8e-b7bd-03cd44b0ae15-maas-api-tls\") pod \"maas-api-6dcf8bb5cc-gm42x\" (UID: \"725f8bfd-92e5-4a8e-b7bd-03cd44b0ae15\") " pod="opendatahub/maas-api-6dcf8bb5cc-gm42x"
Jul 02 23:19:22.076694 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:19:22.076662    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/725f8bfd-92e5-4a8e-b7bd-03cd44b0ae15-maas-api-tls\") pod \"maas-api-6dcf8bb5cc-gm42x\" (UID: \"725f8bfd-92e5-4a8e-b7bd-03cd44b0ae15\") " pod="opendatahub/maas-api-6dcf8bb5cc-gm42x"
Jul 02 23:19:22.312330 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:19:22.312298    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-6dcf8bb5cc-gm42x"
Jul 02 23:19:22.440945 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:19:22.440924    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-6dcf8bb5cc-gm42x"]
Jul 02 23:19:22.443032 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:19:22.443006    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod725f8bfd_92e5_4a8e_b7bd_03cd44b0ae15.slice/crio-6e2333033d0bd25cef708181e3cc37f6a78b30667c33d55442a5ca1cee9a9249 WatchSource:0}: Error finding container 6e2333033d0bd25cef708181e3cc37f6a78b30667c33d55442a5ca1cee9a9249: Status 404 returned error can't find the container with id 6e2333033d0bd25cef708181e3cc37f6a78b30667c33d55442a5ca1cee9a9249
Jul 02 23:19:22.852074 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:19:22.852037    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-6dcf8bb5cc-gm42x" event={"ID":"725f8bfd-92e5-4a8e-b7bd-03cd44b0ae15","Type":"ContainerStarted","Data":"6e2333033d0bd25cef708181e3cc37f6a78b30667c33d55442a5ca1cee9a9249"}
Jul 02 23:19:24.862702 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:19:24.862669    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-6dcf8bb5cc-gm42x" event={"ID":"725f8bfd-92e5-4a8e-b7bd-03cd44b0ae15","Type":"ContainerStarted","Data":"48fa47c7dbce1245015103f46e830936c3bfabe64f77bd8d4a7cc9032efb07a0"}
Jul 02 23:19:24.863098 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:19:24.862803    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-6dcf8bb5cc-gm42x"
Jul 02 23:19:24.881040 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:19:24.880988    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-6dcf8bb5cc-gm42x" podStartSLOduration=1.585884467 podStartE2EDuration="3.88097298s" totalImagesPullingTime="2.295088513s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:19:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:19:24.879210034 +0000 UTC m=+550.896641233" watchObservedRunningTime="2026-07-02 23:19:24.88097298 +0000 UTC m=+550.898404177"
Jul 02 23:19:30.872901 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:19:30.872868    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-6dcf8bb5cc-gm42x"
Jul 02 23:19:31.852667 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:19:31.852629    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:19:31.952489 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:19:31.952454    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:19:38.943559 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:19:38.943525    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:19:49.184359 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:19:49.184327    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-cw58k"]
Jul 02 23:19:49.188166 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:19:49.188145    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cw58k"
Jul 02 23:19:49.192862 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:19:49.192842    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 02 23:19:49.192979 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:19:49.192842    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-djwms\""
Jul 02 23:19:49.192979 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:19:49.192843    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Jul 02 23:19:49.192979 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:19:49.192873    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 02 23:19:49.200307 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:19:49.200285    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-cw58k"]
Jul 02 23:19:49.216696 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:19:49.216662    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:19:49.319932 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:19:49.319904    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pdn2h\" (UniqueName: \"kubernetes.io/projected/08d4216e-1854-4c7a-8589-cbdd627f774f-kube-api-access-pdn2h\") pod \"e2e-distinct-simulated-kserve-59975d69f9-cw58k\" (UID: \"08d4216e-1854-4c7a-8589-cbdd627f774f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cw58k"
Jul 02 23:19:49.320058 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:19:49.319938    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/08d4216e-1854-4c7a-8589-cbdd627f774f-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-cw58k\" (UID: \"08d4216e-1854-4c7a-8589-cbdd627f774f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cw58k"
Jul 02 23:19:49.320058 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:19:49.319958    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/08d4216e-1854-4c7a-8589-cbdd627f774f-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-cw58k\" (UID: \"08d4216e-1854-4c7a-8589-cbdd627f774f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cw58k"
Jul 02 23:19:49.320171 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:19:49.320031    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/08d4216e-1854-4c7a-8589-cbdd627f774f-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-cw58k\" (UID: \"08d4216e-1854-4c7a-8589-cbdd627f774f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cw58k"
Jul 02 23:19:49.320171 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:19:49.320089    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/08d4216e-1854-4c7a-8589-cbdd627f774f-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-cw58k\" (UID: \"08d4216e-1854-4c7a-8589-cbdd627f774f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cw58k"
Jul 02 23:19:49.320171 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:19:49.320127    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/08d4216e-1854-4c7a-8589-cbdd627f774f-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-cw58k\" (UID: \"08d4216e-1854-4c7a-8589-cbdd627f774f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cw58k"
Jul 02 23:19:49.421182 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:19:49.421154    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pdn2h\" (UniqueName: \"kubernetes.io/projected/08d4216e-1854-4c7a-8589-cbdd627f774f-kube-api-access-pdn2h\") pod \"e2e-distinct-simulated-kserve-59975d69f9-cw58k\" (UID: \"08d4216e-1854-4c7a-8589-cbdd627f774f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cw58k"
Jul 02 23:19:49.421312 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:19:49.421191    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/08d4216e-1854-4c7a-8589-cbdd627f774f-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-cw58k\" (UID: \"08d4216e-1854-4c7a-8589-cbdd627f774f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cw58k"
Jul 02 23:19:49.421312 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:19:49.421216    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/08d4216e-1854-4c7a-8589-cbdd627f774f-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-cw58k\" (UID: \"08d4216e-1854-4c7a-8589-cbdd627f774f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cw58k"
Jul 02 23:19:49.421312 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:19:49.421272    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/08d4216e-1854-4c7a-8589-cbdd627f774f-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-cw58k\" (UID: \"08d4216e-1854-4c7a-8589-cbdd627f774f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cw58k"
Jul 02 23:19:49.421312 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:19:49.421307    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/08d4216e-1854-4c7a-8589-cbdd627f774f-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-cw58k\" (UID: \"08d4216e-1854-4c7a-8589-cbdd627f774f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cw58k"
Jul 02 23:19:49.421505 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:19:49.421333    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/08d4216e-1854-4c7a-8589-cbdd627f774f-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-cw58k\" (UID: \"08d4216e-1854-4c7a-8589-cbdd627f774f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cw58k"
Jul 02 23:19:49.421590 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:19:49.421569    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/08d4216e-1854-4c7a-8589-cbdd627f774f-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-cw58k\" (UID: \"08d4216e-1854-4c7a-8589-cbdd627f774f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cw58k"
Jul 02 23:19:49.421649 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:19:49.421633    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/08d4216e-1854-4c7a-8589-cbdd627f774f-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-cw58k\" (UID: \"08d4216e-1854-4c7a-8589-cbdd627f774f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cw58k"
Jul 02 23:19:49.421729 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:19:49.421711    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/08d4216e-1854-4c7a-8589-cbdd627f774f-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-cw58k\" (UID: \"08d4216e-1854-4c7a-8589-cbdd627f774f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cw58k"
Jul 02 23:19:49.423448 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:19:49.423428    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/08d4216e-1854-4c7a-8589-cbdd627f774f-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-cw58k\" (UID: \"08d4216e-1854-4c7a-8589-cbdd627f774f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cw58k"
Jul 02 23:19:49.423753 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:19:49.423736    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/08d4216e-1854-4c7a-8589-cbdd627f774f-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-cw58k\" (UID: \"08d4216e-1854-4c7a-8589-cbdd627f774f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cw58k"
Jul 02 23:19:49.429897 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:19:49.429870    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pdn2h\" (UniqueName: \"kubernetes.io/projected/08d4216e-1854-4c7a-8589-cbdd627f774f-kube-api-access-pdn2h\") pod \"e2e-distinct-simulated-kserve-59975d69f9-cw58k\" (UID: \"08d4216e-1854-4c7a-8589-cbdd627f774f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cw58k"
Jul 02 23:19:49.499088 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:19:49.499016    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cw58k"
Jul 02 23:19:49.626542 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:19:49.626510    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-cw58k"]
Jul 02 23:19:49.627926 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:19:49.627898    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod08d4216e_1854_4c7a_8589_cbdd627f774f.slice/crio-f0d5272c8253dd341cba96a32eebeb7aeb3698e5f5f6bae6f341c580aab4ae6a WatchSource:0}: Error finding container f0d5272c8253dd341cba96a32eebeb7aeb3698e5f5f6bae6f341c580aab4ae6a: Status 404 returned error can't find the container with id f0d5272c8253dd341cba96a32eebeb7aeb3698e5f5f6bae6f341c580aab4ae6a
Jul 02 23:19:49.978127 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:19:49.978093    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cw58k" event={"ID":"08d4216e-1854-4c7a-8589-cbdd627f774f","Type":"ContainerStarted","Data":"f0d5272c8253dd341cba96a32eebeb7aeb3698e5f5f6bae6f341c580aab4ae6a"}
Jul 02 23:19:50.983427 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:19:50.983351    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cw58k" event={"ID":"08d4216e-1854-4c7a-8589-cbdd627f774f","Type":"ContainerStarted","Data":"c14e9339a0914cd6f811c6c7a62660652be461e08642e1e2a05e2e03f8e2610a"}
Jul 02 23:19:51.003289 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:19:51.003232    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cw58k" podStartSLOduration=1.004624981 podStartE2EDuration="2.003217089s" totalImagesPullingTime="998.592108ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:19:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:19:51.001889274 +0000 UTC m=+577.019320473" watchObservedRunningTime="2026-07-02 23:19:51.003217089 +0000 UTC m=+577.020648287"
Jul 02 23:19:59.499381 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:19:59.499351    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cw58k"
Jul 02 23:19:59.499844 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:19:59.499403    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cw58k"
Jul 02 23:19:59.511568 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:19:59.511546    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cw58k"
Jul 02 23:20:00.031471 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:20:00.031443    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cw58k"
Jul 02 23:20:08.806139 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:20:08.806100    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:20:08.906562 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:20:08.906527    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:20:09.513185 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:20:09.513142    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:20:11.728357 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:20:11.728315    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:20:19.186048 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:20:19.186014    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbj8q9v"]
Jul 02 23:20:19.189375 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:20:19.189354    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbj8q9v"
Jul 02 23:20:19.192757 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:20:19.192737    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Jul 02 23:20:19.200086 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:20:19.200062    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbj8q9v"]
Jul 02 23:20:19.213320 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:20:19.213288    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:20:19.267765 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:20:19.267736    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a5c19a22-1643-471d-8e84-1c25b434e6b4-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbj8q9v\" (UID: \"a5c19a22-1643-471d-8e84-1c25b434e6b4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbj8q9v"
Jul 02 23:20:19.267908 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:20:19.267796    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a5c19a22-1643-471d-8e84-1c25b434e6b4-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbj8q9v\" (UID: \"a5c19a22-1643-471d-8e84-1c25b434e6b4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbj8q9v"
Jul 02 23:20:19.267908 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:20:19.267813    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a5c19a22-1643-471d-8e84-1c25b434e6b4-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbj8q9v\" (UID: \"a5c19a22-1643-471d-8e84-1c25b434e6b4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbj8q9v"
Jul 02 23:20:19.267908 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:20:19.267871    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a5c19a22-1643-471d-8e84-1c25b434e6b4-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbj8q9v\" (UID: \"a5c19a22-1643-471d-8e84-1c25b434e6b4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbj8q9v"
Jul 02 23:20:19.268033 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:20:19.267901    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a5c19a22-1643-471d-8e84-1c25b434e6b4-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbj8q9v\" (UID: \"a5c19a22-1643-471d-8e84-1c25b434e6b4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbj8q9v"
Jul 02 23:20:19.268033 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:20:19.267936    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6tr7t\" (UniqueName: \"kubernetes.io/projected/a5c19a22-1643-471d-8e84-1c25b434e6b4-kube-api-access-6tr7t\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbj8q9v\" (UID: \"a5c19a22-1643-471d-8e84-1c25b434e6b4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbj8q9v"
Jul 02 23:20:19.368647 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:20:19.368619    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a5c19a22-1643-471d-8e84-1c25b434e6b4-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbj8q9v\" (UID: \"a5c19a22-1643-471d-8e84-1c25b434e6b4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbj8q9v"
Jul 02 23:20:19.368792 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:20:19.368688    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a5c19a22-1643-471d-8e84-1c25b434e6b4-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbj8q9v\" (UID: \"a5c19a22-1643-471d-8e84-1c25b434e6b4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbj8q9v"
Jul 02 23:20:19.368792 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:20:19.368716    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a5c19a22-1643-471d-8e84-1c25b434e6b4-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbj8q9v\" (UID: \"a5c19a22-1643-471d-8e84-1c25b434e6b4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbj8q9v"
Jul 02 23:20:19.368792 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:20:19.368745    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a5c19a22-1643-471d-8e84-1c25b434e6b4-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbj8q9v\" (UID: \"a5c19a22-1643-471d-8e84-1c25b434e6b4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbj8q9v"
Jul 02 23:20:19.368792 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:20:19.368772    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a5c19a22-1643-471d-8e84-1c25b434e6b4-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbj8q9v\" (UID: \"a5c19a22-1643-471d-8e84-1c25b434e6b4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbj8q9v"
Jul 02 23:20:19.368982 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:20:19.368799    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6tr7t\" (UniqueName: \"kubernetes.io/projected/a5c19a22-1643-471d-8e84-1c25b434e6b4-kube-api-access-6tr7t\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbj8q9v\" (UID: \"a5c19a22-1643-471d-8e84-1c25b434e6b4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbj8q9v"
Jul 02 23:20:19.369102 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:20:19.369081    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a5c19a22-1643-471d-8e84-1c25b434e6b4-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbj8q9v\" (UID: \"a5c19a22-1643-471d-8e84-1c25b434e6b4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbj8q9v"
Jul 02 23:20:19.369174 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:20:19.369096    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a5c19a22-1643-471d-8e84-1c25b434e6b4-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbj8q9v\" (UID: \"a5c19a22-1643-471d-8e84-1c25b434e6b4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbj8q9v"
Jul 02 23:20:19.369174 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:20:19.369133    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a5c19a22-1643-471d-8e84-1c25b434e6b4-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbj8q9v\" (UID: \"a5c19a22-1643-471d-8e84-1c25b434e6b4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbj8q9v"
Jul 02 23:20:19.370997 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:20:19.370973    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a5c19a22-1643-471d-8e84-1c25b434e6b4-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbj8q9v\" (UID: \"a5c19a22-1643-471d-8e84-1c25b434e6b4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbj8q9v"
Jul 02 23:20:19.371264 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:20:19.371231    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a5c19a22-1643-471d-8e84-1c25b434e6b4-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbj8q9v\" (UID: \"a5c19a22-1643-471d-8e84-1c25b434e6b4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbj8q9v"
Jul 02 23:20:19.377044 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:20:19.377019    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6tr7t\" (UniqueName: \"kubernetes.io/projected/a5c19a22-1643-471d-8e84-1c25b434e6b4-kube-api-access-6tr7t\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbj8q9v\" (UID: \"a5c19a22-1643-471d-8e84-1c25b434e6b4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbj8q9v"
Jul 02 23:20:19.500162 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:20:19.500091    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbj8q9v"
Jul 02 23:20:19.630127 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:20:19.630102    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbj8q9v"]
Jul 02 23:20:19.631858 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:20:19.631830    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5c19a22_1643_471d_8e84_1c25b434e6b4.slice/crio-2cdee72649164ec24e7e2b548b3960a9b5d7647f6c192c831ae4a9541c161bc4 WatchSource:0}: Error finding container 2cdee72649164ec24e7e2b548b3960a9b5d7647f6c192c831ae4a9541c161bc4: Status 404 returned error can't find the container with id 2cdee72649164ec24e7e2b548b3960a9b5d7647f6c192c831ae4a9541c161bc4
Jul 02 23:20:20.106648 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:20:20.106564    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbj8q9v" event={"ID":"a5c19a22-1643-471d-8e84-1c25b434e6b4","Type":"ContainerStarted","Data":"0820c1b21d21feae7dd15fc0e0efa1886a3bb62f976053efffc245285da93757"}
Jul 02 23:20:20.106648 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:20:20.106615    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbj8q9v" event={"ID":"a5c19a22-1643-471d-8e84-1c25b434e6b4","Type":"ContainerStarted","Data":"2cdee72649164ec24e7e2b548b3960a9b5d7647f6c192c831ae4a9541c161bc4"}
Jul 02 23:20:20.128349 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:20:20.128305    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbj8q9v" podStartSLOduration=0.950272521 podStartE2EDuration="1.128289618s" totalImagesPullingTime="178.017097ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:20:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:20:20.125827516 +0000 UTC m=+606.143258725" watchObservedRunningTime="2026-07-02 23:20:20.128289618 +0000 UTC m=+606.145720816"
Jul 02 23:20:22.386981 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:20:22.386943    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:20:29.118277 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:20:29.118224    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:20:29.500355 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:20:29.500271    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbj8q9v"
Jul 02 23:20:29.500355 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:20:29.500332    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbj8q9v"
Jul 02 23:20:29.513067 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:20:29.513043    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbj8q9v"
Jul 02 23:20:30.159280 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:20:30.159256    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbj8q9v"
Jul 02 23:20:51.138486 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:20:51.138400    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:20:52.301861 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:20:52.301829    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:21:40.322866 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:21:40.322818    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:21:40.422204 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:21:40.422166    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:21:41.470371 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:21:41.470335    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:21:41.573137 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:21:41.573098    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:21:56.592328 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:21:56.592287    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:22:05.485220 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:22:05.485183    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:22:05.542002 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:22:05.541972    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:23:02.599823 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:23:02.599790    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:23:04.065065 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:23:04.065029    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:23:07.049500 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:23:07.049466    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:23:07.150033 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:23:07.149995    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:23:37.908964 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:23:37.908881    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:23:37.998800 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:23:37.998765    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:23:38.125205 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:23:38.125173    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:23:44.031994 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:23:44.031951    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:23:44.101962 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:23:44.101926    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:23:44.195942 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:23:44.195903    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:23:44.383837 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:23:44.383741    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:23:50.140465 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:23:50.140429    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:23:50.240972 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:23:50.240942    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:25:42.556516 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:25:42.556456    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:25:42.614944 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:25:42.614915    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:27:40.446596 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:27:40.446557    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8jf94"]
Jul 02 23:27:40.447145 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:27:40.446746    2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8jf94" podUID="f65b5ecf-deb6-4e34-b4bb-dcccd29320bd" containerName="manager" containerID="cri-o://e59678318fd83e0bd8939795ebc8e3842181b11eea1bf93f6fb3f0f9f6c0407a" gracePeriod=10
Jul 02 23:27:42.593759 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:27:42.593731    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8jf94"
Jul 02 23:27:42.634568 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:27:42.634539    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dcpgz\" (UniqueName: \"kubernetes.io/projected/f65b5ecf-deb6-4e34-b4bb-dcccd29320bd-kube-api-access-dcpgz\") pod \"f65b5ecf-deb6-4e34-b4bb-dcccd29320bd\" (UID: \"f65b5ecf-deb6-4e34-b4bb-dcccd29320bd\") "
Jul 02 23:27:42.634730 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:27:42.634579    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f65b5ecf-deb6-4e34-b4bb-dcccd29320bd-extensions-socket-volume\") pod \"f65b5ecf-deb6-4e34-b4bb-dcccd29320bd\" (UID: \"f65b5ecf-deb6-4e34-b4bb-dcccd29320bd\") "
Jul 02 23:27:42.634999 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:27:42.634976    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f65b5ecf-deb6-4e34-b4bb-dcccd29320bd-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "f65b5ecf-deb6-4e34-b4bb-dcccd29320bd" (UID: "f65b5ecf-deb6-4e34-b4bb-dcccd29320bd"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 23:27:42.636757 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:27:42.636734    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f65b5ecf-deb6-4e34-b4bb-dcccd29320bd-kube-api-access-dcpgz" (OuterVolumeSpecName: "kube-api-access-dcpgz") pod "f65b5ecf-deb6-4e34-b4bb-dcccd29320bd" (UID: "f65b5ecf-deb6-4e34-b4bb-dcccd29320bd"). InnerVolumeSpecName "kube-api-access-dcpgz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 23:27:42.735884 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:27:42.735804    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dcpgz\" (UniqueName: \"kubernetes.io/projected/f65b5ecf-deb6-4e34-b4bb-dcccd29320bd-kube-api-access-dcpgz\") on node \"ip-10-0-135-187.ec2.internal\" DevicePath \"\""
Jul 02 23:27:42.735884 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:27:42.735832    2580 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f65b5ecf-deb6-4e34-b4bb-dcccd29320bd-extensions-socket-volume\") on node \"ip-10-0-135-187.ec2.internal\" DevicePath \"\""
Jul 02 23:27:43.040435 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:27:43.040405    2580 generic.go:356] "Generic (PLEG): container finished" podID="f65b5ecf-deb6-4e34-b4bb-dcccd29320bd" containerID="e59678318fd83e0bd8939795ebc8e3842181b11eea1bf93f6fb3f0f9f6c0407a" exitCode=0
Jul 02 23:27:43.040593 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:27:43.040442    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8jf94" event={"ID":"f65b5ecf-deb6-4e34-b4bb-dcccd29320bd","Type":"ContainerDied","Data":"e59678318fd83e0bd8939795ebc8e3842181b11eea1bf93f6fb3f0f9f6c0407a"}
Jul 02 23:27:43.040593 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:27:43.040446    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8jf94"
Jul 02 23:27:43.040593 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:27:43.040488    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8jf94" event={"ID":"f65b5ecf-deb6-4e34-b4bb-dcccd29320bd","Type":"ContainerDied","Data":"b9386026cd251a9fbd2eb88caaa0d765711db0fb7491184224db98ad18d24e8d"}
Jul 02 23:27:43.040593 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:27:43.040509    2580 scope.go:117] "RemoveContainer" containerID="e59678318fd83e0bd8939795ebc8e3842181b11eea1bf93f6fb3f0f9f6c0407a"
Jul 02 23:27:43.050855 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:27:43.050832    2580 scope.go:117] "RemoveContainer" containerID="e59678318fd83e0bd8939795ebc8e3842181b11eea1bf93f6fb3f0f9f6c0407a"
Jul 02 23:27:43.051104 ip-10-0-135-187 kubenswrapper[2580]: E0702 23:27:43.051086    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e59678318fd83e0bd8939795ebc8e3842181b11eea1bf93f6fb3f0f9f6c0407a\": container with ID starting with e59678318fd83e0bd8939795ebc8e3842181b11eea1bf93f6fb3f0f9f6c0407a not found: ID does not exist" containerID="e59678318fd83e0bd8939795ebc8e3842181b11eea1bf93f6fb3f0f9f6c0407a"
Jul 02 23:27:43.051151 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:27:43.051114    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e59678318fd83e0bd8939795ebc8e3842181b11eea1bf93f6fb3f0f9f6c0407a"} err="failed to get container status \"e59678318fd83e0bd8939795ebc8e3842181b11eea1bf93f6fb3f0f9f6c0407a\": rpc error: code = NotFound desc = could not find container \"e59678318fd83e0bd8939795ebc8e3842181b11eea1bf93f6fb3f0f9f6c0407a\": container with ID starting with e59678318fd83e0bd8939795ebc8e3842181b11eea1bf93f6fb3f0f9f6c0407a not found: ID does not exist"
Jul 02 23:27:43.062271 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:27:43.062232    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8jf94"]
Jul 02 23:27:43.069360 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:27:43.069339    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8jf94"]
Jul 02 23:27:44.428074 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:27:44.428039    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f65b5ecf-deb6-4e34-b4bb-dcccd29320bd" path="/var/lib/kubelet/pods/f65b5ecf-deb6-4e34-b4bb-dcccd29320bd/volumes"
Jul 02 23:28:41.579452 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:28:41.579417    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nj7bc"]
Jul 02 23:28:41.579949 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:28:41.579922    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f65b5ecf-deb6-4e34-b4bb-dcccd29320bd" containerName="manager"
Jul 02 23:28:41.579949 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:28:41.579942    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="f65b5ecf-deb6-4e34-b4bb-dcccd29320bd" containerName="manager"
Jul 02 23:28:41.580079 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:28:41.580035    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="f65b5ecf-deb6-4e34-b4bb-dcccd29320bd" containerName="manager"
Jul 02 23:28:41.582928 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:28:41.582908    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nj7bc"
Jul 02 23:28:41.585876 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:28:41.585856    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 02 23:28:41.585977 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:28:41.585912    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 02 23:28:41.586047 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:28:41.586017    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-tspvk\""
Jul 02 23:28:41.596285 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:28:41.596263    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nj7bc"]
Jul 02 23:28:41.638759 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:28:41.638734    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c4a5ca63-8c40-4a96-8fa1-4e5a4c81168e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-nj7bc\" (UID: \"c4a5ca63-8c40-4a96-8fa1-4e5a4c81168e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nj7bc"
Jul 02 23:28:41.638865 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:28:41.638766    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gbvgj\" (UniqueName: \"kubernetes.io/projected/c4a5ca63-8c40-4a96-8fa1-4e5a4c81168e-kube-api-access-gbvgj\") pod \"kuadrant-operator-controller-manager-86878c769f-nj7bc\" (UID: \"c4a5ca63-8c40-4a96-8fa1-4e5a4c81168e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nj7bc"
Jul 02 23:28:41.739424 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:28:41.739395    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gbvgj\" (UniqueName: \"kubernetes.io/projected/c4a5ca63-8c40-4a96-8fa1-4e5a4c81168e-kube-api-access-gbvgj\") pod \"kuadrant-operator-controller-manager-86878c769f-nj7bc\" (UID: \"c4a5ca63-8c40-4a96-8fa1-4e5a4c81168e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nj7bc"
Jul 02 23:28:41.739529 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:28:41.739488    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c4a5ca63-8c40-4a96-8fa1-4e5a4c81168e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-nj7bc\" (UID: \"c4a5ca63-8c40-4a96-8fa1-4e5a4c81168e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nj7bc"
Jul 02 23:28:41.739791 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:28:41.739774    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c4a5ca63-8c40-4a96-8fa1-4e5a4c81168e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-nj7bc\" (UID: \"c4a5ca63-8c40-4a96-8fa1-4e5a4c81168e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nj7bc"
Jul 02 23:28:41.748872 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:28:41.748845    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gbvgj\" (UniqueName: \"kubernetes.io/projected/c4a5ca63-8c40-4a96-8fa1-4e5a4c81168e-kube-api-access-gbvgj\") pod \"kuadrant-operator-controller-manager-86878c769f-nj7bc\" (UID: \"c4a5ca63-8c40-4a96-8fa1-4e5a4c81168e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nj7bc"
Jul 02 23:28:41.892816 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:28:41.892747    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nj7bc"
Jul 02 23:28:42.026392 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:28:42.026363    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nj7bc"]
Jul 02 23:28:42.026791 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:28:42.026770    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc4a5ca63_8c40_4a96_8fa1_4e5a4c81168e.slice/crio-a9db4e08fd363e4d4896e0fb30cb8cb2623e1a86dd8cb249ced4ea04f969d005 WatchSource:0}: Error finding container a9db4e08fd363e4d4896e0fb30cb8cb2623e1a86dd8cb249ced4ea04f969d005: Status 404 returned error can't find the container with id a9db4e08fd363e4d4896e0fb30cb8cb2623e1a86dd8cb249ced4ea04f969d005
Jul 02 23:28:42.299310 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:28:42.299273    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nj7bc" event={"ID":"c4a5ca63-8c40-4a96-8fa1-4e5a4c81168e","Type":"ContainerStarted","Data":"7317bcf356b7b0b2ae8278001a9b70d1104f9f5dfba32b59b29d66ac93085046"}
Jul 02 23:28:42.299481 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:28:42.299373    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nj7bc"
Jul 02 23:28:42.299481 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:28:42.299399    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nj7bc" event={"ID":"c4a5ca63-8c40-4a96-8fa1-4e5a4c81168e","Type":"ContainerStarted","Data":"a9db4e08fd363e4d4896e0fb30cb8cb2623e1a86dd8cb249ced4ea04f969d005"}
Jul 02 23:28:42.322349 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:28:42.322303    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nj7bc" podStartSLOduration=1.322289262 podStartE2EDuration="1.322289262s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:28:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:28:42.320375369 +0000 UTC m=+1108.337806578" watchObservedRunningTime="2026-07-02 23:28:42.322289262 +0000 UTC m=+1108.339720460"
Jul 02 23:28:53.306818 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:28:53.306780    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nj7bc"
Jul 02 23:30:42.609141 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:30:42.609038    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:31:22.055118 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:31:22.055084    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:31:35.350472 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:31:35.350433    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:34:22.176586 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:34:22.176550    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:34:27.449910 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:34:27.449878    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:34:35.707768 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:34:35.707736    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:34:40.802347 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:34:40.802309    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:34:43.728720 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:34:43.728688    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:34:43.826273 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:34:43.826223    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:34:44.173882 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:34:44.173847    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:34:49.771076 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:34:49.771041    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:34:49.873998 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:34:49.873951    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:34:49.980650 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:34:49.980622    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:34:50.042695 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:34:50.042659    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:34:51.190645 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:34:51.190607    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:34:51.255035 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:34:51.254998    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-ait-a58dbec0-5ffdf4885b-qbrcj"]
Jul 02 23:34:51.258376 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:34:51.258353    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-a58dbec0-5ffdf4885b-qbrcj"
Jul 02 23:34:51.260427 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:34:51.260402    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:34:51.261071 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:34:51.261052    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-ait-a58dbec0-serving-cert\""
Jul 02 23:34:51.269852 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:34:51.269827    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-a58dbec0-5ffdf4885b-qbrcj"]
Jul 02 23:34:51.342857 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:34:51.342822    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:34:51.378084 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:34:51.378052    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4ppsj\" (UniqueName: \"kubernetes.io/projected/ca4fd92e-3206-4052-9764-da9f6d25f8fb-kube-api-access-4ppsj\") pod \"maas-api-e2e-ait-a58dbec0-5ffdf4885b-qbrcj\" (UID: \"ca4fd92e-3206-4052-9764-da9f6d25f8fb\") " pod="opendatahub/maas-api-e2e-ait-a58dbec0-5ffdf4885b-qbrcj"
Jul 02 23:34:51.378273 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:34:51.378094    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ca4fd92e-3206-4052-9764-da9f6d25f8fb-maas-api-tls\") pod \"maas-api-e2e-ait-a58dbec0-5ffdf4885b-qbrcj\" (UID: \"ca4fd92e-3206-4052-9764-da9f6d25f8fb\") " pod="opendatahub/maas-api-e2e-ait-a58dbec0-5ffdf4885b-qbrcj"
Jul 02 23:34:51.378273 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:34:51.378184    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ca4fd92e-3206-4052-9764-da9f6d25f8fb-openshift-service-ca\") pod \"maas-api-e2e-ait-a58dbec0-5ffdf4885b-qbrcj\" (UID: \"ca4fd92e-3206-4052-9764-da9f6d25f8fb\") " pod="opendatahub/maas-api-e2e-ait-a58dbec0-5ffdf4885b-qbrcj"
Jul 02 23:34:51.479059 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:34:51.478971    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ca4fd92e-3206-4052-9764-da9f6d25f8fb-openshift-service-ca\") pod \"maas-api-e2e-ait-a58dbec0-5ffdf4885b-qbrcj\" (UID: \"ca4fd92e-3206-4052-9764-da9f6d25f8fb\") " pod="opendatahub/maas-api-e2e-ait-a58dbec0-5ffdf4885b-qbrcj"
Jul 02 23:34:51.479059 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:34:51.479043    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4ppsj\" (UniqueName: \"kubernetes.io/projected/ca4fd92e-3206-4052-9764-da9f6d25f8fb-kube-api-access-4ppsj\") pod \"maas-api-e2e-ait-a58dbec0-5ffdf4885b-qbrcj\" (UID: \"ca4fd92e-3206-4052-9764-da9f6d25f8fb\") " pod="opendatahub/maas-api-e2e-ait-a58dbec0-5ffdf4885b-qbrcj"
Jul 02 23:34:51.479272 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:34:51.479068    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ca4fd92e-3206-4052-9764-da9f6d25f8fb-maas-api-tls\") pod \"maas-api-e2e-ait-a58dbec0-5ffdf4885b-qbrcj\" (UID: \"ca4fd92e-3206-4052-9764-da9f6d25f8fb\") " pod="opendatahub/maas-api-e2e-ait-a58dbec0-5ffdf4885b-qbrcj"
Jul 02 23:34:51.479272 ip-10-0-135-187 kubenswrapper[2580]: E0702 23:34:51.479179    2580 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-ait-a58dbec0-serving-cert: secret "maas-api-e2e-ait-a58dbec0-serving-cert" not found
Jul 02 23:34:51.479272 ip-10-0-135-187 kubenswrapper[2580]: E0702 23:34:51.479233    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca4fd92e-3206-4052-9764-da9f6d25f8fb-maas-api-tls podName:ca4fd92e-3206-4052-9764-da9f6d25f8fb nodeName:}" failed. No retries permitted until 2026-07-02 23:34:51.979217201 +0000 UTC m=+1477.996648377 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/ca4fd92e-3206-4052-9764-da9f6d25f8fb-maas-api-tls") pod "maas-api-e2e-ait-a58dbec0-5ffdf4885b-qbrcj" (UID: "ca4fd92e-3206-4052-9764-da9f6d25f8fb") : secret "maas-api-e2e-ait-a58dbec0-serving-cert" not found
Jul 02 23:34:51.479744 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:34:51.479722    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ca4fd92e-3206-4052-9764-da9f6d25f8fb-openshift-service-ca\") pod \"maas-api-e2e-ait-a58dbec0-5ffdf4885b-qbrcj\" (UID: \"ca4fd92e-3206-4052-9764-da9f6d25f8fb\") " pod="opendatahub/maas-api-e2e-ait-a58dbec0-5ffdf4885b-qbrcj"
Jul 02 23:34:51.490506 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:34:51.490469    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4ppsj\" (UniqueName: \"kubernetes.io/projected/ca4fd92e-3206-4052-9764-da9f6d25f8fb-kube-api-access-4ppsj\") pod \"maas-api-e2e-ait-a58dbec0-5ffdf4885b-qbrcj\" (UID: \"ca4fd92e-3206-4052-9764-da9f6d25f8fb\") " pod="opendatahub/maas-api-e2e-ait-a58dbec0-5ffdf4885b-qbrcj"
Jul 02 23:34:51.727125 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:34:51.727091    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:34:51.827775 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:34:51.827743    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:34:51.983812 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:34:51.983778    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ca4fd92e-3206-4052-9764-da9f6d25f8fb-maas-api-tls\") pod \"maas-api-e2e-ait-a58dbec0-5ffdf4885b-qbrcj\" (UID: \"ca4fd92e-3206-4052-9764-da9f6d25f8fb\") " pod="opendatahub/maas-api-e2e-ait-a58dbec0-5ffdf4885b-qbrcj"
Jul 02 23:34:51.986147 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:34:51.986127    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ca4fd92e-3206-4052-9764-da9f6d25f8fb-maas-api-tls\") pod \"maas-api-e2e-ait-a58dbec0-5ffdf4885b-qbrcj\" (UID: \"ca4fd92e-3206-4052-9764-da9f6d25f8fb\") " pod="opendatahub/maas-api-e2e-ait-a58dbec0-5ffdf4885b-qbrcj"
Jul 02 23:34:52.170410 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:34:52.170318    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-a58dbec0-5ffdf4885b-qbrcj"
Jul 02 23:34:52.301021 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:34:52.300997    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-a58dbec0-5ffdf4885b-qbrcj"]
Jul 02 23:34:52.303688 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:34:52.303662    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca4fd92e_3206_4052_9764_da9f6d25f8fb.slice/crio-b34efb25c20689a42f99f5335a0cfb6dba6bdf018d65f2d1143de69926fcdf17 WatchSource:0}: Error finding container b34efb25c20689a42f99f5335a0cfb6dba6bdf018d65f2d1143de69926fcdf17: Status 404 returned error can't find the container with id b34efb25c20689a42f99f5335a0cfb6dba6bdf018d65f2d1143de69926fcdf17
Jul 02 23:34:52.304958 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:34:52.304940    2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 02 23:34:52.940780 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:34:52.940748    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-a58dbec0-5ffdf4885b-qbrcj" event={"ID":"ca4fd92e-3206-4052-9764-da9f6d25f8fb","Type":"ContainerStarted","Data":"a5e2441ff8cef8bcb21ee2def16339f4654ca55c3f62303629dae0b839532cd1"}
Jul 02 23:34:52.940954 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:34:52.940803    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-a58dbec0-5ffdf4885b-qbrcj" event={"ID":"ca4fd92e-3206-4052-9764-da9f6d25f8fb","Type":"ContainerStarted","Data":"b34efb25c20689a42f99f5335a0cfb6dba6bdf018d65f2d1143de69926fcdf17"}
Jul 02 23:34:52.940954 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:34:52.940836    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-ait-a58dbec0-5ffdf4885b-qbrcj"
Jul 02 23:34:52.962696 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:34:52.962648    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-ait-a58dbec0-5ffdf4885b-qbrcj" podStartSLOduration=1.554267353 podStartE2EDuration="1.96263097s" totalImagesPullingTime="408.363617ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:34:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:34:52.961033523 +0000 UTC m=+1478.978464747" watchObservedRunningTime="2026-07-02 23:34:52.96263097 +0000 UTC m=+1478.980062168"
Jul 02 23:34:53.759199 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:34:53.759162    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:34:56.254540 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:34:56.254508    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:34:56.442200 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:34:56.442168    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:34:56.540519 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:34:56.540480    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:34:56.589296 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:34:56.589264    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-ait-a58dbec0-5ffdf4885b-qbrcj"]
Jul 02 23:34:56.589505 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:34:56.589474    2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-ait-a58dbec0-5ffdf4885b-qbrcj" podUID="ca4fd92e-3206-4052-9764-da9f6d25f8fb" containerName="maas-api" containerID="cri-o://a5e2441ff8cef8bcb21ee2def16339f4654ca55c3f62303629dae0b839532cd1" gracePeriod=30
Jul 02 23:34:56.642259 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:34:56.642222    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:34:56.825956 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:34:56.825934    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-a58dbec0-5ffdf4885b-qbrcj"
Jul 02 23:34:56.925494 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:34:56.925459    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4ppsj\" (UniqueName: \"kubernetes.io/projected/ca4fd92e-3206-4052-9764-da9f6d25f8fb-kube-api-access-4ppsj\") pod \"ca4fd92e-3206-4052-9764-da9f6d25f8fb\" (UID: \"ca4fd92e-3206-4052-9764-da9f6d25f8fb\") "
Jul 02 23:34:56.925678 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:34:56.925499    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ca4fd92e-3206-4052-9764-da9f6d25f8fb-openshift-service-ca\") pod \"ca4fd92e-3206-4052-9764-da9f6d25f8fb\" (UID: \"ca4fd92e-3206-4052-9764-da9f6d25f8fb\") "
Jul 02 23:34:56.925678 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:34:56.925608    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ca4fd92e-3206-4052-9764-da9f6d25f8fb-maas-api-tls\") pod \"ca4fd92e-3206-4052-9764-da9f6d25f8fb\" (UID: \"ca4fd92e-3206-4052-9764-da9f6d25f8fb\") "
Jul 02 23:34:56.925896 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:34:56.925872    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ca4fd92e-3206-4052-9764-da9f6d25f8fb-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "ca4fd92e-3206-4052-9764-da9f6d25f8fb" (UID: "ca4fd92e-3206-4052-9764-da9f6d25f8fb"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 23:34:56.927714 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:34:56.927691    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ca4fd92e-3206-4052-9764-da9f6d25f8fb-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "ca4fd92e-3206-4052-9764-da9f6d25f8fb" (UID: "ca4fd92e-3206-4052-9764-da9f6d25f8fb"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 23:34:56.927714 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:34:56.927697    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ca4fd92e-3206-4052-9764-da9f6d25f8fb-kube-api-access-4ppsj" (OuterVolumeSpecName: "kube-api-access-4ppsj") pod "ca4fd92e-3206-4052-9764-da9f6d25f8fb" (UID: "ca4fd92e-3206-4052-9764-da9f6d25f8fb"). InnerVolumeSpecName "kube-api-access-4ppsj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 23:34:56.961082 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:34:56.961050    2580 generic.go:356] "Generic (PLEG): container finished" podID="ca4fd92e-3206-4052-9764-da9f6d25f8fb" containerID="a5e2441ff8cef8bcb21ee2def16339f4654ca55c3f62303629dae0b839532cd1" exitCode=0
Jul 02 23:34:56.961225 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:34:56.961098    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-a58dbec0-5ffdf4885b-qbrcj"
Jul 02 23:34:56.961225 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:34:56.961116    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-a58dbec0-5ffdf4885b-qbrcj" event={"ID":"ca4fd92e-3206-4052-9764-da9f6d25f8fb","Type":"ContainerDied","Data":"a5e2441ff8cef8bcb21ee2def16339f4654ca55c3f62303629dae0b839532cd1"}
Jul 02 23:34:56.961225 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:34:56.961162    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-a58dbec0-5ffdf4885b-qbrcj" event={"ID":"ca4fd92e-3206-4052-9764-da9f6d25f8fb","Type":"ContainerDied","Data":"b34efb25c20689a42f99f5335a0cfb6dba6bdf018d65f2d1143de69926fcdf17"}
Jul 02 23:34:56.961225 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:34:56.961185    2580 scope.go:117] "RemoveContainer" containerID="a5e2441ff8cef8bcb21ee2def16339f4654ca55c3f62303629dae0b839532cd1"
Jul 02 23:34:56.970578 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:34:56.970555    2580 scope.go:117] "RemoveContainer" containerID="a5e2441ff8cef8bcb21ee2def16339f4654ca55c3f62303629dae0b839532cd1"
Jul 02 23:34:56.970816 ip-10-0-135-187 kubenswrapper[2580]: E0702 23:34:56.970800    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a5e2441ff8cef8bcb21ee2def16339f4654ca55c3f62303629dae0b839532cd1\": container with ID starting with a5e2441ff8cef8bcb21ee2def16339f4654ca55c3f62303629dae0b839532cd1 not found: ID does not exist" containerID="a5e2441ff8cef8bcb21ee2def16339f4654ca55c3f62303629dae0b839532cd1"
Jul 02 23:34:56.970863 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:34:56.970823    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a5e2441ff8cef8bcb21ee2def16339f4654ca55c3f62303629dae0b839532cd1"} err="failed to get container status \"a5e2441ff8cef8bcb21ee2def16339f4654ca55c3f62303629dae0b839532cd1\": rpc error: code = NotFound desc = could not find container \"a5e2441ff8cef8bcb21ee2def16339f4654ca55c3f62303629dae0b839532cd1\": container with ID starting with a5e2441ff8cef8bcb21ee2def16339f4654ca55c3f62303629dae0b839532cd1 not found: ID does not exist"
Jul 02 23:34:56.982917 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:34:56.982892    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-ait-a58dbec0-5ffdf4885b-qbrcj"]
Jul 02 23:34:56.986527 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:34:56.986505    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-ait-a58dbec0-5ffdf4885b-qbrcj"]
Jul 02 23:34:57.026338 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:34:57.026306    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4ppsj\" (UniqueName: \"kubernetes.io/projected/ca4fd92e-3206-4052-9764-da9f6d25f8fb-kube-api-access-4ppsj\") on node \"ip-10-0-135-187.ec2.internal\" DevicePath \"\""
Jul 02 23:34:57.026338 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:34:57.026334    2580 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ca4fd92e-3206-4052-9764-da9f6d25f8fb-openshift-service-ca\") on node \"ip-10-0-135-187.ec2.internal\" DevicePath \"\""
Jul 02 23:34:57.026480 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:34:57.026347    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ca4fd92e-3206-4052-9764-da9f6d25f8fb-maas-api-tls\") on node \"ip-10-0-135-187.ec2.internal\" DevicePath \"\""
Jul 02 23:34:57.910742 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:34:57.910714    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:34:58.428078 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:34:58.428035    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ca4fd92e-3206-4052-9764-da9f6d25f8fb" path="/var/lib/kubelet/pods/ca4fd92e-3206-4052-9764-da9f6d25f8fb/volumes"
Jul 02 23:35:02.291587 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:35:02.291557    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:35:02.358962 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:35:02.358936    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:35:02.533596 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:35:02.533562    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:35:02.831467 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:35:02.831430    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:35:02.931797 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:35:02.931763    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:35:04.051439 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:35:04.051407    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:35:04.112647 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:35:04.112616    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-migrate-966cc298-9bb964dbf-qmcql"]
Jul 02 23:35:04.113197 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:35:04.113180    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ca4fd92e-3206-4052-9764-da9f6d25f8fb" containerName="maas-api"
Jul 02 23:35:04.113267 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:35:04.113201    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="ca4fd92e-3206-4052-9764-da9f6d25f8fb" containerName="maas-api"
Jul 02 23:35:04.113351 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:35:04.113337    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="ca4fd92e-3206-4052-9764-da9f6d25f8fb" containerName="maas-api"
Jul 02 23:35:04.118130 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:35:04.118110    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-migrate-966cc298-9bb964dbf-qmcql"
Jul 02 23:35:04.120856 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:35:04.120834    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-migrate-966cc298-serving-cert\""
Jul 02 23:35:04.128311 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:35:04.128287    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-migrate-966cc298-9bb964dbf-qmcql"]
Jul 02 23:35:04.149383 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:35:04.149359    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:35:04.295279 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:35:04.295235    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3416cc88-e62e-4811-8d74-4d6dbfe16e0e-maas-api-tls\") pod \"maas-api-e2e-migrate-966cc298-9bb964dbf-qmcql\" (UID: \"3416cc88-e62e-4811-8d74-4d6dbfe16e0e\") " pod="opendatahub/maas-api-e2e-migrate-966cc298-9bb964dbf-qmcql"
Jul 02 23:35:04.295434 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:35:04.295285    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3416cc88-e62e-4811-8d74-4d6dbfe16e0e-openshift-service-ca\") pod \"maas-api-e2e-migrate-966cc298-9bb964dbf-qmcql\" (UID: \"3416cc88-e62e-4811-8d74-4d6dbfe16e0e\") " pod="opendatahub/maas-api-e2e-migrate-966cc298-9bb964dbf-qmcql"
Jul 02 23:35:04.295434 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:35:04.295327    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zgbrh\" (UniqueName: \"kubernetes.io/projected/3416cc88-e62e-4811-8d74-4d6dbfe16e0e-kube-api-access-zgbrh\") pod \"maas-api-e2e-migrate-966cc298-9bb964dbf-qmcql\" (UID: \"3416cc88-e62e-4811-8d74-4d6dbfe16e0e\") " pod="opendatahub/maas-api-e2e-migrate-966cc298-9bb964dbf-qmcql"
Jul 02 23:35:04.324042 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:35:04.323970    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:35:04.396792 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:35:04.396763    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3416cc88-e62e-4811-8d74-4d6dbfe16e0e-maas-api-tls\") pod \"maas-api-e2e-migrate-966cc298-9bb964dbf-qmcql\" (UID: \"3416cc88-e62e-4811-8d74-4d6dbfe16e0e\") " pod="opendatahub/maas-api-e2e-migrate-966cc298-9bb964dbf-qmcql"
Jul 02 23:35:04.396792 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:35:04.396793    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3416cc88-e62e-4811-8d74-4d6dbfe16e0e-openshift-service-ca\") pod \"maas-api-e2e-migrate-966cc298-9bb964dbf-qmcql\" (UID: \"3416cc88-e62e-4811-8d74-4d6dbfe16e0e\") " pod="opendatahub/maas-api-e2e-migrate-966cc298-9bb964dbf-qmcql"
Jul 02 23:35:04.396987 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:35:04.396834    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zgbrh\" (UniqueName: \"kubernetes.io/projected/3416cc88-e62e-4811-8d74-4d6dbfe16e0e-kube-api-access-zgbrh\") pod \"maas-api-e2e-migrate-966cc298-9bb964dbf-qmcql\" (UID: \"3416cc88-e62e-4811-8d74-4d6dbfe16e0e\") " pod="opendatahub/maas-api-e2e-migrate-966cc298-9bb964dbf-qmcql"
Jul 02 23:35:04.397520 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:35:04.397497    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3416cc88-e62e-4811-8d74-4d6dbfe16e0e-openshift-service-ca\") pod \"maas-api-e2e-migrate-966cc298-9bb964dbf-qmcql\" (UID: \"3416cc88-e62e-4811-8d74-4d6dbfe16e0e\") " pod="opendatahub/maas-api-e2e-migrate-966cc298-9bb964dbf-qmcql"
Jul 02 23:35:04.399219 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:35:04.399195    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3416cc88-e62e-4811-8d74-4d6dbfe16e0e-maas-api-tls\") pod \"maas-api-e2e-migrate-966cc298-9bb964dbf-qmcql\" (UID: \"3416cc88-e62e-4811-8d74-4d6dbfe16e0e\") " pod="opendatahub/maas-api-e2e-migrate-966cc298-9bb964dbf-qmcql"
Jul 02 23:35:04.405892 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:35:04.405872    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zgbrh\" (UniqueName: \"kubernetes.io/projected/3416cc88-e62e-4811-8d74-4d6dbfe16e0e-kube-api-access-zgbrh\") pod \"maas-api-e2e-migrate-966cc298-9bb964dbf-qmcql\" (UID: \"3416cc88-e62e-4811-8d74-4d6dbfe16e0e\") " pod="opendatahub/maas-api-e2e-migrate-966cc298-9bb964dbf-qmcql"
Jul 02 23:35:04.429665 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:35:04.429640    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-migrate-966cc298-9bb964dbf-qmcql"
Jul 02 23:35:04.560217 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:35:04.560170    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-migrate-966cc298-9bb964dbf-qmcql"]
Jul 02 23:35:04.562484 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:35:04.562459    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3416cc88_e62e_4811_8d74_4d6dbfe16e0e.slice/crio-b011e84af8f1d82c11f34646fcf28b16550f75340ab28eb2c4b792248ca8b995 WatchSource:0}: Error finding container b011e84af8f1d82c11f34646fcf28b16550f75340ab28eb2c4b792248ca8b995: Status 404 returned error can't find the container with id b011e84af8f1d82c11f34646fcf28b16550f75340ab28eb2c4b792248ca8b995
Jul 02 23:35:04.756740 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:35:04.756656    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:35:04.858741 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:35:04.858711    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:35:04.999340 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:35:04.999310    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-migrate-966cc298-9bb964dbf-qmcql" event={"ID":"3416cc88-e62e-4811-8d74-4d6dbfe16e0e","Type":"ContainerStarted","Data":"923ccd7f67be23451e6bef3e654b6fb088fb3a40025dbd145d8a9010f19d4d95"}
Jul 02 23:35:04.999445 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:35:04.999362    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-migrate-966cc298-9bb964dbf-qmcql" event={"ID":"3416cc88-e62e-4811-8d74-4d6dbfe16e0e","Type":"ContainerStarted","Data":"b011e84af8f1d82c11f34646fcf28b16550f75340ab28eb2c4b792248ca8b995"}
Jul 02 23:35:04.999498 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:35:04.999484    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-migrate-966cc298-9bb964dbf-qmcql"
Jul 02 23:35:05.017088 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:35:05.017009    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-migrate-966cc298-9bb964dbf-qmcql" podStartSLOduration=0.693935247 podStartE2EDuration="1.016996484s" totalImagesPullingTime="323.061237ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:35:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:35:05.014929111 +0000 UTC m=+1491.032360320" watchObservedRunningTime="2026-07-02 23:35:05.016996484 +0000 UTC m=+1491.034427682"
Jul 02 23:35:06.023881 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:35:06.023848    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:35:08.621320 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:35:08.621288    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:35:08.796402 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:35:08.796369    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:35:08.890203 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:35:08.890118    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:35:08.977002 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:35:08.976967    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-migrate-966cc298-9bb964dbf-qmcql"]
Jul 02 23:35:08.977297 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:35:08.977236    2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-migrate-966cc298-9bb964dbf-qmcql" podUID="3416cc88-e62e-4811-8d74-4d6dbfe16e0e" containerName="maas-api" containerID="cri-o://923ccd7f67be23451e6bef3e654b6fb088fb3a40025dbd145d8a9010f19d4d95" gracePeriod=30
Jul 02 23:35:09.002152 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:35:09.002121    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:35:09.230759 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:35:09.230735    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-migrate-966cc298-9bb964dbf-qmcql"
Jul 02 23:35:09.239570 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:35:09.239549    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3416cc88-e62e-4811-8d74-4d6dbfe16e0e-maas-api-tls\") pod \"3416cc88-e62e-4811-8d74-4d6dbfe16e0e\" (UID: \"3416cc88-e62e-4811-8d74-4d6dbfe16e0e\") "
Jul 02 23:35:09.239731 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:35:09.239596    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zgbrh\" (UniqueName: \"kubernetes.io/projected/3416cc88-e62e-4811-8d74-4d6dbfe16e0e-kube-api-access-zgbrh\") pod \"3416cc88-e62e-4811-8d74-4d6dbfe16e0e\" (UID: \"3416cc88-e62e-4811-8d74-4d6dbfe16e0e\") "
Jul 02 23:35:09.239731 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:35:09.239672    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3416cc88-e62e-4811-8d74-4d6dbfe16e0e-openshift-service-ca\") pod \"3416cc88-e62e-4811-8d74-4d6dbfe16e0e\" (UID: \"3416cc88-e62e-4811-8d74-4d6dbfe16e0e\") "
Jul 02 23:35:09.240050 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:35:09.240011    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3416cc88-e62e-4811-8d74-4d6dbfe16e0e-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "3416cc88-e62e-4811-8d74-4d6dbfe16e0e" (UID: "3416cc88-e62e-4811-8d74-4d6dbfe16e0e"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 23:35:09.241636 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:35:09.241609    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3416cc88-e62e-4811-8d74-4d6dbfe16e0e-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "3416cc88-e62e-4811-8d74-4d6dbfe16e0e" (UID: "3416cc88-e62e-4811-8d74-4d6dbfe16e0e"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 23:35:09.241727 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:35:09.241695    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3416cc88-e62e-4811-8d74-4d6dbfe16e0e-kube-api-access-zgbrh" (OuterVolumeSpecName: "kube-api-access-zgbrh") pod "3416cc88-e62e-4811-8d74-4d6dbfe16e0e" (UID: "3416cc88-e62e-4811-8d74-4d6dbfe16e0e"). InnerVolumeSpecName "kube-api-access-zgbrh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 23:35:09.341133 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:35:09.341100    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zgbrh\" (UniqueName: \"kubernetes.io/projected/3416cc88-e62e-4811-8d74-4d6dbfe16e0e-kube-api-access-zgbrh\") on node \"ip-10-0-135-187.ec2.internal\" DevicePath \"\""
Jul 02 23:35:09.341133 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:35:09.341126    2580 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3416cc88-e62e-4811-8d74-4d6dbfe16e0e-openshift-service-ca\") on node \"ip-10-0-135-187.ec2.internal\" DevicePath \"\""
Jul 02 23:35:09.341133 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:35:09.341136    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3416cc88-e62e-4811-8d74-4d6dbfe16e0e-maas-api-tls\") on node \"ip-10-0-135-187.ec2.internal\" DevicePath \"\""
Jul 02 23:35:10.009003 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:35:10.008974    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:35:10.026037 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:35:10.026008    2580 generic.go:356] "Generic (PLEG): container finished" podID="3416cc88-e62e-4811-8d74-4d6dbfe16e0e" containerID="923ccd7f67be23451e6bef3e654b6fb088fb3a40025dbd145d8a9010f19d4d95" exitCode=0
Jul 02 23:35:10.026155 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:35:10.026060    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-migrate-966cc298-9bb964dbf-qmcql"
Jul 02 23:35:10.026155 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:35:10.026088    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-migrate-966cc298-9bb964dbf-qmcql" event={"ID":"3416cc88-e62e-4811-8d74-4d6dbfe16e0e","Type":"ContainerDied","Data":"923ccd7f67be23451e6bef3e654b6fb088fb3a40025dbd145d8a9010f19d4d95"}
Jul 02 23:35:10.026155 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:35:10.026147    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-migrate-966cc298-9bb964dbf-qmcql" event={"ID":"3416cc88-e62e-4811-8d74-4d6dbfe16e0e","Type":"ContainerDied","Data":"b011e84af8f1d82c11f34646fcf28b16550f75340ab28eb2c4b792248ca8b995"}
Jul 02 23:35:10.026292 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:35:10.026170    2580 scope.go:117] "RemoveContainer" containerID="923ccd7f67be23451e6bef3e654b6fb088fb3a40025dbd145d8a9010f19d4d95"
Jul 02 23:35:10.036997 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:35:10.036982    2580 scope.go:117] "RemoveContainer" containerID="923ccd7f67be23451e6bef3e654b6fb088fb3a40025dbd145d8a9010f19d4d95"
Jul 02 23:35:10.037260 ip-10-0-135-187 kubenswrapper[2580]: E0702 23:35:10.037222    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"923ccd7f67be23451e6bef3e654b6fb088fb3a40025dbd145d8a9010f19d4d95\": container with ID starting with 923ccd7f67be23451e6bef3e654b6fb088fb3a40025dbd145d8a9010f19d4d95 not found: ID does not exist" containerID="923ccd7f67be23451e6bef3e654b6fb088fb3a40025dbd145d8a9010f19d4d95"
Jul 02 23:35:10.037322 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:35:10.037269    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"923ccd7f67be23451e6bef3e654b6fb088fb3a40025dbd145d8a9010f19d4d95"} err="failed to get container status \"923ccd7f67be23451e6bef3e654b6fb088fb3a40025dbd145d8a9010f19d4d95\": rpc error: code = NotFound desc = could not find container \"923ccd7f67be23451e6bef3e654b6fb088fb3a40025dbd145d8a9010f19d4d95\": container with ID starting with 923ccd7f67be23451e6bef3e654b6fb088fb3a40025dbd145d8a9010f19d4d95 not found: ID does not exist"
Jul 02 23:35:10.049878 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:35:10.049856    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-migrate-966cc298-9bb964dbf-qmcql"]
Jul 02 23:35:10.055793 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:35:10.055767    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-migrate-966cc298-9bb964dbf-qmcql"]
Jul 02 23:35:10.428276 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:35:10.428229    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3416cc88-e62e-4811-8d74-4d6dbfe16e0e" path="/var/lib/kubelet/pods/3416cc88-e62e-4811-8d74-4d6dbfe16e0e/volumes"
Jul 02 23:35:14.641201 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:35:14.641169    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:35:14.740935 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:35:14.740856    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:35:14.885531 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:35:14.885500    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:35:14.984395 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:35:14.984355    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:35:16.175549 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:35:16.175516    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:35:16.280057 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:35:16.280018    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:35:16.370861 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:35:16.370833    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-ait-6ccb1915-647f6f8c86-b2hbh"]
Jul 02 23:35:16.371212 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:35:16.371200    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3416cc88-e62e-4811-8d74-4d6dbfe16e0e" containerName="maas-api"
Jul 02 23:35:16.371271 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:35:16.371214    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="3416cc88-e62e-4811-8d74-4d6dbfe16e0e" containerName="maas-api"
Jul 02 23:35:16.371311 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:35:16.371283    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="3416cc88-e62e-4811-8d74-4d6dbfe16e0e" containerName="maas-api"
Jul 02 23:35:16.375763 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:35:16.375742    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-6ccb1915-647f6f8c86-b2hbh"
Jul 02 23:35:16.378892 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:35:16.378871    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-ait-6ccb1915-serving-cert\""
Jul 02 23:35:16.386593 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:35:16.386572    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-6ccb1915-647f6f8c86-b2hbh"]
Jul 02 23:35:16.399613 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:35:16.399593    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8179b471-7eb4-42f7-b5f6-19294d68cfcf-maas-api-tls\") pod \"maas-api-e2e-ait-6ccb1915-647f6f8c86-b2hbh\" (UID: \"8179b471-7eb4-42f7-b5f6-19294d68cfcf\") " pod="opendatahub/maas-api-e2e-ait-6ccb1915-647f6f8c86-b2hbh"
Jul 02 23:35:16.399720 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:35:16.399643    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8179b471-7eb4-42f7-b5f6-19294d68cfcf-openshift-service-ca\") pod \"maas-api-e2e-ait-6ccb1915-647f6f8c86-b2hbh\" (UID: \"8179b471-7eb4-42f7-b5f6-19294d68cfcf\") " pod="opendatahub/maas-api-e2e-ait-6ccb1915-647f6f8c86-b2hbh"
Jul 02 23:35:16.399720 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:35:16.399696    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dbd99\" (UniqueName: \"kubernetes.io/projected/8179b471-7eb4-42f7-b5f6-19294d68cfcf-kube-api-access-dbd99\") pod \"maas-api-e2e-ait-6ccb1915-647f6f8c86-b2hbh\" (UID: \"8179b471-7eb4-42f7-b5f6-19294d68cfcf\") " pod="opendatahub/maas-api-e2e-ait-6ccb1915-647f6f8c86-b2hbh"
Jul 02 23:35:16.418254 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:35:16.418224    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:35:16.500947 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:35:16.500866    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8179b471-7eb4-42f7-b5f6-19294d68cfcf-maas-api-tls\") pod \"maas-api-e2e-ait-6ccb1915-647f6f8c86-b2hbh\" (UID: \"8179b471-7eb4-42f7-b5f6-19294d68cfcf\") " pod="opendatahub/maas-api-e2e-ait-6ccb1915-647f6f8c86-b2hbh"
Jul 02 23:35:16.501092 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:35:16.500971    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8179b471-7eb4-42f7-b5f6-19294d68cfcf-openshift-service-ca\") pod \"maas-api-e2e-ait-6ccb1915-647f6f8c86-b2hbh\" (UID: \"8179b471-7eb4-42f7-b5f6-19294d68cfcf\") " pod="opendatahub/maas-api-e2e-ait-6ccb1915-647f6f8c86-b2hbh"
Jul 02 23:35:16.501092 ip-10-0-135-187 kubenswrapper[2580]: E0702 23:35:16.501017    2580 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-ait-6ccb1915-serving-cert: secret "maas-api-e2e-ait-6ccb1915-serving-cert" not found
Jul 02 23:35:16.501092 ip-10-0-135-187 kubenswrapper[2580]: E0702 23:35:16.501085    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8179b471-7eb4-42f7-b5f6-19294d68cfcf-maas-api-tls podName:8179b471-7eb4-42f7-b5f6-19294d68cfcf nodeName:}" failed. No retries permitted until 2026-07-02 23:35:17.001065283 +0000 UTC m=+1503.018496460 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/8179b471-7eb4-42f7-b5f6-19294d68cfcf-maas-api-tls") pod "maas-api-e2e-ait-6ccb1915-647f6f8c86-b2hbh" (UID: "8179b471-7eb4-42f7-b5f6-19294d68cfcf") : secret "maas-api-e2e-ait-6ccb1915-serving-cert" not found
Jul 02 23:35:16.501274 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:35:16.501020    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dbd99\" (UniqueName: \"kubernetes.io/projected/8179b471-7eb4-42f7-b5f6-19294d68cfcf-kube-api-access-dbd99\") pod \"maas-api-e2e-ait-6ccb1915-647f6f8c86-b2hbh\" (UID: \"8179b471-7eb4-42f7-b5f6-19294d68cfcf\") " pod="opendatahub/maas-api-e2e-ait-6ccb1915-647f6f8c86-b2hbh"
Jul 02 23:35:16.501741 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:35:16.501723    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8179b471-7eb4-42f7-b5f6-19294d68cfcf-openshift-service-ca\") pod \"maas-api-e2e-ait-6ccb1915-647f6f8c86-b2hbh\" (UID: \"8179b471-7eb4-42f7-b5f6-19294d68cfcf\") " pod="opendatahub/maas-api-e2e-ait-6ccb1915-647f6f8c86-b2hbh"
Jul 02 23:35:16.509577 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:35:16.509555    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dbd99\" (UniqueName: \"kubernetes.io/projected/8179b471-7eb4-42f7-b5f6-19294d68cfcf-kube-api-access-dbd99\") pod \"maas-api-e2e-ait-6ccb1915-647f6f8c86-b2hbh\" (UID: \"8179b471-7eb4-42f7-b5f6-19294d68cfcf\") " pod="opendatahub/maas-api-e2e-ait-6ccb1915-647f6f8c86-b2hbh"
Jul 02 23:35:16.689883 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:35:16.689852    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:35:16.936950 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:35:16.936917    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:35:17.004638 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:35:17.004606    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8179b471-7eb4-42f7-b5f6-19294d68cfcf-maas-api-tls\") pod \"maas-api-e2e-ait-6ccb1915-647f6f8c86-b2hbh\" (UID: \"8179b471-7eb4-42f7-b5f6-19294d68cfcf\") " pod="opendatahub/maas-api-e2e-ait-6ccb1915-647f6f8c86-b2hbh"
Jul 02 23:35:17.006935 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:35:17.006914    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8179b471-7eb4-42f7-b5f6-19294d68cfcf-maas-api-tls\") pod \"maas-api-e2e-ait-6ccb1915-647f6f8c86-b2hbh\" (UID: \"8179b471-7eb4-42f7-b5f6-19294d68cfcf\") " pod="opendatahub/maas-api-e2e-ait-6ccb1915-647f6f8c86-b2hbh"
Jul 02 23:35:17.035256 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:35:17.035217    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:35:17.288914 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:35:17.288884    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-6ccb1915-647f6f8c86-b2hbh"
Jul 02 23:35:17.421515 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:35:17.421491    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-6ccb1915-647f6f8c86-b2hbh"]
Jul 02 23:35:17.423804 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:35:17.423773    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8179b471_7eb4_42f7_b5f6_19294d68cfcf.slice/crio-8943ceba5399ee29c0799db97b6f5cdecfadb8f2c81543c42276b66e49ef443d WatchSource:0}: Error finding container 8943ceba5399ee29c0799db97b6f5cdecfadb8f2c81543c42276b66e49ef443d: Status 404 returned error can't find the container with id 8943ceba5399ee29c0799db97b6f5cdecfadb8f2c81543c42276b66e49ef443d
Jul 02 23:35:18.065861 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:35:18.065775    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-6ccb1915-647f6f8c86-b2hbh" event={"ID":"8179b471-7eb4-42f7-b5f6-19294d68cfcf","Type":"ContainerStarted","Data":"64e7c869a0e12fad2246a47cd09d4e73953132d667195246ebc98c7481b33d4c"}
Jul 02 23:35:18.065861 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:35:18.065822    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-6ccb1915-647f6f8c86-b2hbh" event={"ID":"8179b471-7eb4-42f7-b5f6-19294d68cfcf","Type":"ContainerStarted","Data":"8943ceba5399ee29c0799db97b6f5cdecfadb8f2c81543c42276b66e49ef443d"}
Jul 02 23:35:18.066041 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:35:18.065866    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-ait-6ccb1915-647f6f8c86-b2hbh"
Jul 02 23:35:18.084629 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:35:18.084578    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-ait-6ccb1915-647f6f8c86-b2hbh" podStartSLOduration=1.72106038 podStartE2EDuration="2.084563652s" totalImagesPullingTime="363.503272ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:35:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:35:18.083356076 +0000 UTC m=+1504.100787276" watchObservedRunningTime="2026-07-02 23:35:18.084563652 +0000 UTC m=+1504.101994850"
Jul 02 23:35:18.148499 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:35:18.148467    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:35:21.211422 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:35:21.211391    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:35:21.707158 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:35:21.707125    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-ait-6ccb1915-647f6f8c86-b2hbh"]
Jul 02 23:35:21.707358 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:35:21.707329    2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-ait-6ccb1915-647f6f8c86-b2hbh" podUID="8179b471-7eb4-42f7-b5f6-19294d68cfcf" containerName="maas-api" containerID="cri-o://64e7c869a0e12fad2246a47cd09d4e73953132d667195246ebc98c7481b33d4c" gracePeriod=30
Jul 02 23:35:21.731087 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:35:21.731067    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:35:21.948205 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:35:21.948181    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-6ccb1915-647f6f8c86-b2hbh"
Jul 02 23:35:22.052286 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:35:22.052258    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8179b471-7eb4-42f7-b5f6-19294d68cfcf-maas-api-tls\") pod \"8179b471-7eb4-42f7-b5f6-19294d68cfcf\" (UID: \"8179b471-7eb4-42f7-b5f6-19294d68cfcf\") "
Jul 02 23:35:22.052436 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:35:22.052359    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dbd99\" (UniqueName: \"kubernetes.io/projected/8179b471-7eb4-42f7-b5f6-19294d68cfcf-kube-api-access-dbd99\") pod \"8179b471-7eb4-42f7-b5f6-19294d68cfcf\" (UID: \"8179b471-7eb4-42f7-b5f6-19294d68cfcf\") "
Jul 02 23:35:22.052477 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:35:22.052454    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8179b471-7eb4-42f7-b5f6-19294d68cfcf-openshift-service-ca\") pod \"8179b471-7eb4-42f7-b5f6-19294d68cfcf\" (UID: \"8179b471-7eb4-42f7-b5f6-19294d68cfcf\") "
Jul 02 23:35:22.052803 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:35:22.052775    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8179b471-7eb4-42f7-b5f6-19294d68cfcf-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "8179b471-7eb4-42f7-b5f6-19294d68cfcf" (UID: "8179b471-7eb4-42f7-b5f6-19294d68cfcf"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 23:35:22.054274 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:35:22.054255    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8179b471-7eb4-42f7-b5f6-19294d68cfcf-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "8179b471-7eb4-42f7-b5f6-19294d68cfcf" (UID: "8179b471-7eb4-42f7-b5f6-19294d68cfcf"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 23:35:22.054361 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:35:22.054302    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8179b471-7eb4-42f7-b5f6-19294d68cfcf-kube-api-access-dbd99" (OuterVolumeSpecName: "kube-api-access-dbd99") pod "8179b471-7eb4-42f7-b5f6-19294d68cfcf" (UID: "8179b471-7eb4-42f7-b5f6-19294d68cfcf"). InnerVolumeSpecName "kube-api-access-dbd99". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 23:35:22.084301 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:35:22.084274    2580 generic.go:356] "Generic (PLEG): container finished" podID="8179b471-7eb4-42f7-b5f6-19294d68cfcf" containerID="64e7c869a0e12fad2246a47cd09d4e73953132d667195246ebc98c7481b33d4c" exitCode=0
Jul 02 23:35:22.084410 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:35:22.084361    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-6ccb1915-647f6f8c86-b2hbh"
Jul 02 23:35:22.084410 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:35:22.084382    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-6ccb1915-647f6f8c86-b2hbh" event={"ID":"8179b471-7eb4-42f7-b5f6-19294d68cfcf","Type":"ContainerDied","Data":"64e7c869a0e12fad2246a47cd09d4e73953132d667195246ebc98c7481b33d4c"}
Jul 02 23:35:22.084476 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:35:22.084423    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-6ccb1915-647f6f8c86-b2hbh" event={"ID":"8179b471-7eb4-42f7-b5f6-19294d68cfcf","Type":"ContainerDied","Data":"8943ceba5399ee29c0799db97b6f5cdecfadb8f2c81543c42276b66e49ef443d"}
Jul 02 23:35:22.084476 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:35:22.084445    2580 scope.go:117] "RemoveContainer" containerID="64e7c869a0e12fad2246a47cd09d4e73953132d667195246ebc98c7481b33d4c"
Jul 02 23:35:22.092932 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:35:22.092917    2580 scope.go:117] "RemoveContainer" containerID="64e7c869a0e12fad2246a47cd09d4e73953132d667195246ebc98c7481b33d4c"
Jul 02 23:35:22.093175 ip-10-0-135-187 kubenswrapper[2580]: E0702 23:35:22.093156    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"64e7c869a0e12fad2246a47cd09d4e73953132d667195246ebc98c7481b33d4c\": container with ID starting with 64e7c869a0e12fad2246a47cd09d4e73953132d667195246ebc98c7481b33d4c not found: ID does not exist" containerID="64e7c869a0e12fad2246a47cd09d4e73953132d667195246ebc98c7481b33d4c"
Jul 02 23:35:22.093231 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:35:22.093186    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"64e7c869a0e12fad2246a47cd09d4e73953132d667195246ebc98c7481b33d4c"} err="failed to get container status \"64e7c869a0e12fad2246a47cd09d4e73953132d667195246ebc98c7481b33d4c\": rpc error: code = NotFound desc = could not find container \"64e7c869a0e12fad2246a47cd09d4e73953132d667195246ebc98c7481b33d4c\": container with ID starting with 64e7c869a0e12fad2246a47cd09d4e73953132d667195246ebc98c7481b33d4c not found: ID does not exist"
Jul 02 23:35:22.108092 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:35:22.108070    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-ait-6ccb1915-647f6f8c86-b2hbh"]
Jul 02 23:35:22.114635 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:35:22.114614    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-ait-6ccb1915-647f6f8c86-b2hbh"]
Jul 02 23:35:22.153872 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:35:22.153847    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dbd99\" (UniqueName: \"kubernetes.io/projected/8179b471-7eb4-42f7-b5f6-19294d68cfcf-kube-api-access-dbd99\") on node \"ip-10-0-135-187.ec2.internal\" DevicePath \"\""
Jul 02 23:35:22.153872 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:35:22.153870    2580 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8179b471-7eb4-42f7-b5f6-19294d68cfcf-openshift-service-ca\") on node \"ip-10-0-135-187.ec2.internal\" DevicePath \"\""
Jul 02 23:35:22.154004 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:35:22.153882    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8179b471-7eb4-42f7-b5f6-19294d68cfcf-maas-api-tls\") on node \"ip-10-0-135-187.ec2.internal\" DevicePath \"\""
Jul 02 23:35:22.428302 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:35:22.428216    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8179b471-7eb4-42f7-b5f6-19294d68cfcf" path="/var/lib/kubelet/pods/8179b471-7eb4-42f7-b5f6-19294d68cfcf/volumes"
Jul 02 23:35:27.523718 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:35:27.523641    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:35:27.629866 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:35:27.629838    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:35:33.755351 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:35:33.755323    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:35:33.823945 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:35:33.823918    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:35:33.967936 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:35:33.967899    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:35:34.311197 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:35:34.311171    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:35:34.368393 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:35:34.368365    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:35:35.180297 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:35:35.180235    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:35:35.238528 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:35:35.238497    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-derive-ee1caf8b-fc4cb78f8-mxr94"]
Jul 02 23:35:35.239091 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:35:35.239069    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8179b471-7eb4-42f7-b5f6-19294d68cfcf" containerName="maas-api"
Jul 02 23:35:35.239268 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:35:35.239235    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="8179b471-7eb4-42f7-b5f6-19294d68cfcf" containerName="maas-api"
Jul 02 23:35:35.239487 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:35:35.239471    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="8179b471-7eb4-42f7-b5f6-19294d68cfcf" containerName="maas-api"
Jul 02 23:35:35.243804 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:35:35.243785    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-derive-ee1caf8b-fc4cb78f8-mxr94"
Jul 02 23:35:35.246413 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:35:35.246395    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-derive-ee1caf8b-serving-cert\""
Jul 02 23:35:35.256365 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:35:35.256326    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-derive-ee1caf8b-fc4cb78f8-mxr94"]
Jul 02 23:35:35.369074 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:35:35.369034    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xll8f\" (UniqueName: \"kubernetes.io/projected/9a147935-516b-4064-82e4-39bba4ea2155-kube-api-access-xll8f\") pod \"maas-api-e2e-derive-ee1caf8b-fc4cb78f8-mxr94\" (UID: \"9a147935-516b-4064-82e4-39bba4ea2155\") " pod="opendatahub/maas-api-e2e-derive-ee1caf8b-fc4cb78f8-mxr94"
Jul 02 23:35:35.369260 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:35:35.369148    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9a147935-516b-4064-82e4-39bba4ea2155-maas-api-tls\") pod \"maas-api-e2e-derive-ee1caf8b-fc4cb78f8-mxr94\" (UID: \"9a147935-516b-4064-82e4-39bba4ea2155\") " pod="opendatahub/maas-api-e2e-derive-ee1caf8b-fc4cb78f8-mxr94"
Jul 02 23:35:35.369260 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:35:35.369182    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9a147935-516b-4064-82e4-39bba4ea2155-openshift-service-ca\") pod \"maas-api-e2e-derive-ee1caf8b-fc4cb78f8-mxr94\" (UID: \"9a147935-516b-4064-82e4-39bba4ea2155\") " pod="opendatahub/maas-api-e2e-derive-ee1caf8b-fc4cb78f8-mxr94"
Jul 02 23:35:35.470525 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:35:35.470444    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9a147935-516b-4064-82e4-39bba4ea2155-maas-api-tls\") pod \"maas-api-e2e-derive-ee1caf8b-fc4cb78f8-mxr94\" (UID: \"9a147935-516b-4064-82e4-39bba4ea2155\") " pod="opendatahub/maas-api-e2e-derive-ee1caf8b-fc4cb78f8-mxr94"
Jul 02 23:35:35.470525 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:35:35.470486    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9a147935-516b-4064-82e4-39bba4ea2155-openshift-service-ca\") pod \"maas-api-e2e-derive-ee1caf8b-fc4cb78f8-mxr94\" (UID: \"9a147935-516b-4064-82e4-39bba4ea2155\") " pod="opendatahub/maas-api-e2e-derive-ee1caf8b-fc4cb78f8-mxr94"
Jul 02 23:35:35.470746 ip-10-0-135-187 kubenswrapper[2580]: E0702 23:35:35.470607    2580 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-derive-ee1caf8b-serving-cert: secret "maas-api-e2e-derive-ee1caf8b-serving-cert" not found
Jul 02 23:35:35.470746 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:35:35.470606    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xll8f\" (UniqueName: \"kubernetes.io/projected/9a147935-516b-4064-82e4-39bba4ea2155-kube-api-access-xll8f\") pod \"maas-api-e2e-derive-ee1caf8b-fc4cb78f8-mxr94\" (UID: \"9a147935-516b-4064-82e4-39bba4ea2155\") " pod="opendatahub/maas-api-e2e-derive-ee1caf8b-fc4cb78f8-mxr94"
Jul 02 23:35:35.470746 ip-10-0-135-187 kubenswrapper[2580]: E0702 23:35:35.470690    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a147935-516b-4064-82e4-39bba4ea2155-maas-api-tls podName:9a147935-516b-4064-82e4-39bba4ea2155 nodeName:}" failed. No retries permitted until 2026-07-02 23:35:35.970666659 +0000 UTC m=+1521.988097849 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/9a147935-516b-4064-82e4-39bba4ea2155-maas-api-tls") pod "maas-api-e2e-derive-ee1caf8b-fc4cb78f8-mxr94" (UID: "9a147935-516b-4064-82e4-39bba4ea2155") : secret "maas-api-e2e-derive-ee1caf8b-serving-cert" not found
Jul 02 23:35:35.471204 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:35:35.471186    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9a147935-516b-4064-82e4-39bba4ea2155-openshift-service-ca\") pod \"maas-api-e2e-derive-ee1caf8b-fc4cb78f8-mxr94\" (UID: \"9a147935-516b-4064-82e4-39bba4ea2155\") " pod="opendatahub/maas-api-e2e-derive-ee1caf8b-fc4cb78f8-mxr94"
Jul 02 23:35:35.481141 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:35:35.481116    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xll8f\" (UniqueName: \"kubernetes.io/projected/9a147935-516b-4064-82e4-39bba4ea2155-kube-api-access-xll8f\") pod \"maas-api-e2e-derive-ee1caf8b-fc4cb78f8-mxr94\" (UID: \"9a147935-516b-4064-82e4-39bba4ea2155\") " pod="opendatahub/maas-api-e2e-derive-ee1caf8b-fc4cb78f8-mxr94"
Jul 02 23:35:35.975358 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:35:35.975326    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9a147935-516b-4064-82e4-39bba4ea2155-maas-api-tls\") pod \"maas-api-e2e-derive-ee1caf8b-fc4cb78f8-mxr94\" (UID: \"9a147935-516b-4064-82e4-39bba4ea2155\") " pod="opendatahub/maas-api-e2e-derive-ee1caf8b-fc4cb78f8-mxr94"
Jul 02 23:35:35.977903 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:35:35.977873    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9a147935-516b-4064-82e4-39bba4ea2155-maas-api-tls\") pod \"maas-api-e2e-derive-ee1caf8b-fc4cb78f8-mxr94\" (UID: \"9a147935-516b-4064-82e4-39bba4ea2155\") " pod="opendatahub/maas-api-e2e-derive-ee1caf8b-fc4cb78f8-mxr94"
Jul 02 23:35:36.137132 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:35:36.137051    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:35:36.157444 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:35:36.157414    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-derive-ee1caf8b-fc4cb78f8-mxr94"
Jul 02 23:35:36.236805 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:35:36.236623    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:35:36.283287 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:35:36.283234    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-derive-ee1caf8b-fc4cb78f8-mxr94"]
Jul 02 23:35:36.285188 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:35:36.285163    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a147935_516b_4064_82e4_39bba4ea2155.slice/crio-8454fe087b7b94d64abcade8093cde43cd79ac1af0253b8d50ceaa76c13f7e14 WatchSource:0}: Error finding container 8454fe087b7b94d64abcade8093cde43cd79ac1af0253b8d50ceaa76c13f7e14: Status 404 returned error can't find the container with id 8454fe087b7b94d64abcade8093cde43cd79ac1af0253b8d50ceaa76c13f7e14
Jul 02 23:35:37.151296 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:35:37.151252    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-derive-ee1caf8b-fc4cb78f8-mxr94" event={"ID":"9a147935-516b-4064-82e4-39bba4ea2155","Type":"ContainerStarted","Data":"874fe76dc1465adf854aefd790d2c3c2b141efb9854f67ef4f88a005f03889c1"}
Jul 02 23:35:37.151460 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:35:37.151350    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-derive-ee1caf8b-fc4cb78f8-mxr94" event={"ID":"9a147935-516b-4064-82e4-39bba4ea2155","Type":"ContainerStarted","Data":"8454fe087b7b94d64abcade8093cde43cd79ac1af0253b8d50ceaa76c13f7e14"}
Jul 02 23:35:37.151460 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:35:37.151379    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-derive-ee1caf8b-fc4cb78f8-mxr94"
Jul 02 23:35:37.183523 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:35:37.183473    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-derive-ee1caf8b-fc4cb78f8-mxr94" podStartSLOduration=1.772533121 podStartE2EDuration="2.183453102s" totalImagesPullingTime="410.919981ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:35:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:35:37.182147102 +0000 UTC m=+1523.199578302" watchObservedRunningTime="2026-07-02 23:35:37.183453102 +0000 UTC m=+1523.200884300"
Jul 02 23:35:37.734475 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:35:37.734447    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:35:39.612506 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:35:39.612471    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:35:39.773094 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:35:39.773049    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:35:39.874478 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:35:39.874403    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:35:39.974218 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:35:39.974181    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-derive-ee1caf8b-fc4cb78f8-mxr94"]
Jul 02 23:35:39.974482 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:35:39.974449    2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-derive-ee1caf8b-fc4cb78f8-mxr94" podUID="9a147935-516b-4064-82e4-39bba4ea2155" containerName="maas-api" containerID="cri-o://874fe76dc1465adf854aefd790d2c3c2b141efb9854f67ef4f88a005f03889c1" gracePeriod=30
Jul 02 23:35:40.001845 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:35:40.001818    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:35:40.169722 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:35:40.169690    2580 generic.go:356] "Generic (PLEG): container finished" podID="9a147935-516b-4064-82e4-39bba4ea2155" containerID="874fe76dc1465adf854aefd790d2c3c2b141efb9854f67ef4f88a005f03889c1" exitCode=0
Jul 02 23:35:40.169866 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:35:40.169766    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-derive-ee1caf8b-fc4cb78f8-mxr94" event={"ID":"9a147935-516b-4064-82e4-39bba4ea2155","Type":"ContainerDied","Data":"874fe76dc1465adf854aefd790d2c3c2b141efb9854f67ef4f88a005f03889c1"}
Jul 02 23:35:40.223058 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:35:40.223028    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-derive-ee1caf8b-fc4cb78f8-mxr94"
Jul 02 23:35:40.312664 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:35:40.312636    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9a147935-516b-4064-82e4-39bba4ea2155-openshift-service-ca\") pod \"9a147935-516b-4064-82e4-39bba4ea2155\" (UID: \"9a147935-516b-4064-82e4-39bba4ea2155\") "
Jul 02 23:35:40.312814 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:35:40.312698    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9a147935-516b-4064-82e4-39bba4ea2155-maas-api-tls\") pod \"9a147935-516b-4064-82e4-39bba4ea2155\" (UID: \"9a147935-516b-4064-82e4-39bba4ea2155\") "
Jul 02 23:35:40.312814 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:35:40.312771    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xll8f\" (UniqueName: \"kubernetes.io/projected/9a147935-516b-4064-82e4-39bba4ea2155-kube-api-access-xll8f\") pod \"9a147935-516b-4064-82e4-39bba4ea2155\" (UID: \"9a147935-516b-4064-82e4-39bba4ea2155\") "
Jul 02 23:35:40.313008 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:35:40.312981    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9a147935-516b-4064-82e4-39bba4ea2155-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "9a147935-516b-4064-82e4-39bba4ea2155" (UID: "9a147935-516b-4064-82e4-39bba4ea2155"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 23:35:40.314702 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:35:40.314669    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9a147935-516b-4064-82e4-39bba4ea2155-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "9a147935-516b-4064-82e4-39bba4ea2155" (UID: "9a147935-516b-4064-82e4-39bba4ea2155"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 23:35:40.314702 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:35:40.314673    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9a147935-516b-4064-82e4-39bba4ea2155-kube-api-access-xll8f" (OuterVolumeSpecName: "kube-api-access-xll8f") pod "9a147935-516b-4064-82e4-39bba4ea2155" (UID: "9a147935-516b-4064-82e4-39bba4ea2155"). InnerVolumeSpecName "kube-api-access-xll8f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 23:35:40.414116 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:35:40.414048    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xll8f\" (UniqueName: \"kubernetes.io/projected/9a147935-516b-4064-82e4-39bba4ea2155-kube-api-access-xll8f\") on node \"ip-10-0-135-187.ec2.internal\" DevicePath \"\""
Jul 02 23:35:40.414116 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:35:40.414074    2580 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9a147935-516b-4064-82e4-39bba4ea2155-openshift-service-ca\") on node \"ip-10-0-135-187.ec2.internal\" DevicePath \"\""
Jul 02 23:35:40.414116 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:35:40.414088    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9a147935-516b-4064-82e4-39bba4ea2155-maas-api-tls\") on node \"ip-10-0-135-187.ec2.internal\" DevicePath \"\""
Jul 02 23:35:41.175629 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:35:41.175598    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-derive-ee1caf8b-fc4cb78f8-mxr94" event={"ID":"9a147935-516b-4064-82e4-39bba4ea2155","Type":"ContainerDied","Data":"8454fe087b7b94d64abcade8093cde43cd79ac1af0253b8d50ceaa76c13f7e14"}
Jul 02 23:35:41.175945 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:35:41.175666    2580 scope.go:117] "RemoveContainer" containerID="874fe76dc1465adf854aefd790d2c3c2b141efb9854f67ef4f88a005f03889c1"
Jul 02 23:35:41.175945 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:35:41.175612    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-derive-ee1caf8b-fc4cb78f8-mxr94"
Jul 02 23:35:41.186839 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:35:41.186818    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:35:41.193754 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:35:41.193732    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-derive-ee1caf8b-fc4cb78f8-mxr94"]
Jul 02 23:35:41.197618 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:35:41.197597    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-derive-ee1caf8b-fc4cb78f8-mxr94"]
Jul 02 23:35:42.429063 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:35:42.429027    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9a147935-516b-4064-82e4-39bba4ea2155" path="/var/lib/kubelet/pods/9a147935-516b-4064-82e4-39bba4ea2155/volumes"
Jul 02 23:35:45.795356 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:35:45.795316    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:35:47.136288 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:35:47.136229    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:35:47.861505 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:35:47.861470    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:35:54.065811 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:35:54.065776    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:35:54.173856 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:35:54.173820    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:35:54.280269 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:35:54.280220    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:35:54.335154 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:35:54.335082    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:35:54.767529 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:35:54.767444    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:36:18.370749 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:36:18.370709    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:36:20.707814 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:36:20.707780    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:36:26.397135 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:36:26.397089    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:36:26.457894 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:36:26.457808    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:36:26.527788 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:36:26.527756    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:36:26.629357 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:36:26.629327    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:36:42.468189 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:36:42.468144    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:36:48.120154 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:36:48.120115    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:36:48.225473 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:36:48.225440    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:36:48.322890 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:36:48.322853    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:36:58.861092 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:36:58.861050    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:36:59.643619 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:36:59.643581    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:37:05.539867 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:37:05.539833    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:37:05.701830 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:37:05.701798    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:37:05.842830 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:37:05.842759    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:37:05.937652 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:37:05.937617    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:37:06.682221 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:37:06.682179    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:37:06.773729 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:37:06.773701    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:37:06.874909 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:37:06.874880    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:37:08.469089 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:37:08.469060    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:37:14.095791 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:37:14.095761    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:37:14.164408 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:37:14.164382    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:37:14.738466 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:37:14.738435    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:37:20.428804 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:37:20.428768    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:37:20.488563 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:37:20.488529    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:37:20.668032 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:37:20.668002    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:37:20.969628 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:37:20.969594    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:37:21.360948 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:37:21.360920    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:37:23.854163 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:37:23.854116    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:37:23.959877 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:37:23.959835    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:37:24.005670 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:37:24.005643    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-mt-27a6656e-7dcf85bbdf-k26fv"]
Jul 02 23:37:24.005978 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:37:24.005967    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9a147935-516b-4064-82e4-39bba4ea2155" containerName="maas-api"
Jul 02 23:37:24.006020 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:37:24.005980    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="9a147935-516b-4064-82e4-39bba4ea2155" containerName="maas-api"
Jul 02 23:37:24.006053 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:37:24.006049    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="9a147935-516b-4064-82e4-39bba4ea2155" containerName="maas-api"
Jul 02 23:37:24.008815 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:37:24.008798    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-27a6656e-7dcf85bbdf-k26fv"
Jul 02 23:37:24.011614 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:37:24.011596    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-mt-27a6656e-serving-cert\""
Jul 02 23:37:24.022829 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:37:24.022807    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-mt-27a6656e-7dcf85bbdf-k26fv"]
Jul 02 23:37:24.027308 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:37:24.027288    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-krw8j\" (UniqueName: \"kubernetes.io/projected/e2ec3c0a-ee85-4856-9ee4-e61cd35651fc-kube-api-access-krw8j\") pod \"maas-api-e2e-mt-27a6656e-7dcf85bbdf-k26fv\" (UID: \"e2ec3c0a-ee85-4856-9ee4-e61cd35651fc\") " pod="opendatahub/maas-api-e2e-mt-27a6656e-7dcf85bbdf-k26fv"
Jul 02 23:37:24.027426 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:37:24.027323    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e2ec3c0a-ee85-4856-9ee4-e61cd35651fc-maas-api-tls\") pod \"maas-api-e2e-mt-27a6656e-7dcf85bbdf-k26fv\" (UID: \"e2ec3c0a-ee85-4856-9ee4-e61cd35651fc\") " pod="opendatahub/maas-api-e2e-mt-27a6656e-7dcf85bbdf-k26fv"
Jul 02 23:37:24.027426 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:37:24.027352    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e2ec3c0a-ee85-4856-9ee4-e61cd35651fc-openshift-service-ca\") pod \"maas-api-e2e-mt-27a6656e-7dcf85bbdf-k26fv\" (UID: \"e2ec3c0a-ee85-4856-9ee4-e61cd35651fc\") " pod="opendatahub/maas-api-e2e-mt-27a6656e-7dcf85bbdf-k26fv"
Jul 02 23:37:24.109705 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:37:24.109600    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:37:24.128880 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:37:24.128856    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-krw8j\" (UniqueName: \"kubernetes.io/projected/e2ec3c0a-ee85-4856-9ee4-e61cd35651fc-kube-api-access-krw8j\") pod \"maas-api-e2e-mt-27a6656e-7dcf85bbdf-k26fv\" (UID: \"e2ec3c0a-ee85-4856-9ee4-e61cd35651fc\") " pod="opendatahub/maas-api-e2e-mt-27a6656e-7dcf85bbdf-k26fv"
Jul 02 23:37:24.128993 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:37:24.128885    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e2ec3c0a-ee85-4856-9ee4-e61cd35651fc-maas-api-tls\") pod \"maas-api-e2e-mt-27a6656e-7dcf85bbdf-k26fv\" (UID: \"e2ec3c0a-ee85-4856-9ee4-e61cd35651fc\") " pod="opendatahub/maas-api-e2e-mt-27a6656e-7dcf85bbdf-k26fv"
Jul 02 23:37:24.128993 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:37:24.128910    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e2ec3c0a-ee85-4856-9ee4-e61cd35651fc-openshift-service-ca\") pod \"maas-api-e2e-mt-27a6656e-7dcf85bbdf-k26fv\" (UID: \"e2ec3c0a-ee85-4856-9ee4-e61cd35651fc\") " pod="opendatahub/maas-api-e2e-mt-27a6656e-7dcf85bbdf-k26fv"
Jul 02 23:37:24.129101 ip-10-0-135-187 kubenswrapper[2580]: E0702 23:37:24.129002    2580 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-mt-27a6656e-serving-cert: secret "maas-api-e2e-mt-27a6656e-serving-cert" not found
Jul 02 23:37:24.129101 ip-10-0-135-187 kubenswrapper[2580]: E0702 23:37:24.129070    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e2ec3c0a-ee85-4856-9ee4-e61cd35651fc-maas-api-tls podName:e2ec3c0a-ee85-4856-9ee4-e61cd35651fc nodeName:}" failed. No retries permitted until 2026-07-02 23:37:24.629049952 +0000 UTC m=+1630.646481134 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/e2ec3c0a-ee85-4856-9ee4-e61cd35651fc-maas-api-tls") pod "maas-api-e2e-mt-27a6656e-7dcf85bbdf-k26fv" (UID: "e2ec3c0a-ee85-4856-9ee4-e61cd35651fc") : secret "maas-api-e2e-mt-27a6656e-serving-cert" not found
Jul 02 23:37:24.129618 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:37:24.129601    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e2ec3c0a-ee85-4856-9ee4-e61cd35651fc-openshift-service-ca\") pod \"maas-api-e2e-mt-27a6656e-7dcf85bbdf-k26fv\" (UID: \"e2ec3c0a-ee85-4856-9ee4-e61cd35651fc\") " pod="opendatahub/maas-api-e2e-mt-27a6656e-7dcf85bbdf-k26fv"
Jul 02 23:37:24.138491 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:37:24.138465    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-krw8j\" (UniqueName: \"kubernetes.io/projected/e2ec3c0a-ee85-4856-9ee4-e61cd35651fc-kube-api-access-krw8j\") pod \"maas-api-e2e-mt-27a6656e-7dcf85bbdf-k26fv\" (UID: \"e2ec3c0a-ee85-4856-9ee4-e61cd35651fc\") " pod="opendatahub/maas-api-e2e-mt-27a6656e-7dcf85bbdf-k26fv"
Jul 02 23:37:24.540316 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:37:24.540281    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:37:24.633265 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:37:24.633219    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e2ec3c0a-ee85-4856-9ee4-e61cd35651fc-maas-api-tls\") pod \"maas-api-e2e-mt-27a6656e-7dcf85bbdf-k26fv\" (UID: \"e2ec3c0a-ee85-4856-9ee4-e61cd35651fc\") " pod="opendatahub/maas-api-e2e-mt-27a6656e-7dcf85bbdf-k26fv"
Jul 02 23:37:24.635774 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:37:24.635749    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e2ec3c0a-ee85-4856-9ee4-e61cd35651fc-maas-api-tls\") pod \"maas-api-e2e-mt-27a6656e-7dcf85bbdf-k26fv\" (UID: \"e2ec3c0a-ee85-4856-9ee4-e61cd35651fc\") " pod="opendatahub/maas-api-e2e-mt-27a6656e-7dcf85bbdf-k26fv"
Jul 02 23:37:24.643729 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:37:24.643692    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:37:24.744621 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:37:24.744592    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:37:24.919602 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:37:24.919532    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-27a6656e-7dcf85bbdf-k26fv"
Jul 02 23:37:25.049122 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:37:25.049093    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-mt-27a6656e-7dcf85bbdf-k26fv"]
Jul 02 23:37:25.050199 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:37:25.050176    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2ec3c0a_ee85_4856_9ee4_e61cd35651fc.slice/crio-b2d4bd3f462f60299feb85d0284957b5fb5cb2a2dfdab0e3ef2dbebd6242b4a2 WatchSource:0}: Error finding container b2d4bd3f462f60299feb85d0284957b5fb5cb2a2dfdab0e3ef2dbebd6242b4a2: Status 404 returned error can't find the container with id b2d4bd3f462f60299feb85d0284957b5fb5cb2a2dfdab0e3ef2dbebd6242b4a2
Jul 02 23:37:25.645533 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:37:25.645496    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-27a6656e-7dcf85bbdf-k26fv" event={"ID":"e2ec3c0a-ee85-4856-9ee4-e61cd35651fc","Type":"ContainerStarted","Data":"bd832d604eb2cb3afebf31524f65177e98d618579554016f3607917251cffb88"}
Jul 02 23:37:25.645684 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:37:25.645580    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-27a6656e-7dcf85bbdf-k26fv" event={"ID":"e2ec3c0a-ee85-4856-9ee4-e61cd35651fc","Type":"ContainerStarted","Data":"b2d4bd3f462f60299feb85d0284957b5fb5cb2a2dfdab0e3ef2dbebd6242b4a2"}
Jul 02 23:37:25.645684 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:37:25.645631    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-mt-27a6656e-7dcf85bbdf-k26fv"
Jul 02 23:37:25.664961 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:37:25.664914    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-mt-27a6656e-7dcf85bbdf-k26fv" podStartSLOduration=2.246159998 podStartE2EDuration="2.664899612s" totalImagesPullingTime="418.739614ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:37:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:37:25.662725995 +0000 UTC m=+1631.680157193" watchObservedRunningTime="2026-07-02 23:37:25.664899612 +0000 UTC m=+1631.682330810"
Jul 02 23:37:28.343165 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:37:28.343127    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:37:29.000889 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:37:29.000854    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:37:29.094062 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:37:29.094024    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:37:29.429141 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:37:29.429112    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:37:31.655896 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:37:31.655868    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-mt-27a6656e-7dcf85bbdf-k26fv"
Jul 02 23:37:35.139453 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:37:35.139421    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:37:35.240109 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:37:35.240073    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:37:35.554825 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:37:35.554793    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:37:35.849399 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:37:35.849325    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-mt-27a6656e-7dcf85bbdf-k26fv"]
Jul 02 23:37:35.849559 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:37:35.849507    2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-mt-27a6656e-7dcf85bbdf-k26fv" podUID="e2ec3c0a-ee85-4856-9ee4-e61cd35651fc" containerName="maas-api" containerID="cri-o://bd832d604eb2cb3afebf31524f65177e98d618579554016f3607917251cffb88" gracePeriod=30
Jul 02 23:37:35.886446 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:37:35.886412    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:37:35.987342 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:37:35.987315    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:37:36.095911 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:37:36.095882    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-27a6656e-7dcf85bbdf-k26fv"
Jul 02 23:37:36.133499 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:37:36.133437    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e2ec3c0a-ee85-4856-9ee4-e61cd35651fc-openshift-service-ca\") pod \"e2ec3c0a-ee85-4856-9ee4-e61cd35651fc\" (UID: \"e2ec3c0a-ee85-4856-9ee4-e61cd35651fc\") "
Jul 02 23:37:36.133499 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:37:36.133481    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e2ec3c0a-ee85-4856-9ee4-e61cd35651fc-maas-api-tls\") pod \"e2ec3c0a-ee85-4856-9ee4-e61cd35651fc\" (UID: \"e2ec3c0a-ee85-4856-9ee4-e61cd35651fc\") "
Jul 02 23:37:36.133707 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:37:36.133547    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-krw8j\" (UniqueName: \"kubernetes.io/projected/e2ec3c0a-ee85-4856-9ee4-e61cd35651fc-kube-api-access-krw8j\") pod \"e2ec3c0a-ee85-4856-9ee4-e61cd35651fc\" (UID: \"e2ec3c0a-ee85-4856-9ee4-e61cd35651fc\") "
Jul 02 23:37:36.133852 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:37:36.133822    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e2ec3c0a-ee85-4856-9ee4-e61cd35651fc-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "e2ec3c0a-ee85-4856-9ee4-e61cd35651fc" (UID: "e2ec3c0a-ee85-4856-9ee4-e61cd35651fc"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 23:37:36.136157 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:37:36.136128    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e2ec3c0a-ee85-4856-9ee4-e61cd35651fc-kube-api-access-krw8j" (OuterVolumeSpecName: "kube-api-access-krw8j") pod "e2ec3c0a-ee85-4856-9ee4-e61cd35651fc" (UID: "e2ec3c0a-ee85-4856-9ee4-e61cd35651fc"). InnerVolumeSpecName "kube-api-access-krw8j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 23:37:36.136275 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:37:36.136179    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e2ec3c0a-ee85-4856-9ee4-e61cd35651fc-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "e2ec3c0a-ee85-4856-9ee4-e61cd35651fc" (UID: "e2ec3c0a-ee85-4856-9ee4-e61cd35651fc"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 23:37:36.234721 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:37:36.234688    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e2ec3c0a-ee85-4856-9ee4-e61cd35651fc-maas-api-tls\") on node \"ip-10-0-135-187.ec2.internal\" DevicePath \"\""
Jul 02 23:37:36.234721 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:37:36.234717    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-krw8j\" (UniqueName: \"kubernetes.io/projected/e2ec3c0a-ee85-4856-9ee4-e61cd35651fc-kube-api-access-krw8j\") on node \"ip-10-0-135-187.ec2.internal\" DevicePath \"\""
Jul 02 23:37:36.234721 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:37:36.234727    2580 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e2ec3c0a-ee85-4856-9ee4-e61cd35651fc-openshift-service-ca\") on node \"ip-10-0-135-187.ec2.internal\" DevicePath \"\""
Jul 02 23:37:36.696511 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:37:36.696423    2580 generic.go:356] "Generic (PLEG): container finished" podID="e2ec3c0a-ee85-4856-9ee4-e61cd35651fc" containerID="bd832d604eb2cb3afebf31524f65177e98d618579554016f3607917251cffb88" exitCode=0
Jul 02 23:37:36.696511 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:37:36.696487    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-27a6656e-7dcf85bbdf-k26fv"
Jul 02 23:37:36.696740 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:37:36.696512    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-27a6656e-7dcf85bbdf-k26fv" event={"ID":"e2ec3c0a-ee85-4856-9ee4-e61cd35651fc","Type":"ContainerDied","Data":"bd832d604eb2cb3afebf31524f65177e98d618579554016f3607917251cffb88"}
Jul 02 23:37:36.696740 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:37:36.696577    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-27a6656e-7dcf85bbdf-k26fv" event={"ID":"e2ec3c0a-ee85-4856-9ee4-e61cd35651fc","Type":"ContainerDied","Data":"b2d4bd3f462f60299feb85d0284957b5fb5cb2a2dfdab0e3ef2dbebd6242b4a2"}
Jul 02 23:37:36.696740 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:37:36.696608    2580 scope.go:117] "RemoveContainer" containerID="bd832d604eb2cb3afebf31524f65177e98d618579554016f3607917251cffb88"
Jul 02 23:37:36.705114 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:37:36.705097    2580 scope.go:117] "RemoveContainer" containerID="bd832d604eb2cb3afebf31524f65177e98d618579554016f3607917251cffb88"
Jul 02 23:37:36.705438 ip-10-0-135-187 kubenswrapper[2580]: E0702 23:37:36.705418    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bd832d604eb2cb3afebf31524f65177e98d618579554016f3607917251cffb88\": container with ID starting with bd832d604eb2cb3afebf31524f65177e98d618579554016f3607917251cffb88 not found: ID does not exist" containerID="bd832d604eb2cb3afebf31524f65177e98d618579554016f3607917251cffb88"
Jul 02 23:37:36.705519 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:37:36.705450    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bd832d604eb2cb3afebf31524f65177e98d618579554016f3607917251cffb88"} err="failed to get container status \"bd832d604eb2cb3afebf31524f65177e98d618579554016f3607917251cffb88\": rpc error: code = NotFound desc = could not find container \"bd832d604eb2cb3afebf31524f65177e98d618579554016f3607917251cffb88\": container with ID starting with bd832d604eb2cb3afebf31524f65177e98d618579554016f3607917251cffb88 not found: ID does not exist"
Jul 02 23:37:36.713811 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:37:36.713792    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-mt-27a6656e-7dcf85bbdf-k26fv"]
Jul 02 23:37:36.717199 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:37:36.717181    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-mt-27a6656e-7dcf85bbdf-k26fv"]
Jul 02 23:37:38.267435 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:37:38.267400    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:37:38.368401 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:37:38.368370    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:37:38.428628 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:37:38.428601    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e2ec3c0a-ee85-4856-9ee4-e61cd35651fc" path="/var/lib/kubelet/pods/e2ec3c0a-ee85-4856-9ee4-e61cd35651fc/volumes"
Jul 02 23:37:41.898692 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:37:41.898660    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:37:42.000359 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:37:42.000331    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:37:42.185699 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:37:42.185609    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:37:42.434086 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:37:42.434043    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:37:42.561725 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:37:42.561685    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:37:42.710311 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:37:42.710280    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:37:42.843587 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:37:42.843514    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:37:48.526644 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:37:48.526601    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:37:48.589740 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:37:48.589706    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:37:48.681121 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:37:48.681087    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:37:48.780393 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:37:48.780317    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:37:48.879937 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:37:48.879906    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:37:54.725646 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:37:54.725616    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:37:54.785613 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:37:54.785583    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:38:01.128615 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:38:01.128580    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:38:01.439339 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:38:01.439228    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:38:01.639881 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:38:01.639850    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:38:04.050883 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:38:04.050853    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:38:04.112876 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:38:04.112843    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-mt-fe62b48c-7647d8f99-84r4s"]
Jul 02 23:38:04.113336 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:38:04.113317    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e2ec3c0a-ee85-4856-9ee4-e61cd35651fc" containerName="maas-api"
Jul 02 23:38:04.113414 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:38:04.113338    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="e2ec3c0a-ee85-4856-9ee4-e61cd35651fc" containerName="maas-api"
Jul 02 23:38:04.113471 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:38:04.113454    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="e2ec3c0a-ee85-4856-9ee4-e61cd35651fc" containerName="maas-api"
Jul 02 23:38:04.116255 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:38:04.116224    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-fe62b48c-7647d8f99-84r4s"
Jul 02 23:38:04.119185 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:38:04.119154    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-mt-fe62b48c-serving-cert\""
Jul 02 23:38:04.128144 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:38:04.128124    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-mt-fe62b48c-7647d8f99-84r4s"]
Jul 02 23:38:04.131882 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:38:04.131856    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:38:04.182484 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:38:04.182454    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f519a24c-efb6-4507-a99c-e6c6052d36a7-maas-api-tls\") pod \"maas-api-e2e-mt-fe62b48c-7647d8f99-84r4s\" (UID: \"f519a24c-efb6-4507-a99c-e6c6052d36a7\") " pod="opendatahub/maas-api-e2e-mt-fe62b48c-7647d8f99-84r4s"
Jul 02 23:38:04.182631 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:38:04.182488    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f519a24c-efb6-4507-a99c-e6c6052d36a7-openshift-service-ca\") pod \"maas-api-e2e-mt-fe62b48c-7647d8f99-84r4s\" (UID: \"f519a24c-efb6-4507-a99c-e6c6052d36a7\") " pod="opendatahub/maas-api-e2e-mt-fe62b48c-7647d8f99-84r4s"
Jul 02 23:38:04.182631 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:38:04.182507    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jl49x\" (UniqueName: \"kubernetes.io/projected/f519a24c-efb6-4507-a99c-e6c6052d36a7-kube-api-access-jl49x\") pod \"maas-api-e2e-mt-fe62b48c-7647d8f99-84r4s\" (UID: \"f519a24c-efb6-4507-a99c-e6c6052d36a7\") " pod="opendatahub/maas-api-e2e-mt-fe62b48c-7647d8f99-84r4s"
Jul 02 23:38:04.202455 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:38:04.202428    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:38:04.283746 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:38:04.283714    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f519a24c-efb6-4507-a99c-e6c6052d36a7-maas-api-tls\") pod \"maas-api-e2e-mt-fe62b48c-7647d8f99-84r4s\" (UID: \"f519a24c-efb6-4507-a99c-e6c6052d36a7\") " pod="opendatahub/maas-api-e2e-mt-fe62b48c-7647d8f99-84r4s"
Jul 02 23:38:04.283923 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:38:04.283752    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f519a24c-efb6-4507-a99c-e6c6052d36a7-openshift-service-ca\") pod \"maas-api-e2e-mt-fe62b48c-7647d8f99-84r4s\" (UID: \"f519a24c-efb6-4507-a99c-e6c6052d36a7\") " pod="opendatahub/maas-api-e2e-mt-fe62b48c-7647d8f99-84r4s"
Jul 02 23:38:04.283923 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:38:04.283779    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jl49x\" (UniqueName: \"kubernetes.io/projected/f519a24c-efb6-4507-a99c-e6c6052d36a7-kube-api-access-jl49x\") pod \"maas-api-e2e-mt-fe62b48c-7647d8f99-84r4s\" (UID: \"f519a24c-efb6-4507-a99c-e6c6052d36a7\") " pod="opendatahub/maas-api-e2e-mt-fe62b48c-7647d8f99-84r4s"
Jul 02 23:38:04.283923 ip-10-0-135-187 kubenswrapper[2580]: E0702 23:38:04.283893    2580 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-mt-fe62b48c-serving-cert: secret "maas-api-e2e-mt-fe62b48c-serving-cert" not found
Jul 02 23:38:04.284099 ip-10-0-135-187 kubenswrapper[2580]: E0702 23:38:04.283946    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f519a24c-efb6-4507-a99c-e6c6052d36a7-maas-api-tls podName:f519a24c-efb6-4507-a99c-e6c6052d36a7 nodeName:}" failed. No retries permitted until 2026-07-02 23:38:04.783931211 +0000 UTC m=+1670.801362386 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/f519a24c-efb6-4507-a99c-e6c6052d36a7-maas-api-tls") pod "maas-api-e2e-mt-fe62b48c-7647d8f99-84r4s" (UID: "f519a24c-efb6-4507-a99c-e6c6052d36a7") : secret "maas-api-e2e-mt-fe62b48c-serving-cert" not found
Jul 02 23:38:04.284390 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:38:04.284370    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f519a24c-efb6-4507-a99c-e6c6052d36a7-openshift-service-ca\") pod \"maas-api-e2e-mt-fe62b48c-7647d8f99-84r4s\" (UID: \"f519a24c-efb6-4507-a99c-e6c6052d36a7\") " pod="opendatahub/maas-api-e2e-mt-fe62b48c-7647d8f99-84r4s"
Jul 02 23:38:04.304556 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:38:04.304497    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jl49x\" (UniqueName: \"kubernetes.io/projected/f519a24c-efb6-4507-a99c-e6c6052d36a7-kube-api-access-jl49x\") pod \"maas-api-e2e-mt-fe62b48c-7647d8f99-84r4s\" (UID: \"f519a24c-efb6-4507-a99c-e6c6052d36a7\") " pod="opendatahub/maas-api-e2e-mt-fe62b48c-7647d8f99-84r4s"
Jul 02 23:38:04.474420 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:38:04.474384    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:38:04.753685 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:38:04.753594    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:38:04.787355 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:38:04.787327    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f519a24c-efb6-4507-a99c-e6c6052d36a7-maas-api-tls\") pod \"maas-api-e2e-mt-fe62b48c-7647d8f99-84r4s\" (UID: \"f519a24c-efb6-4507-a99c-e6c6052d36a7\") " pod="opendatahub/maas-api-e2e-mt-fe62b48c-7647d8f99-84r4s"
Jul 02 23:38:04.789713 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:38:04.789693    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f519a24c-efb6-4507-a99c-e6c6052d36a7-maas-api-tls\") pod \"maas-api-e2e-mt-fe62b48c-7647d8f99-84r4s\" (UID: \"f519a24c-efb6-4507-a99c-e6c6052d36a7\") " pod="opendatahub/maas-api-e2e-mt-fe62b48c-7647d8f99-84r4s"
Jul 02 23:38:04.850861 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:38:04.850827    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:38:05.027929 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:38:05.027898    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-fe62b48c-7647d8f99-84r4s"
Jul 02 23:38:05.154670 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:38:05.154645    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-mt-fe62b48c-7647d8f99-84r4s"]
Jul 02 23:38:05.156724 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:38:05.156691    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf519a24c_efb6_4507_a99c_e6c6052d36a7.slice/crio-0d600e5bd391fa4c8d3edcbb2427b489f16fcea7932636651f2ac3ef7ce8e54a WatchSource:0}: Error finding container 0d600e5bd391fa4c8d3edcbb2427b489f16fcea7932636651f2ac3ef7ce8e54a: Status 404 returned error can't find the container with id 0d600e5bd391fa4c8d3edcbb2427b489f16fcea7932636651f2ac3ef7ce8e54a
Jul 02 23:38:05.830258 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:38:05.830162    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-fe62b48c-7647d8f99-84r4s" event={"ID":"f519a24c-efb6-4507-a99c-e6c6052d36a7","Type":"ContainerStarted","Data":"6abe65a27df75c8b61c7cc15610a80b856ae96af62ea944febee632a0ddb5da1"}
Jul 02 23:38:05.830258 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:38:05.830216    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-fe62b48c-7647d8f99-84r4s" event={"ID":"f519a24c-efb6-4507-a99c-e6c6052d36a7","Type":"ContainerStarted","Data":"0d600e5bd391fa4c8d3edcbb2427b489f16fcea7932636651f2ac3ef7ce8e54a"}
Jul 02 23:38:05.830457 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:38:05.830353    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-mt-fe62b48c-7647d8f99-84r4s"
Jul 02 23:38:05.850081 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:38:05.850034    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-mt-fe62b48c-7647d8f99-84r4s" podStartSLOduration=1.4722774840000001 podStartE2EDuration="1.850018945s" totalImagesPullingTime="377.741461ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:38:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:38:05.847533758 +0000 UTC m=+1671.864964958" watchObservedRunningTime="2026-07-02 23:38:05.850018945 +0000 UTC m=+1671.867450142"
Jul 02 23:38:08.547839 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:38:08.547807    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:38:11.840513 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:38:11.840480    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-mt-fe62b48c-7647d8f99-84r4s"
Jul 02 23:38:24.905091 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:38:24.905063    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:38:25.005737 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:38:25.005700    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:38:25.606699 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:38:25.606667    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:38:25.722759 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:38:25.722730    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:40:33.029669 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:40:33.029635    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:41:13.411501 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:41:13.411463    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:41:13.706821 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:41:13.706742    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-mt-fe62b48c-7647d8f99-84r4s"]
Jul 02 23:41:13.707015 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:41:13.706990    2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-mt-fe62b48c-7647d8f99-84r4s" podUID="f519a24c-efb6-4507-a99c-e6c6052d36a7" containerName="maas-api" containerID="cri-o://6abe65a27df75c8b61c7cc15610a80b856ae96af62ea944febee632a0ddb5da1" gracePeriod=30
Jul 02 23:41:13.963764 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:41:13.963714    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-fe62b48c-7647d8f99-84r4s"
Jul 02 23:41:14.088236 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:41:14.088207    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f519a24c-efb6-4507-a99c-e6c6052d36a7-maas-api-tls\") pod \"f519a24c-efb6-4507-a99c-e6c6052d36a7\" (UID: \"f519a24c-efb6-4507-a99c-e6c6052d36a7\") "
Jul 02 23:41:14.088404 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:41:14.088330    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f519a24c-efb6-4507-a99c-e6c6052d36a7-openshift-service-ca\") pod \"f519a24c-efb6-4507-a99c-e6c6052d36a7\" (UID: \"f519a24c-efb6-4507-a99c-e6c6052d36a7\") "
Jul 02 23:41:14.088404 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:41:14.088358    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jl49x\" (UniqueName: \"kubernetes.io/projected/f519a24c-efb6-4507-a99c-e6c6052d36a7-kube-api-access-jl49x\") pod \"f519a24c-efb6-4507-a99c-e6c6052d36a7\" (UID: \"f519a24c-efb6-4507-a99c-e6c6052d36a7\") "
Jul 02 23:41:14.088689 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:41:14.088668    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f519a24c-efb6-4507-a99c-e6c6052d36a7-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "f519a24c-efb6-4507-a99c-e6c6052d36a7" (UID: "f519a24c-efb6-4507-a99c-e6c6052d36a7"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 23:41:14.090393 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:41:14.090366    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f519a24c-efb6-4507-a99c-e6c6052d36a7-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "f519a24c-efb6-4507-a99c-e6c6052d36a7" (UID: "f519a24c-efb6-4507-a99c-e6c6052d36a7"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 23:41:14.090488 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:41:14.090467    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f519a24c-efb6-4507-a99c-e6c6052d36a7-kube-api-access-jl49x" (OuterVolumeSpecName: "kube-api-access-jl49x") pod "f519a24c-efb6-4507-a99c-e6c6052d36a7" (UID: "f519a24c-efb6-4507-a99c-e6c6052d36a7"). InnerVolumeSpecName "kube-api-access-jl49x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 23:41:14.188926 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:41:14.188892    2580 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f519a24c-efb6-4507-a99c-e6c6052d36a7-openshift-service-ca\") on node \"ip-10-0-135-187.ec2.internal\" DevicePath \"\""
Jul 02 23:41:14.188926 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:41:14.188921    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jl49x\" (UniqueName: \"kubernetes.io/projected/f519a24c-efb6-4507-a99c-e6c6052d36a7-kube-api-access-jl49x\") on node \"ip-10-0-135-187.ec2.internal\" DevicePath \"\""
Jul 02 23:41:14.188926 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:41:14.188931    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f519a24c-efb6-4507-a99c-e6c6052d36a7-maas-api-tls\") on node \"ip-10-0-135-187.ec2.internal\" DevicePath \"\""
Jul 02 23:41:14.495769 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:41:14.495737    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:41:14.662558 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:41:14.662519    2580 generic.go:356] "Generic (PLEG): container finished" podID="f519a24c-efb6-4507-a99c-e6c6052d36a7" containerID="6abe65a27df75c8b61c7cc15610a80b856ae96af62ea944febee632a0ddb5da1" exitCode=0
Jul 02 23:41:14.662729 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:41:14.662570    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-fe62b48c-7647d8f99-84r4s"
Jul 02 23:41:14.662729 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:41:14.662603    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-fe62b48c-7647d8f99-84r4s" event={"ID":"f519a24c-efb6-4507-a99c-e6c6052d36a7","Type":"ContainerDied","Data":"6abe65a27df75c8b61c7cc15610a80b856ae96af62ea944febee632a0ddb5da1"}
Jul 02 23:41:14.662729 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:41:14.662663    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-fe62b48c-7647d8f99-84r4s" event={"ID":"f519a24c-efb6-4507-a99c-e6c6052d36a7","Type":"ContainerDied","Data":"0d600e5bd391fa4c8d3edcbb2427b489f16fcea7932636651f2ac3ef7ce8e54a"}
Jul 02 23:41:14.662729 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:41:14.662685    2580 scope.go:117] "RemoveContainer" containerID="6abe65a27df75c8b61c7cc15610a80b856ae96af62ea944febee632a0ddb5da1"
Jul 02 23:41:14.671894 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:41:14.671874    2580 scope.go:117] "RemoveContainer" containerID="6abe65a27df75c8b61c7cc15610a80b856ae96af62ea944febee632a0ddb5da1"
Jul 02 23:41:14.672163 ip-10-0-135-187 kubenswrapper[2580]: E0702 23:41:14.672143    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6abe65a27df75c8b61c7cc15610a80b856ae96af62ea944febee632a0ddb5da1\": container with ID starting with 6abe65a27df75c8b61c7cc15610a80b856ae96af62ea944febee632a0ddb5da1 not found: ID does not exist" containerID="6abe65a27df75c8b61c7cc15610a80b856ae96af62ea944febee632a0ddb5da1"
Jul 02 23:41:14.672230 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:41:14.672170    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6abe65a27df75c8b61c7cc15610a80b856ae96af62ea944febee632a0ddb5da1"} err="failed to get container status \"6abe65a27df75c8b61c7cc15610a80b856ae96af62ea944febee632a0ddb5da1\": rpc error: code = NotFound desc = could not find container \"6abe65a27df75c8b61c7cc15610a80b856ae96af62ea944febee632a0ddb5da1\": container with ID starting with 6abe65a27df75c8b61c7cc15610a80b856ae96af62ea944febee632a0ddb5da1 not found: ID does not exist"
Jul 02 23:41:14.680338 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:41:14.680315    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-mt-fe62b48c-7647d8f99-84r4s"]
Jul 02 23:41:14.684615 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:41:14.684591    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-mt-fe62b48c-7647d8f99-84r4s"]
Jul 02 23:41:16.428565 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:41:16.428533    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f519a24c-efb6-4507-a99c-e6c6052d36a7" path="/var/lib/kubelet/pods/f519a24c-efb6-4507-a99c-e6c6052d36a7/volumes"
Jul 02 23:41:19.769059 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:41:19.769012    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:41:19.828386 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:41:19.828357    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:41:20.051512 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:41:20.051481    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:41:20.272554 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:41:20.272516    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:41:21.414357 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:41:21.414327    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:41:21.512196 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:41:21.512161    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:41:21.612144 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:41:21.612097    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:41:22.335742 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:41:22.335707    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:41:22.433917 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:41:22.433885    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:41:22.534769 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:41:22.534731    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:41:23.913550 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:41:23.913523    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:41:29.702989 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:41:29.702956    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:41:29.760663 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:41:29.760633    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:41:30.396370 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:41:30.396337    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:41:36.030370 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:41:36.030320    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:41:36.095919 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:41:36.095885    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:41:36.168567 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:41:36.168500    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:41:36.267449 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:41:36.267410    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:41:46.742169 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:41:46.742136    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:41:47.088600 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:41:47.088565    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:42:08.058451 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:42:08.058416    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:42:13.867402 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:42:13.867365    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:42:13.933958 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:42:13.933925    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:42:14.224213 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:42:14.224075    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:42:14.555098 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:42:14.555071    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:42:14.722325 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:42:14.722290    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:42:17.357800 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:42:17.357768    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:42:17.425613 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:42:17.425577    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-inf-a-1ef970-5d6cb45775-sx77b"]
Jul 02 23:42:17.425984 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:42:17.425954    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f519a24c-efb6-4507-a99c-e6c6052d36a7" containerName="maas-api"
Jul 02 23:42:17.425984 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:42:17.425970    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="f519a24c-efb6-4507-a99c-e6c6052d36a7" containerName="maas-api"
Jul 02 23:42:17.426174 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:42:17.426027    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="f519a24c-efb6-4507-a99c-e6c6052d36a7" containerName="maas-api"
Jul 02 23:42:17.428915 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:42:17.428895    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-a-1ef970-5d6cb45775-sx77b"
Jul 02 23:42:17.432413 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:42:17.432388    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-inf-a-1ef970-serving-cert\""
Jul 02 23:42:17.440490 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:42:17.440467    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-1ef970-5d6cb45775-sx77b"]
Jul 02 23:42:17.441472 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:42:17.441451    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:42:17.541650 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:42:17.541607    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:42:17.548662 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:42:17.548631    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e3a7d069-289a-4efc-a94a-4e8dfd860726-openshift-service-ca\") pod \"maas-api-e2e-inf-a-1ef970-5d6cb45775-sx77b\" (UID: \"e3a7d069-289a-4efc-a94a-4e8dfd860726\") " pod="opendatahub/maas-api-e2e-inf-a-1ef970-5d6cb45775-sx77b"
Jul 02 23:42:17.548817 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:42:17.548686    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e3a7d069-289a-4efc-a94a-4e8dfd860726-maas-api-tls\") pod \"maas-api-e2e-inf-a-1ef970-5d6cb45775-sx77b\" (UID: \"e3a7d069-289a-4efc-a94a-4e8dfd860726\") " pod="opendatahub/maas-api-e2e-inf-a-1ef970-5d6cb45775-sx77b"
Jul 02 23:42:17.548817 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:42:17.548717    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dnm8l\" (UniqueName: \"kubernetes.io/projected/e3a7d069-289a-4efc-a94a-4e8dfd860726-kube-api-access-dnm8l\") pod \"maas-api-e2e-inf-a-1ef970-5d6cb45775-sx77b\" (UID: \"e3a7d069-289a-4efc-a94a-4e8dfd860726\") " pod="opendatahub/maas-api-e2e-inf-a-1ef970-5d6cb45775-sx77b"
Jul 02 23:42:17.650280 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:42:17.650161    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e3a7d069-289a-4efc-a94a-4e8dfd860726-openshift-service-ca\") pod \"maas-api-e2e-inf-a-1ef970-5d6cb45775-sx77b\" (UID: \"e3a7d069-289a-4efc-a94a-4e8dfd860726\") " pod="opendatahub/maas-api-e2e-inf-a-1ef970-5d6cb45775-sx77b"
Jul 02 23:42:17.650280 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:42:17.650214    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e3a7d069-289a-4efc-a94a-4e8dfd860726-maas-api-tls\") pod \"maas-api-e2e-inf-a-1ef970-5d6cb45775-sx77b\" (UID: \"e3a7d069-289a-4efc-a94a-4e8dfd860726\") " pod="opendatahub/maas-api-e2e-inf-a-1ef970-5d6cb45775-sx77b"
Jul 02 23:42:17.650514 ip-10-0-135-187 kubenswrapper[2580]: E0702 23:42:17.650335    2580 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-inf-a-1ef970-serving-cert: secret "maas-api-e2e-inf-a-1ef970-serving-cert" not found
Jul 02 23:42:17.650514 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:42:17.650349    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dnm8l\" (UniqueName: \"kubernetes.io/projected/e3a7d069-289a-4efc-a94a-4e8dfd860726-kube-api-access-dnm8l\") pod \"maas-api-e2e-inf-a-1ef970-5d6cb45775-sx77b\" (UID: \"e3a7d069-289a-4efc-a94a-4e8dfd860726\") " pod="opendatahub/maas-api-e2e-inf-a-1ef970-5d6cb45775-sx77b"
Jul 02 23:42:17.650514 ip-10-0-135-187 kubenswrapper[2580]: E0702 23:42:17.650412    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e3a7d069-289a-4efc-a94a-4e8dfd860726-maas-api-tls podName:e3a7d069-289a-4efc-a94a-4e8dfd860726 nodeName:}" failed. No retries permitted until 2026-07-02 23:42:18.150389864 +0000 UTC m=+1924.167821053 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/e3a7d069-289a-4efc-a94a-4e8dfd860726-maas-api-tls") pod "maas-api-e2e-inf-a-1ef970-5d6cb45775-sx77b" (UID: "e3a7d069-289a-4efc-a94a-4e8dfd860726") : secret "maas-api-e2e-inf-a-1ef970-serving-cert" not found
Jul 02 23:42:17.650984 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:42:17.650963    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e3a7d069-289a-4efc-a94a-4e8dfd860726-openshift-service-ca\") pod \"maas-api-e2e-inf-a-1ef970-5d6cb45775-sx77b\" (UID: \"e3a7d069-289a-4efc-a94a-4e8dfd860726\") " pod="opendatahub/maas-api-e2e-inf-a-1ef970-5d6cb45775-sx77b"
Jul 02 23:42:17.659616 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:42:17.659583    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dnm8l\" (UniqueName: \"kubernetes.io/projected/e3a7d069-289a-4efc-a94a-4e8dfd860726-kube-api-access-dnm8l\") pod \"maas-api-e2e-inf-a-1ef970-5d6cb45775-sx77b\" (UID: \"e3a7d069-289a-4efc-a94a-4e8dfd860726\") " pod="opendatahub/maas-api-e2e-inf-a-1ef970-5d6cb45775-sx77b"
Jul 02 23:42:17.830682 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:42:17.830650    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:42:18.000634 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:42:18.000544    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:42:18.102372 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:42:18.102343    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:42:18.155631 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:42:18.155595    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e3a7d069-289a-4efc-a94a-4e8dfd860726-maas-api-tls\") pod \"maas-api-e2e-inf-a-1ef970-5d6cb45775-sx77b\" (UID: \"e3a7d069-289a-4efc-a94a-4e8dfd860726\") " pod="opendatahub/maas-api-e2e-inf-a-1ef970-5d6cb45775-sx77b"
Jul 02 23:42:18.158213 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:42:18.158190    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e3a7d069-289a-4efc-a94a-4e8dfd860726-maas-api-tls\") pod \"maas-api-e2e-inf-a-1ef970-5d6cb45775-sx77b\" (UID: \"e3a7d069-289a-4efc-a94a-4e8dfd860726\") " pod="opendatahub/maas-api-e2e-inf-a-1ef970-5d6cb45775-sx77b"
Jul 02 23:42:18.342137 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:42:18.342095    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-a-1ef970-5d6cb45775-sx77b"
Jul 02 23:42:18.473167 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:42:18.473128    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-1ef970-5d6cb45775-sx77b"]
Jul 02 23:42:18.473563 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:42:18.473500    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3a7d069_289a_4efc_a94a_4e8dfd860726.slice/crio-a411b9f618d90f5fa24cd6cf66a2f3e206cc97e5c19935b94f92bf2056d00d88 WatchSource:0}: Error finding container a411b9f618d90f5fa24cd6cf66a2f3e206cc97e5c19935b94f92bf2056d00d88: Status 404 returned error can't find the container with id a411b9f618d90f5fa24cd6cf66a2f3e206cc97e5c19935b94f92bf2056d00d88
Jul 02 23:42:18.475126 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:42:18.475107    2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 02 23:42:18.954890 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:42:18.954856    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-a-1ef970-5d6cb45775-sx77b" event={"ID":"e3a7d069-289a-4efc-a94a-4e8dfd860726","Type":"ContainerStarted","Data":"a411b9f618d90f5fa24cd6cf66a2f3e206cc97e5c19935b94f92bf2056d00d88"}
Jul 02 23:42:19.961107 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:42:19.961067    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-a-1ef970-5d6cb45775-sx77b" event={"ID":"e3a7d069-289a-4efc-a94a-4e8dfd860726","Type":"ContainerStarted","Data":"d401b9c7dfa5cf16bbf636046026d7e05283d85505a0128c99641953db57a25d"}
Jul 02 23:42:19.961513 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:42:19.961185    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-inf-a-1ef970-5d6cb45775-sx77b"
Jul 02 23:42:19.979430 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:42:19.979377    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-inf-a-1ef970-5d6cb45775-sx77b" podStartSLOduration=2.478859676 podStartE2EDuration="2.979358718s" totalImagesPullingTime="500.499042ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:42:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:42:19.979009433 +0000 UTC m=+1925.996440632" watchObservedRunningTime="2026-07-02 23:42:19.979358718 +0000 UTC m=+1925.996789916"
Jul 02 23:42:21.840141 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:42:21.840105    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:42:22.170027 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:42:22.169947    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:42:22.481666 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:42:22.481570    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:42:22.953575 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:42:22.953541    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:42:25.387742 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:42:25.387707    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:42:25.491759 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:42:25.491729    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-inf-b-20977a-68cb48c45b-lwpqp"]
Jul 02 23:42:25.495304 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:42:25.495284    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-b-20977a-68cb48c45b-lwpqp"
Jul 02 23:42:25.499464 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:42:25.499442    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-inf-b-20977a-serving-cert\""
Jul 02 23:42:25.501102 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:42:25.501080    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:42:25.515764 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:42:25.515740    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-20977a-68cb48c45b-lwpqp"]
Jul 02 23:42:25.525929 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:42:25.525900    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/74b56d8e-544d-4db4-aa1f-9985d0f05dbf-openshift-service-ca\") pod \"maas-api-e2e-inf-b-20977a-68cb48c45b-lwpqp\" (UID: \"74b56d8e-544d-4db4-aa1f-9985d0f05dbf\") " pod="opendatahub/maas-api-e2e-inf-b-20977a-68cb48c45b-lwpqp"
Jul 02 23:42:25.526070 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:42:25.525966    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/74b56d8e-544d-4db4-aa1f-9985d0f05dbf-maas-api-tls\") pod \"maas-api-e2e-inf-b-20977a-68cb48c45b-lwpqp\" (UID: \"74b56d8e-544d-4db4-aa1f-9985d0f05dbf\") " pod="opendatahub/maas-api-e2e-inf-b-20977a-68cb48c45b-lwpqp"
Jul 02 23:42:25.526139 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:42:25.526066    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kzfv7\" (UniqueName: \"kubernetes.io/projected/74b56d8e-544d-4db4-aa1f-9985d0f05dbf-kube-api-access-kzfv7\") pod \"maas-api-e2e-inf-b-20977a-68cb48c45b-lwpqp\" (UID: \"74b56d8e-544d-4db4-aa1f-9985d0f05dbf\") " pod="opendatahub/maas-api-e2e-inf-b-20977a-68cb48c45b-lwpqp"
Jul 02 23:42:25.583309 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:42:25.583270    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:42:25.626897 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:42:25.626868    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kzfv7\" (UniqueName: \"kubernetes.io/projected/74b56d8e-544d-4db4-aa1f-9985d0f05dbf-kube-api-access-kzfv7\") pod \"maas-api-e2e-inf-b-20977a-68cb48c45b-lwpqp\" (UID: \"74b56d8e-544d-4db4-aa1f-9985d0f05dbf\") " pod="opendatahub/maas-api-e2e-inf-b-20977a-68cb48c45b-lwpqp"
Jul 02 23:42:25.627047 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:42:25.626927    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/74b56d8e-544d-4db4-aa1f-9985d0f05dbf-openshift-service-ca\") pod \"maas-api-e2e-inf-b-20977a-68cb48c45b-lwpqp\" (UID: \"74b56d8e-544d-4db4-aa1f-9985d0f05dbf\") " pod="opendatahub/maas-api-e2e-inf-b-20977a-68cb48c45b-lwpqp"
Jul 02 23:42:25.627047 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:42:25.626999    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/74b56d8e-544d-4db4-aa1f-9985d0f05dbf-maas-api-tls\") pod \"maas-api-e2e-inf-b-20977a-68cb48c45b-lwpqp\" (UID: \"74b56d8e-544d-4db4-aa1f-9985d0f05dbf\") " pod="opendatahub/maas-api-e2e-inf-b-20977a-68cb48c45b-lwpqp"
Jul 02 23:42:25.627187 ip-10-0-135-187 kubenswrapper[2580]: E0702 23:42:25.627114    2580 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-inf-b-20977a-serving-cert: secret "maas-api-e2e-inf-b-20977a-serving-cert" not found
Jul 02 23:42:25.627187 ip-10-0-135-187 kubenswrapper[2580]: E0702 23:42:25.627185    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/74b56d8e-544d-4db4-aa1f-9985d0f05dbf-maas-api-tls podName:74b56d8e-544d-4db4-aa1f-9985d0f05dbf nodeName:}" failed. No retries permitted until 2026-07-02 23:42:26.127163212 +0000 UTC m=+1932.144594403 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/74b56d8e-544d-4db4-aa1f-9985d0f05dbf-maas-api-tls") pod "maas-api-e2e-inf-b-20977a-68cb48c45b-lwpqp" (UID: "74b56d8e-544d-4db4-aa1f-9985d0f05dbf") : secret "maas-api-e2e-inf-b-20977a-serving-cert" not found
Jul 02 23:42:25.627613 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:42:25.627593    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/74b56d8e-544d-4db4-aa1f-9985d0f05dbf-openshift-service-ca\") pod \"maas-api-e2e-inf-b-20977a-68cb48c45b-lwpqp\" (UID: \"74b56d8e-544d-4db4-aa1f-9985d0f05dbf\") " pod="opendatahub/maas-api-e2e-inf-b-20977a-68cb48c45b-lwpqp"
Jul 02 23:42:25.638271 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:42:25.638203    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kzfv7\" (UniqueName: \"kubernetes.io/projected/74b56d8e-544d-4db4-aa1f-9985d0f05dbf-kube-api-access-kzfv7\") pod \"maas-api-e2e-inf-b-20977a-68cb48c45b-lwpqp\" (UID: \"74b56d8e-544d-4db4-aa1f-9985d0f05dbf\") " pod="opendatahub/maas-api-e2e-inf-b-20977a-68cb48c45b-lwpqp"
Jul 02 23:42:25.798965 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:42:25.798929    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:42:25.971278 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:42:25.971187    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-inf-a-1ef970-5d6cb45775-sx77b"
Jul 02 23:42:26.071027 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:42:26.070996    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:42:26.132988 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:42:26.132953    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/74b56d8e-544d-4db4-aa1f-9985d0f05dbf-maas-api-tls\") pod \"maas-api-e2e-inf-b-20977a-68cb48c45b-lwpqp\" (UID: \"74b56d8e-544d-4db4-aa1f-9985d0f05dbf\") " pod="opendatahub/maas-api-e2e-inf-b-20977a-68cb48c45b-lwpqp"
Jul 02 23:42:26.135341 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:42:26.135310    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/74b56d8e-544d-4db4-aa1f-9985d0f05dbf-maas-api-tls\") pod \"maas-api-e2e-inf-b-20977a-68cb48c45b-lwpqp\" (UID: \"74b56d8e-544d-4db4-aa1f-9985d0f05dbf\") " pod="opendatahub/maas-api-e2e-inf-b-20977a-68cb48c45b-lwpqp"
Jul 02 23:42:26.167732 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:42:26.167704    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:42:26.407221 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:42:26.407186    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-b-20977a-68cb48c45b-lwpqp"
Jul 02 23:42:26.537581 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:42:26.537396    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-20977a-68cb48c45b-lwpqp"]
Jul 02 23:42:26.539978 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:42:26.539953    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod74b56d8e_544d_4db4_aa1f_9985d0f05dbf.slice/crio-2dd5e93c8ca2055d9b1f98ed9c1b57a559b1359039afcadcb2e339defee9c8bb WatchSource:0}: Error finding container 2dd5e93c8ca2055d9b1f98ed9c1b57a559b1359039afcadcb2e339defee9c8bb: Status 404 returned error can't find the container with id 2dd5e93c8ca2055d9b1f98ed9c1b57a559b1359039afcadcb2e339defee9c8bb
Jul 02 23:42:26.992164 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:42:26.992128    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-b-20977a-68cb48c45b-lwpqp" event={"ID":"74b56d8e-544d-4db4-aa1f-9985d0f05dbf","Type":"ContainerStarted","Data":"33cbd06eab320ff10291fb6d15f966ea0b0c0a8b88dfd8fe2e397f5155c97f8e"}
Jul 02 23:42:26.992345 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:42:26.992184    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-b-20977a-68cb48c45b-lwpqp" event={"ID":"74b56d8e-544d-4db4-aa1f-9985d0f05dbf","Type":"ContainerStarted","Data":"2dd5e93c8ca2055d9b1f98ed9c1b57a559b1359039afcadcb2e339defee9c8bb"}
Jul 02 23:42:26.992345 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:42:26.992211    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-inf-b-20977a-68cb48c45b-lwpqp"
Jul 02 23:42:27.015585 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:42:27.015522    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-inf-b-20977a-68cb48c45b-lwpqp" podStartSLOduration=1.716924509 podStartE2EDuration="2.015507268s" totalImagesPullingTime="298.582759ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:42:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:42:27.014061573 +0000 UTC m=+1933.031492771" watchObservedRunningTime="2026-07-02 23:42:27.015507268 +0000 UTC m=+1933.032938718"
Jul 02 23:42:29.853671 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:42:29.853642    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:42:33.002301 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:42:33.002269    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-inf-b-20977a-68cb48c45b-lwpqp"
Jul 02 23:42:38.718730 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:42:38.718688    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:42:38.831561 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:42:38.831524    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:42:46.805596 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:42:46.805561    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:42:46.919938 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:42:46.919904    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:42:55.517107 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:42:55.517076    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:43:15.708930 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:43:15.708896    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:43:17.814300 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:43:17.814253    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:43:25.601855 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:43:25.601798    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:43:25.700712 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:43:25.700674    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:43:38.618549 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:43:38.618516    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:43:39.503326 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:43:39.503286    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:43:39.681256 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:43:39.681214    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:43:40.082023 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:43:40.081990    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:43:40.191540 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:43:40.191511    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:43:40.292659 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:43:40.292633    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:43:40.414094 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:43:40.414022    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-1ef970-5d6cb45775-sx77b"]
Jul 02 23:43:40.414295 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:43:40.414272    2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-inf-a-1ef970-5d6cb45775-sx77b" podUID="e3a7d069-289a-4efc-a94a-4e8dfd860726" containerName="maas-api" containerID="cri-o://d401b9c7dfa5cf16bbf636046026d7e05283d85505a0128c99641953db57a25d" gracePeriod=30
Jul 02 23:43:40.444461 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:43:40.444431    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:43:40.658854 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:43:40.658831    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-a-1ef970-5d6cb45775-sx77b"
Jul 02 23:43:40.788903 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:43:40.788878    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e3a7d069-289a-4efc-a94a-4e8dfd860726-openshift-service-ca\") pod \"e3a7d069-289a-4efc-a94a-4e8dfd860726\" (UID: \"e3a7d069-289a-4efc-a94a-4e8dfd860726\") "
Jul 02 23:43:40.789379 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:43:40.788924    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dnm8l\" (UniqueName: \"kubernetes.io/projected/e3a7d069-289a-4efc-a94a-4e8dfd860726-kube-api-access-dnm8l\") pod \"e3a7d069-289a-4efc-a94a-4e8dfd860726\" (UID: \"e3a7d069-289a-4efc-a94a-4e8dfd860726\") "
Jul 02 23:43:40.789379 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:43:40.788971    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e3a7d069-289a-4efc-a94a-4e8dfd860726-maas-api-tls\") pod \"e3a7d069-289a-4efc-a94a-4e8dfd860726\" (UID: \"e3a7d069-289a-4efc-a94a-4e8dfd860726\") "
Jul 02 23:43:40.789379 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:43:40.789310    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e3a7d069-289a-4efc-a94a-4e8dfd860726-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "e3a7d069-289a-4efc-a94a-4e8dfd860726" (UID: "e3a7d069-289a-4efc-a94a-4e8dfd860726"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 23:43:40.791006 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:43:40.790987    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e3a7d069-289a-4efc-a94a-4e8dfd860726-kube-api-access-dnm8l" (OuterVolumeSpecName: "kube-api-access-dnm8l") pod "e3a7d069-289a-4efc-a94a-4e8dfd860726" (UID: "e3a7d069-289a-4efc-a94a-4e8dfd860726"). InnerVolumeSpecName "kube-api-access-dnm8l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 23:43:40.791058 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:43:40.790997    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e3a7d069-289a-4efc-a94a-4e8dfd860726-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "e3a7d069-289a-4efc-a94a-4e8dfd860726" (UID: "e3a7d069-289a-4efc-a94a-4e8dfd860726"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 23:43:40.890301 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:43:40.890272    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dnm8l\" (UniqueName: \"kubernetes.io/projected/e3a7d069-289a-4efc-a94a-4e8dfd860726-kube-api-access-dnm8l\") on node \"ip-10-0-135-187.ec2.internal\" DevicePath \"\""
Jul 02 23:43:40.890301 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:43:40.890299    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e3a7d069-289a-4efc-a94a-4e8dfd860726-maas-api-tls\") on node \"ip-10-0-135-187.ec2.internal\" DevicePath \"\""
Jul 02 23:43:40.890301 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:43:40.890307    2580 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e3a7d069-289a-4efc-a94a-4e8dfd860726-openshift-service-ca\") on node \"ip-10-0-135-187.ec2.internal\" DevicePath \"\""
Jul 02 23:43:41.324127 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:43:41.324091    2580 generic.go:356] "Generic (PLEG): container finished" podID="e3a7d069-289a-4efc-a94a-4e8dfd860726" containerID="d401b9c7dfa5cf16bbf636046026d7e05283d85505a0128c99641953db57a25d" exitCode=0
Jul 02 23:43:41.324305 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:43:41.324135    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-a-1ef970-5d6cb45775-sx77b"
Jul 02 23:43:41.324305 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:43:41.324176    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-a-1ef970-5d6cb45775-sx77b" event={"ID":"e3a7d069-289a-4efc-a94a-4e8dfd860726","Type":"ContainerDied","Data":"d401b9c7dfa5cf16bbf636046026d7e05283d85505a0128c99641953db57a25d"}
Jul 02 23:43:41.324305 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:43:41.324226    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-a-1ef970-5d6cb45775-sx77b" event={"ID":"e3a7d069-289a-4efc-a94a-4e8dfd860726","Type":"ContainerDied","Data":"a411b9f618d90f5fa24cd6cf66a2f3e206cc97e5c19935b94f92bf2056d00d88"}
Jul 02 23:43:41.324305 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:43:41.324265    2580 scope.go:117] "RemoveContainer" containerID="d401b9c7dfa5cf16bbf636046026d7e05283d85505a0128c99641953db57a25d"
Jul 02 23:43:41.332733 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:43:41.332719    2580 scope.go:117] "RemoveContainer" containerID="d401b9c7dfa5cf16bbf636046026d7e05283d85505a0128c99641953db57a25d"
Jul 02 23:43:41.332997 ip-10-0-135-187 kubenswrapper[2580]: E0702 23:43:41.332980    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d401b9c7dfa5cf16bbf636046026d7e05283d85505a0128c99641953db57a25d\": container with ID starting with d401b9c7dfa5cf16bbf636046026d7e05283d85505a0128c99641953db57a25d not found: ID does not exist" containerID="d401b9c7dfa5cf16bbf636046026d7e05283d85505a0128c99641953db57a25d"
Jul 02 23:43:41.333045 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:43:41.333005    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d401b9c7dfa5cf16bbf636046026d7e05283d85505a0128c99641953db57a25d"} err="failed to get container status \"d401b9c7dfa5cf16bbf636046026d7e05283d85505a0128c99641953db57a25d\": rpc error: code = NotFound desc = could not find container \"d401b9c7dfa5cf16bbf636046026d7e05283d85505a0128c99641953db57a25d\": container with ID starting with d401b9c7dfa5cf16bbf636046026d7e05283d85505a0128c99641953db57a25d not found: ID does not exist"
Jul 02 23:43:41.346224 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:43:41.346201    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-1ef970-5d6cb45775-sx77b"]
Jul 02 23:43:41.350696 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:43:41.350677    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-1ef970-5d6cb45775-sx77b"]
Jul 02 23:43:42.428575 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:43:42.428542    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e3a7d069-289a-4efc-a94a-4e8dfd860726" path="/var/lib/kubelet/pods/e3a7d069-289a-4efc-a94a-4e8dfd860726/volumes"
Jul 02 23:43:45.160363 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:43:45.160329    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:44:22.390055 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:44:22.390008    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:44:22.653438 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:44:22.653364    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:44:22.882919 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:44:22.882887    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:44:23.055559 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:44:23.055525    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:44:23.456253 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:44:23.456218    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:44:23.556347 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:44:23.556318    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:44:23.669717 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:44:23.669633    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:44:23.828472 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:44:23.828443    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-20977a-68cb48c45b-lwpqp"]
Jul 02 23:44:23.828706 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:44:23.828684    2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-inf-b-20977a-68cb48c45b-lwpqp" podUID="74b56d8e-544d-4db4-aa1f-9985d0f05dbf" containerName="maas-api" containerID="cri-o://33cbd06eab320ff10291fb6d15f966ea0b0c0a8b88dfd8fe2e397f5155c97f8e" gracePeriod=30
Jul 02 23:44:23.875131 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:44:23.875088    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:44:24.072438 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:44:24.072409    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-b-20977a-68cb48c45b-lwpqp"
Jul 02 23:44:24.168104 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:44:24.168071    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/74b56d8e-544d-4db4-aa1f-9985d0f05dbf-openshift-service-ca\") pod \"74b56d8e-544d-4db4-aa1f-9985d0f05dbf\" (UID: \"74b56d8e-544d-4db4-aa1f-9985d0f05dbf\") "
Jul 02 23:44:24.168308 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:44:24.168112    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/74b56d8e-544d-4db4-aa1f-9985d0f05dbf-maas-api-tls\") pod \"74b56d8e-544d-4db4-aa1f-9985d0f05dbf\" (UID: \"74b56d8e-544d-4db4-aa1f-9985d0f05dbf\") "
Jul 02 23:44:24.168308 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:44:24.168150    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kzfv7\" (UniqueName: \"kubernetes.io/projected/74b56d8e-544d-4db4-aa1f-9985d0f05dbf-kube-api-access-kzfv7\") pod \"74b56d8e-544d-4db4-aa1f-9985d0f05dbf\" (UID: \"74b56d8e-544d-4db4-aa1f-9985d0f05dbf\") "
Jul 02 23:44:24.168549 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:44:24.168520    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/74b56d8e-544d-4db4-aa1f-9985d0f05dbf-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "74b56d8e-544d-4db4-aa1f-9985d0f05dbf" (UID: "74b56d8e-544d-4db4-aa1f-9985d0f05dbf"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 23:44:24.170328 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:44:24.170305    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/74b56d8e-544d-4db4-aa1f-9985d0f05dbf-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "74b56d8e-544d-4db4-aa1f-9985d0f05dbf" (UID: "74b56d8e-544d-4db4-aa1f-9985d0f05dbf"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 23:44:24.170430 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:44:24.170374    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/74b56d8e-544d-4db4-aa1f-9985d0f05dbf-kube-api-access-kzfv7" (OuterVolumeSpecName: "kube-api-access-kzfv7") pod "74b56d8e-544d-4db4-aa1f-9985d0f05dbf" (UID: "74b56d8e-544d-4db4-aa1f-9985d0f05dbf"). InnerVolumeSpecName "kube-api-access-kzfv7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 23:44:24.269217 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:44:24.269149    2580 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/74b56d8e-544d-4db4-aa1f-9985d0f05dbf-openshift-service-ca\") on node \"ip-10-0-135-187.ec2.internal\" DevicePath \"\""
Jul 02 23:44:24.269217 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:44:24.269177    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/74b56d8e-544d-4db4-aa1f-9985d0f05dbf-maas-api-tls\") on node \"ip-10-0-135-187.ec2.internal\" DevicePath \"\""
Jul 02 23:44:24.269217 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:44:24.269187    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kzfv7\" (UniqueName: \"kubernetes.io/projected/74b56d8e-544d-4db4-aa1f-9985d0f05dbf-kube-api-access-kzfv7\") on node \"ip-10-0-135-187.ec2.internal\" DevicePath \"\""
Jul 02 23:44:24.510760 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:44:24.510732    2580 generic.go:356] "Generic (PLEG): container finished" podID="74b56d8e-544d-4db4-aa1f-9985d0f05dbf" containerID="33cbd06eab320ff10291fb6d15f966ea0b0c0a8b88dfd8fe2e397f5155c97f8e" exitCode=0
Jul 02 23:44:24.511136 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:44:24.510777    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-b-20977a-68cb48c45b-lwpqp"
Jul 02 23:44:24.511136 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:44:24.510823    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-b-20977a-68cb48c45b-lwpqp" event={"ID":"74b56d8e-544d-4db4-aa1f-9985d0f05dbf","Type":"ContainerDied","Data":"33cbd06eab320ff10291fb6d15f966ea0b0c0a8b88dfd8fe2e397f5155c97f8e"}
Jul 02 23:44:24.511136 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:44:24.510876    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-b-20977a-68cb48c45b-lwpqp" event={"ID":"74b56d8e-544d-4db4-aa1f-9985d0f05dbf","Type":"ContainerDied","Data":"2dd5e93c8ca2055d9b1f98ed9c1b57a559b1359039afcadcb2e339defee9c8bb"}
Jul 02 23:44:24.511136 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:44:24.510903    2580 scope.go:117] "RemoveContainer" containerID="33cbd06eab320ff10291fb6d15f966ea0b0c0a8b88dfd8fe2e397f5155c97f8e"
Jul 02 23:44:24.519527 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:44:24.519490    2580 scope.go:117] "RemoveContainer" containerID="33cbd06eab320ff10291fb6d15f966ea0b0c0a8b88dfd8fe2e397f5155c97f8e"
Jul 02 23:44:24.519754 ip-10-0-135-187 kubenswrapper[2580]: E0702 23:44:24.519734    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"33cbd06eab320ff10291fb6d15f966ea0b0c0a8b88dfd8fe2e397f5155c97f8e\": container with ID starting with 33cbd06eab320ff10291fb6d15f966ea0b0c0a8b88dfd8fe2e397f5155c97f8e not found: ID does not exist" containerID="33cbd06eab320ff10291fb6d15f966ea0b0c0a8b88dfd8fe2e397f5155c97f8e"
Jul 02 23:44:24.519809 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:44:24.519761    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"33cbd06eab320ff10291fb6d15f966ea0b0c0a8b88dfd8fe2e397f5155c97f8e"} err="failed to get container status \"33cbd06eab320ff10291fb6d15f966ea0b0c0a8b88dfd8fe2e397f5155c97f8e\": rpc error: code = NotFound desc = could not find container \"33cbd06eab320ff10291fb6d15f966ea0b0c0a8b88dfd8fe2e397f5155c97f8e\": container with ID starting with 33cbd06eab320ff10291fb6d15f966ea0b0c0a8b88dfd8fe2e397f5155c97f8e not found: ID does not exist"
Jul 02 23:44:24.527919 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:44:24.527895    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-20977a-68cb48c45b-lwpqp"]
Jul 02 23:44:24.531199 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:44:24.531175    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-20977a-68cb48c45b-lwpqp"]
Jul 02 23:44:26.429623 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:44:26.429582    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="74b56d8e-544d-4db4-aa1f-9985d0f05dbf" path="/var/lib/kubelet/pods/74b56d8e-544d-4db4-aa1f-9985d0f05dbf/volumes"
Jul 02 23:44:30.055919 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:44:30.055876    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:44:30.132141 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:44:30.132114    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:44:30.336843 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:44:30.336762    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:44:30.607225 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:44:30.607133    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:44:30.921296 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:44:30.921212    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:44:31.215575 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:44:31.215481    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:44:31.724209 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:44:31.724176    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:44:34.056826 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:44:34.056796    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:44:34.124362 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:44:34.124211    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-api-a-7318b0-5dc5cfb8c5-tvqvn"]
Jul 02 23:44:34.124823 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:44:34.124794    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e3a7d069-289a-4efc-a94a-4e8dfd860726" containerName="maas-api"
Jul 02 23:44:34.124982 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:44:34.124835    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="e3a7d069-289a-4efc-a94a-4e8dfd860726" containerName="maas-api"
Jul 02 23:44:34.124982 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:44:34.124885    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="74b56d8e-544d-4db4-aa1f-9985d0f05dbf" containerName="maas-api"
Jul 02 23:44:34.124982 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:44:34.124894    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="74b56d8e-544d-4db4-aa1f-9985d0f05dbf" containerName="maas-api"
Jul 02 23:44:34.125152 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:44:34.124993    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="74b56d8e-544d-4db4-aa1f-9985d0f05dbf" containerName="maas-api"
Jul 02 23:44:34.125152 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:44:34.125005    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="e3a7d069-289a-4efc-a94a-4e8dfd860726" containerName="maas-api"
Jul 02 23:44:34.129842 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:44:34.129820    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-a-7318b0-5dc5cfb8c5-tvqvn"
Jul 02 23:44:34.133930 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:44:34.133906    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-api-a-7318b0-serving-cert\""
Jul 02 23:44:34.138611 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:44:34.138586    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-api-a-7318b0-5dc5cfb8c5-tvqvn"]
Jul 02 23:44:34.142401 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:44:34.142365    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:44:34.219039 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:44:34.218990    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:44:34.258045 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:44:34.258007    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3ea3b503-7506-41e2-ad99-6736d2af7a92-maas-api-tls\") pod \"maas-api-e2e-api-a-7318b0-5dc5cfb8c5-tvqvn\" (UID: \"3ea3b503-7506-41e2-ad99-6736d2af7a92\") " pod="opendatahub/maas-api-e2e-api-a-7318b0-5dc5cfb8c5-tvqvn"
Jul 02 23:44:34.258208 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:44:34.258059    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v57gd\" (UniqueName: \"kubernetes.io/projected/3ea3b503-7506-41e2-ad99-6736d2af7a92-kube-api-access-v57gd\") pod \"maas-api-e2e-api-a-7318b0-5dc5cfb8c5-tvqvn\" (UID: \"3ea3b503-7506-41e2-ad99-6736d2af7a92\") " pod="opendatahub/maas-api-e2e-api-a-7318b0-5dc5cfb8c5-tvqvn"
Jul 02 23:44:34.258208 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:44:34.258114    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3ea3b503-7506-41e2-ad99-6736d2af7a92-openshift-service-ca\") pod \"maas-api-e2e-api-a-7318b0-5dc5cfb8c5-tvqvn\" (UID: \"3ea3b503-7506-41e2-ad99-6736d2af7a92\") " pod="opendatahub/maas-api-e2e-api-a-7318b0-5dc5cfb8c5-tvqvn"
Jul 02 23:44:34.319210 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:44:34.319135    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:44:34.359455 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:44:34.359427    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3ea3b503-7506-41e2-ad99-6736d2af7a92-openshift-service-ca\") pod \"maas-api-e2e-api-a-7318b0-5dc5cfb8c5-tvqvn\" (UID: \"3ea3b503-7506-41e2-ad99-6736d2af7a92\") " pod="opendatahub/maas-api-e2e-api-a-7318b0-5dc5cfb8c5-tvqvn"
Jul 02 23:44:34.359576 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:44:34.359561    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3ea3b503-7506-41e2-ad99-6736d2af7a92-maas-api-tls\") pod \"maas-api-e2e-api-a-7318b0-5dc5cfb8c5-tvqvn\" (UID: \"3ea3b503-7506-41e2-ad99-6736d2af7a92\") " pod="opendatahub/maas-api-e2e-api-a-7318b0-5dc5cfb8c5-tvqvn"
Jul 02 23:44:34.359618 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:44:34.359604    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v57gd\" (UniqueName: \"kubernetes.io/projected/3ea3b503-7506-41e2-ad99-6736d2af7a92-kube-api-access-v57gd\") pod \"maas-api-e2e-api-a-7318b0-5dc5cfb8c5-tvqvn\" (UID: \"3ea3b503-7506-41e2-ad99-6736d2af7a92\") " pod="opendatahub/maas-api-e2e-api-a-7318b0-5dc5cfb8c5-tvqvn"
Jul 02 23:44:34.360156 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:44:34.360130    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3ea3b503-7506-41e2-ad99-6736d2af7a92-openshift-service-ca\") pod \"maas-api-e2e-api-a-7318b0-5dc5cfb8c5-tvqvn\" (UID: \"3ea3b503-7506-41e2-ad99-6736d2af7a92\") " pod="opendatahub/maas-api-e2e-api-a-7318b0-5dc5cfb8c5-tvqvn"
Jul 02 23:44:34.361984 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:44:34.361965    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3ea3b503-7506-41e2-ad99-6736d2af7a92-maas-api-tls\") pod \"maas-api-e2e-api-a-7318b0-5dc5cfb8c5-tvqvn\" (UID: \"3ea3b503-7506-41e2-ad99-6736d2af7a92\") " pod="opendatahub/maas-api-e2e-api-a-7318b0-5dc5cfb8c5-tvqvn"
Jul 02 23:44:34.367049 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:44:34.367032    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v57gd\" (UniqueName: \"kubernetes.io/projected/3ea3b503-7506-41e2-ad99-6736d2af7a92-kube-api-access-v57gd\") pod \"maas-api-e2e-api-a-7318b0-5dc5cfb8c5-tvqvn\" (UID: \"3ea3b503-7506-41e2-ad99-6736d2af7a92\") " pod="opendatahub/maas-api-e2e-api-a-7318b0-5dc5cfb8c5-tvqvn"
Jul 02 23:44:34.445340 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:44:34.445313    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-a-7318b0-5dc5cfb8c5-tvqvn"
Jul 02 23:44:34.583961 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:44:34.583934    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-api-a-7318b0-5dc5cfb8c5-tvqvn"]
Jul 02 23:44:34.585980 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:44:34.585956    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ea3b503_7506_41e2_ad99_6736d2af7a92.slice/crio-5a708077d1f3ce049878c5953e0b6d6751b6d16ff355246e96141c87f7aeddb6 WatchSource:0}: Error finding container 5a708077d1f3ce049878c5953e0b6d6751b6d16ff355246e96141c87f7aeddb6: Status 404 returned error can't find the container with id 5a708077d1f3ce049878c5953e0b6d6751b6d16ff355246e96141c87f7aeddb6
Jul 02 23:44:34.613182 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:44:34.613160    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:44:34.714429 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:44:34.714404    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:44:35.563021 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:44:35.562979    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-a-7318b0-5dc5cfb8c5-tvqvn" event={"ID":"3ea3b503-7506-41e2-ad99-6736d2af7a92","Type":"ContainerStarted","Data":"528bab7763dcc44bc6fe443e824aaaa50df42dd0a480b9830d64b294ff242f10"}
Jul 02 23:44:35.563467 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:44:35.563063    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-a-7318b0-5dc5cfb8c5-tvqvn" event={"ID":"3ea3b503-7506-41e2-ad99-6736d2af7a92","Type":"ContainerStarted","Data":"5a708077d1f3ce049878c5953e0b6d6751b6d16ff355246e96141c87f7aeddb6"}
Jul 02 23:44:35.563467 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:44:35.563129    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-api-a-7318b0-5dc5cfb8c5-tvqvn"
Jul 02 23:44:35.579863 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:44:35.579817    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-api-a-7318b0-5dc5cfb8c5-tvqvn" podStartSLOduration=1.166663188 podStartE2EDuration="1.579804621s" totalImagesPullingTime="413.141433ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:44:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:44:35.579194848 +0000 UTC m=+2061.596626045" watchObservedRunningTime="2026-07-02 23:44:35.579804621 +0000 UTC m=+2061.597235822"
Jul 02 23:44:38.569807 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:44:38.569722    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:44:39.073032 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:44:39.073002    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:44:39.407487 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:44:39.407393    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:44:39.502638 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:44:39.502602    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:44:41.572731 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:44:41.572704    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-api-a-7318b0-5dc5cfb8c5-tvqvn"
Jul 02 23:44:42.106264 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:44:42.106213    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:44:42.191418 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:44:42.191388    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-api-b-06bba8-57bdbdb588-kt4w4"]
Jul 02 23:44:42.193795 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:44:42.193762    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:44:42.195254 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:44:42.195226    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-b-06bba8-57bdbdb588-kt4w4"
Jul 02 23:44:42.197875 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:44:42.197855    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-api-b-06bba8-serving-cert\""
Jul 02 23:44:42.207349 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:44:42.207328    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-api-b-06bba8-57bdbdb588-kt4w4"]
Jul 02 23:44:42.233560 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:44:42.233530    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/68b99f36-8e70-41e4-b047-b7fbfdec3328-maas-api-tls\") pod \"maas-api-e2e-api-b-06bba8-57bdbdb588-kt4w4\" (UID: \"68b99f36-8e70-41e4-b047-b7fbfdec3328\") " pod="opendatahub/maas-api-e2e-api-b-06bba8-57bdbdb588-kt4w4"
Jul 02 23:44:42.233703 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:44:42.233589    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/68b99f36-8e70-41e4-b047-b7fbfdec3328-openshift-service-ca\") pod \"maas-api-e2e-api-b-06bba8-57bdbdb588-kt4w4\" (UID: \"68b99f36-8e70-41e4-b047-b7fbfdec3328\") " pod="opendatahub/maas-api-e2e-api-b-06bba8-57bdbdb588-kt4w4"
Jul 02 23:44:42.233703 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:44:42.233616    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sdg4b\" (UniqueName: \"kubernetes.io/projected/68b99f36-8e70-41e4-b047-b7fbfdec3328-kube-api-access-sdg4b\") pod \"maas-api-e2e-api-b-06bba8-57bdbdb588-kt4w4\" (UID: \"68b99f36-8e70-41e4-b047-b7fbfdec3328\") " pod="opendatahub/maas-api-e2e-api-b-06bba8-57bdbdb588-kt4w4"
Jul 02 23:44:42.259864 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:44:42.259835    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:44:42.334393 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:44:42.334359    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/68b99f36-8e70-41e4-b047-b7fbfdec3328-maas-api-tls\") pod \"maas-api-e2e-api-b-06bba8-57bdbdb588-kt4w4\" (UID: \"68b99f36-8e70-41e4-b047-b7fbfdec3328\") " pod="opendatahub/maas-api-e2e-api-b-06bba8-57bdbdb588-kt4w4"
Jul 02 23:44:42.334565 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:44:42.334459    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/68b99f36-8e70-41e4-b047-b7fbfdec3328-openshift-service-ca\") pod \"maas-api-e2e-api-b-06bba8-57bdbdb588-kt4w4\" (UID: \"68b99f36-8e70-41e4-b047-b7fbfdec3328\") " pod="opendatahub/maas-api-e2e-api-b-06bba8-57bdbdb588-kt4w4"
Jul 02 23:44:42.334565 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:44:42.334505    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sdg4b\" (UniqueName: \"kubernetes.io/projected/68b99f36-8e70-41e4-b047-b7fbfdec3328-kube-api-access-sdg4b\") pod \"maas-api-e2e-api-b-06bba8-57bdbdb588-kt4w4\" (UID: \"68b99f36-8e70-41e4-b047-b7fbfdec3328\") " pod="opendatahub/maas-api-e2e-api-b-06bba8-57bdbdb588-kt4w4"
Jul 02 23:44:42.334565 ip-10-0-135-187 kubenswrapper[2580]: E0702 23:44:42.334520    2580 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-api-b-06bba8-serving-cert: secret "maas-api-e2e-api-b-06bba8-serving-cert" not found
Jul 02 23:44:42.334731 ip-10-0-135-187 kubenswrapper[2580]: E0702 23:44:42.334602    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68b99f36-8e70-41e4-b047-b7fbfdec3328-maas-api-tls podName:68b99f36-8e70-41e4-b047-b7fbfdec3328 nodeName:}" failed. No retries permitted until 2026-07-02 23:44:42.834581116 +0000 UTC m=+2068.852012295 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/68b99f36-8e70-41e4-b047-b7fbfdec3328-maas-api-tls") pod "maas-api-e2e-api-b-06bba8-57bdbdb588-kt4w4" (UID: "68b99f36-8e70-41e4-b047-b7fbfdec3328") : secret "maas-api-e2e-api-b-06bba8-serving-cert" not found
Jul 02 23:44:42.335182 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:44:42.335164    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/68b99f36-8e70-41e4-b047-b7fbfdec3328-openshift-service-ca\") pod \"maas-api-e2e-api-b-06bba8-57bdbdb588-kt4w4\" (UID: \"68b99f36-8e70-41e4-b047-b7fbfdec3328\") " pod="opendatahub/maas-api-e2e-api-b-06bba8-57bdbdb588-kt4w4"
Jul 02 23:44:42.345907 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:44:42.345880    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sdg4b\" (UniqueName: \"kubernetes.io/projected/68b99f36-8e70-41e4-b047-b7fbfdec3328-kube-api-access-sdg4b\") pod \"maas-api-e2e-api-b-06bba8-57bdbdb588-kt4w4\" (UID: \"68b99f36-8e70-41e4-b047-b7fbfdec3328\") " pod="opendatahub/maas-api-e2e-api-b-06bba8-57bdbdb588-kt4w4"
Jul 02 23:44:42.543563 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:44:42.543527    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:44:42.669899 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:44:42.669868    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:44:42.770283 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:44:42.770228    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:44:42.838860 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:44:42.838772    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/68b99f36-8e70-41e4-b047-b7fbfdec3328-maas-api-tls\") pod \"maas-api-e2e-api-b-06bba8-57bdbdb588-kt4w4\" (UID: \"68b99f36-8e70-41e4-b047-b7fbfdec3328\") " pod="opendatahub/maas-api-e2e-api-b-06bba8-57bdbdb588-kt4w4"
Jul 02 23:44:42.841158 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:44:42.841140    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/68b99f36-8e70-41e4-b047-b7fbfdec3328-maas-api-tls\") pod \"maas-api-e2e-api-b-06bba8-57bdbdb588-kt4w4\" (UID: \"68b99f36-8e70-41e4-b047-b7fbfdec3328\") " pod="opendatahub/maas-api-e2e-api-b-06bba8-57bdbdb588-kt4w4"
Jul 02 23:44:43.110610 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:44:43.110533    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-b-06bba8-57bdbdb588-kt4w4"
Jul 02 23:44:43.241439 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:44:43.241321    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-api-b-06bba8-57bdbdb588-kt4w4"]
Jul 02 23:44:43.243559 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:44:43.243530    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68b99f36_8e70_41e4_b047_b7fbfdec3328.slice/crio-c3ed2aa622d5dcae0dd6e6be634ebebb1285158f7809505bc13a92f4fec5f99b WatchSource:0}: Error finding container c3ed2aa622d5dcae0dd6e6be634ebebb1285158f7809505bc13a92f4fec5f99b: Status 404 returned error can't find the container with id c3ed2aa622d5dcae0dd6e6be634ebebb1285158f7809505bc13a92f4fec5f99b
Jul 02 23:44:43.603181 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:44:43.603148    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-b-06bba8-57bdbdb588-kt4w4" event={"ID":"68b99f36-8e70-41e4-b047-b7fbfdec3328","Type":"ContainerStarted","Data":"c3ed2aa622d5dcae0dd6e6be634ebebb1285158f7809505bc13a92f4fec5f99b"}
Jul 02 23:44:44.325308 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:44:44.325276    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:44:44.609747 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:44:44.609654    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-b-06bba8-57bdbdb588-kt4w4" event={"ID":"68b99f36-8e70-41e4-b047-b7fbfdec3328","Type":"ContainerStarted","Data":"f8f157ca1ccb14d1b93b9b14a7fff0f7c678988560f5705756f0a67392583b55"}
Jul 02 23:44:44.609923 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:44:44.609753    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-api-b-06bba8-57bdbdb588-kt4w4"
Jul 02 23:44:44.626952 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:44:44.626911    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-api-b-06bba8-57bdbdb588-kt4w4" podStartSLOduration=2.160323598 podStartE2EDuration="2.626897846s" totalImagesPullingTime="466.574248ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:44:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:44:44.626064977 +0000 UTC m=+2070.643496175" watchObservedRunningTime="2026-07-02 23:44:44.626897846 +0000 UTC m=+2070.644329044"
Jul 02 23:44:46.677224 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:44:46.677189    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:44:50.619892 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:44:50.619861    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-api-b-06bba8-57bdbdb588-kt4w4"
Jul 02 23:44:54.700981 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:44:54.700943    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:44:55.084960 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:44:55.084926    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:44:55.183307 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:44:55.183279    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:44:55.284331 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:44:55.284301    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:44:55.377068 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:44:55.376987    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-api-a-7318b0-5dc5cfb8c5-tvqvn"]
Jul 02 23:44:55.377232 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:44:55.377189    2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-api-a-7318b0-5dc5cfb8c5-tvqvn" podUID="3ea3b503-7506-41e2-ad99-6736d2af7a92" containerName="maas-api" containerID="cri-o://528bab7763dcc44bc6fe443e824aaaa50df42dd0a480b9830d64b294ff242f10" gracePeriod=30
Jul 02 23:44:55.391999 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:44:55.391976    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:44:55.624616 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:44:55.624593    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-a-7318b0-5dc5cfb8c5-tvqvn"
Jul 02 23:44:55.661963 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:44:55.661890    2580 generic.go:356] "Generic (PLEG): container finished" podID="3ea3b503-7506-41e2-ad99-6736d2af7a92" containerID="528bab7763dcc44bc6fe443e824aaaa50df42dd0a480b9830d64b294ff242f10" exitCode=0
Jul 02 23:44:55.661963 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:44:55.661930    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-a-7318b0-5dc5cfb8c5-tvqvn" event={"ID":"3ea3b503-7506-41e2-ad99-6736d2af7a92","Type":"ContainerDied","Data":"528bab7763dcc44bc6fe443e824aaaa50df42dd0a480b9830d64b294ff242f10"}
Jul 02 23:44:55.661963 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:44:55.661937    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-a-7318b0-5dc5cfb8c5-tvqvn"
Jul 02 23:44:55.662180 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:44:55.661979    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-a-7318b0-5dc5cfb8c5-tvqvn" event={"ID":"3ea3b503-7506-41e2-ad99-6736d2af7a92","Type":"ContainerDied","Data":"5a708077d1f3ce049878c5953e0b6d6751b6d16ff355246e96141c87f7aeddb6"}
Jul 02 23:44:55.662180 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:44:55.662007    2580 scope.go:117] "RemoveContainer" containerID="528bab7763dcc44bc6fe443e824aaaa50df42dd0a480b9830d64b294ff242f10"
Jul 02 23:44:55.672424 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:44:55.672404    2580 scope.go:117] "RemoveContainer" containerID="528bab7763dcc44bc6fe443e824aaaa50df42dd0a480b9830d64b294ff242f10"
Jul 02 23:44:55.672699 ip-10-0-135-187 kubenswrapper[2580]: E0702 23:44:55.672672    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"528bab7763dcc44bc6fe443e824aaaa50df42dd0a480b9830d64b294ff242f10\": container with ID starting with 528bab7763dcc44bc6fe443e824aaaa50df42dd0a480b9830d64b294ff242f10 not found: ID does not exist" containerID="528bab7763dcc44bc6fe443e824aaaa50df42dd0a480b9830d64b294ff242f10"
Jul 02 23:44:55.672767 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:44:55.672713    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"528bab7763dcc44bc6fe443e824aaaa50df42dd0a480b9830d64b294ff242f10"} err="failed to get container status \"528bab7763dcc44bc6fe443e824aaaa50df42dd0a480b9830d64b294ff242f10\": rpc error: code = NotFound desc = could not find container \"528bab7763dcc44bc6fe443e824aaaa50df42dd0a480b9830d64b294ff242f10\": container with ID starting with 528bab7763dcc44bc6fe443e824aaaa50df42dd0a480b9830d64b294ff242f10 not found: ID does not exist"
Jul 02 23:44:55.730743 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:44:55.730714    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3ea3b503-7506-41e2-ad99-6736d2af7a92-maas-api-tls\") pod \"3ea3b503-7506-41e2-ad99-6736d2af7a92\" (UID: \"3ea3b503-7506-41e2-ad99-6736d2af7a92\") "
Jul 02 23:44:55.730743 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:44:55.730744    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v57gd\" (UniqueName: \"kubernetes.io/projected/3ea3b503-7506-41e2-ad99-6736d2af7a92-kube-api-access-v57gd\") pod \"3ea3b503-7506-41e2-ad99-6736d2af7a92\" (UID: \"3ea3b503-7506-41e2-ad99-6736d2af7a92\") "
Jul 02 23:44:55.731190 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:44:55.730783    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3ea3b503-7506-41e2-ad99-6736d2af7a92-openshift-service-ca\") pod \"3ea3b503-7506-41e2-ad99-6736d2af7a92\" (UID: \"3ea3b503-7506-41e2-ad99-6736d2af7a92\") "
Jul 02 23:44:55.731278 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:44:55.731179    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3ea3b503-7506-41e2-ad99-6736d2af7a92-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "3ea3b503-7506-41e2-ad99-6736d2af7a92" (UID: "3ea3b503-7506-41e2-ad99-6736d2af7a92"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 23:44:55.732894 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:44:55.732870    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3ea3b503-7506-41e2-ad99-6736d2af7a92-kube-api-access-v57gd" (OuterVolumeSpecName: "kube-api-access-v57gd") pod "3ea3b503-7506-41e2-ad99-6736d2af7a92" (UID: "3ea3b503-7506-41e2-ad99-6736d2af7a92"). InnerVolumeSpecName "kube-api-access-v57gd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 23:44:55.732894 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:44:55.732885    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3ea3b503-7506-41e2-ad99-6736d2af7a92-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "3ea3b503-7506-41e2-ad99-6736d2af7a92" (UID: "3ea3b503-7506-41e2-ad99-6736d2af7a92"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 23:44:55.831917 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:44:55.831891    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3ea3b503-7506-41e2-ad99-6736d2af7a92-maas-api-tls\") on node \"ip-10-0-135-187.ec2.internal\" DevicePath \"\""
Jul 02 23:44:55.831917 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:44:55.831916    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v57gd\" (UniqueName: \"kubernetes.io/projected/3ea3b503-7506-41e2-ad99-6736d2af7a92-kube-api-access-v57gd\") on node \"ip-10-0-135-187.ec2.internal\" DevicePath \"\""
Jul 02 23:44:55.832110 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:44:55.831927    2580 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3ea3b503-7506-41e2-ad99-6736d2af7a92-openshift-service-ca\") on node \"ip-10-0-135-187.ec2.internal\" DevicePath \"\""
Jul 02 23:44:55.983981 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:44:55.983952    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-api-a-7318b0-5dc5cfb8c5-tvqvn"]
Jul 02 23:44:55.987286 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:44:55.987264    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-api-a-7318b0-5dc5cfb8c5-tvqvn"]
Jul 02 23:44:56.428583 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:44:56.428549    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3ea3b503-7506-41e2-ad99-6736d2af7a92" path="/var/lib/kubelet/pods/3ea3b503-7506-41e2-ad99-6736d2af7a92/volumes"
Jul 02 23:45:00.151291 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:45:00.151258    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-api-b-06bba8-29717265-4wqkv"]
Jul 02 23:45:00.151669 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:45:00.151656    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3ea3b503-7506-41e2-ad99-6736d2af7a92" containerName="maas-api"
Jul 02 23:45:00.151669 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:45:00.151667    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="3ea3b503-7506-41e2-ad99-6736d2af7a92" containerName="maas-api"
Jul 02 23:45:00.151740 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:45:00.151735    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="3ea3b503-7506-41e2-ad99-6736d2af7a92" containerName="maas-api"
Jul 02 23:45:00.156171 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:45:00.156153    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-api-b-06bba8-29717265-4wqkv"
Jul 02 23:45:00.165936 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:45:00.165911    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-api-b-06bba8-29717265-4wqkv"]
Jul 02 23:45:00.270343 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:45:00.270311    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wsq9k\" (UniqueName: \"kubernetes.io/projected/7482f1c0-af81-472b-8e2a-88c6001202ed-kube-api-access-wsq9k\") pod \"maas-api-key-cleanup-e2e-api-b-06bba8-29717265-4wqkv\" (UID: \"7482f1c0-af81-472b-8e2a-88c6001202ed\") " pod="opendatahub/maas-api-key-cleanup-e2e-api-b-06bba8-29717265-4wqkv"
Jul 02 23:45:00.371154 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:45:00.371117    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wsq9k\" (UniqueName: \"kubernetes.io/projected/7482f1c0-af81-472b-8e2a-88c6001202ed-kube-api-access-wsq9k\") pod \"maas-api-key-cleanup-e2e-api-b-06bba8-29717265-4wqkv\" (UID: \"7482f1c0-af81-472b-8e2a-88c6001202ed\") " pod="opendatahub/maas-api-key-cleanup-e2e-api-b-06bba8-29717265-4wqkv"
Jul 02 23:45:00.378826 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:45:00.378804    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wsq9k\" (UniqueName: \"kubernetes.io/projected/7482f1c0-af81-472b-8e2a-88c6001202ed-kube-api-access-wsq9k\") pod \"maas-api-key-cleanup-e2e-api-b-06bba8-29717265-4wqkv\" (UID: \"7482f1c0-af81-472b-8e2a-88c6001202ed\") " pod="opendatahub/maas-api-key-cleanup-e2e-api-b-06bba8-29717265-4wqkv"
Jul 02 23:45:00.469361 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:45:00.469293    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-api-b-06bba8-29717265-4wqkv"
Jul 02 23:45:00.594325 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:45:00.594303    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-api-b-06bba8-29717265-4wqkv"]
Jul 02 23:45:00.596238 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:45:00.596215    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7482f1c0_af81_472b_8e2a_88c6001202ed.slice/crio-d64dbc73cb439f2254dac41fc8d9bf7f73c0369901e26ad125af8a6bf6015633 WatchSource:0}: Error finding container d64dbc73cb439f2254dac41fc8d9bf7f73c0369901e26ad125af8a6bf6015633: Status 404 returned error can't find the container with id d64dbc73cb439f2254dac41fc8d9bf7f73c0369901e26ad125af8a6bf6015633
Jul 02 23:45:00.685394 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:45:00.685366    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-api-b-06bba8-29717265-4wqkv" event={"ID":"7482f1c0-af81-472b-8e2a-88c6001202ed","Type":"ContainerStarted","Data":"d64dbc73cb439f2254dac41fc8d9bf7f73c0369901e26ad125af8a6bf6015633"}
Jul 02 23:45:00.974072 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:45:00.974033    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:45:01.074283 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:45:01.074254    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:45:01.239469 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:45:01.239387    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:45:01.511947 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:45:01.511864    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:45:01.973925 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:45:01.973892    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:45:02.165872 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:45:02.165835    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:45:02.329967 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:45:02.329913    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:45:02.438147 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:45:02.438088    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:45:02.515968 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:45:02.515936    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-api-b-06bba8-57bdbdb588-kt4w4"]
Jul 02 23:45:02.516206 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:45:02.516176    2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-api-b-06bba8-57bdbdb588-kt4w4" podUID="68b99f36-8e70-41e4-b047-b7fbfdec3328" containerName="maas-api" containerID="cri-o://f8f157ca1ccb14d1b93b9b14a7fff0f7c678988560f5705756f0a67392583b55" gracePeriod=30
Jul 02 23:45:02.543070 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:45:02.543044    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:45:02.552061 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:45:02.552026    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-api-b-06bba8-29717265-4wqkv"]
Jul 02 23:45:02.873720 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:45:02.873696    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-b-06bba8-57bdbdb588-kt4w4"
Jul 02 23:45:02.996117 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:45:02.996055    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sdg4b\" (UniqueName: \"kubernetes.io/projected/68b99f36-8e70-41e4-b047-b7fbfdec3328-kube-api-access-sdg4b\") pod \"68b99f36-8e70-41e4-b047-b7fbfdec3328\" (UID: \"68b99f36-8e70-41e4-b047-b7fbfdec3328\") "
Jul 02 23:45:02.996117 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:45:02.996103    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/68b99f36-8e70-41e4-b047-b7fbfdec3328-maas-api-tls\") pod \"68b99f36-8e70-41e4-b047-b7fbfdec3328\" (UID: \"68b99f36-8e70-41e4-b047-b7fbfdec3328\") "
Jul 02 23:45:02.996309 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:45:02.996154    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/68b99f36-8e70-41e4-b047-b7fbfdec3328-openshift-service-ca\") pod \"68b99f36-8e70-41e4-b047-b7fbfdec3328\" (UID: \"68b99f36-8e70-41e4-b047-b7fbfdec3328\") "
Jul 02 23:45:02.996554 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:45:02.996530    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/68b99f36-8e70-41e4-b047-b7fbfdec3328-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "68b99f36-8e70-41e4-b047-b7fbfdec3328" (UID: "68b99f36-8e70-41e4-b047-b7fbfdec3328"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 23:45:02.997967 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:45:02.997945    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/68b99f36-8e70-41e4-b047-b7fbfdec3328-kube-api-access-sdg4b" (OuterVolumeSpecName: "kube-api-access-sdg4b") pod "68b99f36-8e70-41e4-b047-b7fbfdec3328" (UID: "68b99f36-8e70-41e4-b047-b7fbfdec3328"). InnerVolumeSpecName "kube-api-access-sdg4b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 23:45:02.998062 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:45:02.998042    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/68b99f36-8e70-41e4-b047-b7fbfdec3328-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "68b99f36-8e70-41e4-b047-b7fbfdec3328" (UID: "68b99f36-8e70-41e4-b047-b7fbfdec3328"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 23:45:03.097280 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:45:03.097227    2580 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/68b99f36-8e70-41e4-b047-b7fbfdec3328-openshift-service-ca\") on node \"ip-10-0-135-187.ec2.internal\" DevicePath \"\""
Jul 02 23:45:03.097280 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:45:03.097274    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sdg4b\" (UniqueName: \"kubernetes.io/projected/68b99f36-8e70-41e4-b047-b7fbfdec3328-kube-api-access-sdg4b\") on node \"ip-10-0-135-187.ec2.internal\" DevicePath \"\""
Jul 02 23:45:03.097280 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:45:03.097284    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/68b99f36-8e70-41e4-b047-b7fbfdec3328-maas-api-tls\") on node \"ip-10-0-135-187.ec2.internal\" DevicePath \"\""
Jul 02 23:45:03.704069 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:45:03.703973    2580 generic.go:356] "Generic (PLEG): container finished" podID="7482f1c0-af81-472b-8e2a-88c6001202ed" containerID="6bc6393849c9292d6f70e780b638de67bf22d1e8f992598031ce1fffe2c2c965" exitCode=6
Jul 02 23:45:03.704553 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:45:03.704071    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-api-b-06bba8-29717265-4wqkv" event={"ID":"7482f1c0-af81-472b-8e2a-88c6001202ed","Type":"ContainerDied","Data":"6bc6393849c9292d6f70e780b638de67bf22d1e8f992598031ce1fffe2c2c965"}
Jul 02 23:45:03.705421 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:45:03.705397    2580 generic.go:356] "Generic (PLEG): container finished" podID="68b99f36-8e70-41e4-b047-b7fbfdec3328" containerID="f8f157ca1ccb14d1b93b9b14a7fff0f7c678988560f5705756f0a67392583b55" exitCode=0
Jul 02 23:45:03.705542 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:45:03.705454    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-b-06bba8-57bdbdb588-kt4w4" event={"ID":"68b99f36-8e70-41e4-b047-b7fbfdec3328","Type":"ContainerDied","Data":"f8f157ca1ccb14d1b93b9b14a7fff0f7c678988560f5705756f0a67392583b55"}
Jul 02 23:45:03.705542 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:45:03.705460    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-b-06bba8-57bdbdb588-kt4w4"
Jul 02 23:45:03.705542 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:45:03.705489    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-b-06bba8-57bdbdb588-kt4w4" event={"ID":"68b99f36-8e70-41e4-b047-b7fbfdec3328","Type":"ContainerDied","Data":"c3ed2aa622d5dcae0dd6e6be634ebebb1285158f7809505bc13a92f4fec5f99b"}
Jul 02 23:45:03.705542 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:45:03.705509    2580 scope.go:117] "RemoveContainer" containerID="f8f157ca1ccb14d1b93b9b14a7fff0f7c678988560f5705756f0a67392583b55"
Jul 02 23:45:03.714036 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:45:03.714020    2580 scope.go:117] "RemoveContainer" containerID="f8f157ca1ccb14d1b93b9b14a7fff0f7c678988560f5705756f0a67392583b55"
Jul 02 23:45:03.714291 ip-10-0-135-187 kubenswrapper[2580]: E0702 23:45:03.714273    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f8f157ca1ccb14d1b93b9b14a7fff0f7c678988560f5705756f0a67392583b55\": container with ID starting with f8f157ca1ccb14d1b93b9b14a7fff0f7c678988560f5705756f0a67392583b55 not found: ID does not exist" containerID="f8f157ca1ccb14d1b93b9b14a7fff0f7c678988560f5705756f0a67392583b55"
Jul 02 23:45:03.714356 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:45:03.714297    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f8f157ca1ccb14d1b93b9b14a7fff0f7c678988560f5705756f0a67392583b55"} err="failed to get container status \"f8f157ca1ccb14d1b93b9b14a7fff0f7c678988560f5705756f0a67392583b55\": rpc error: code = NotFound desc = could not find container \"f8f157ca1ccb14d1b93b9b14a7fff0f7c678988560f5705756f0a67392583b55\": container with ID starting with f8f157ca1ccb14d1b93b9b14a7fff0f7c678988560f5705756f0a67392583b55 not found: ID does not exist"
Jul 02 23:45:03.734236 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:45:03.734212    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-api-b-06bba8-57bdbdb588-kt4w4"]
Jul 02 23:45:03.742318 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:45:03.742295    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-api-b-06bba8-57bdbdb588-kt4w4"]
Jul 02 23:45:03.841877 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:45:03.841855    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-api-b-06bba8-29717265-4wqkv"
Jul 02 23:45:03.904269 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:45:03.904228    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wsq9k\" (UniqueName: \"kubernetes.io/projected/7482f1c0-af81-472b-8e2a-88c6001202ed-kube-api-access-wsq9k\") pod \"7482f1c0-af81-472b-8e2a-88c6001202ed\" (UID: \"7482f1c0-af81-472b-8e2a-88c6001202ed\") "
Jul 02 23:45:03.906110 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:45:03.906087    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7482f1c0-af81-472b-8e2a-88c6001202ed-kube-api-access-wsq9k" (OuterVolumeSpecName: "kube-api-access-wsq9k") pod "7482f1c0-af81-472b-8e2a-88c6001202ed" (UID: "7482f1c0-af81-472b-8e2a-88c6001202ed"). InnerVolumeSpecName "kube-api-access-wsq9k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 23:45:04.005211 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:45:04.005153    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wsq9k\" (UniqueName: \"kubernetes.io/projected/7482f1c0-af81-472b-8e2a-88c6001202ed-kube-api-access-wsq9k\") on node \"ip-10-0-135-187.ec2.internal\" DevicePath \"\""
Jul 02 23:45:04.433900 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:45:04.433865    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="68b99f36-8e70-41e4-b047-b7fbfdec3328" path="/var/lib/kubelet/pods/68b99f36-8e70-41e4-b047-b7fbfdec3328/volumes"
Jul 02 23:45:04.711383 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:45:04.711301    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-api-b-06bba8-29717265-4wqkv"
Jul 02 23:45:04.711383 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:45:04.711351    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-api-b-06bba8-29717265-4wqkv" event={"ID":"7482f1c0-af81-472b-8e2a-88c6001202ed","Type":"ContainerDied","Data":"d64dbc73cb439f2254dac41fc8d9bf7f73c0369901e26ad125af8a6bf6015633"}
Jul 02 23:45:04.711858 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:45:04.711416    2580 scope.go:117] "RemoveContainer" containerID="6bc6393849c9292d6f70e780b638de67bf22d1e8f992598031ce1fffe2c2c965"
Jul 02 23:45:04.728504 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:45:04.728476    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-api-b-06bba8-29717265-4wqkv"]
Jul 02 23:45:04.729999 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:45:04.729979    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-api-b-06bba8-29717265-4wqkv"]
Jul 02 23:45:06.428687 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:45:06.428655    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7482f1c0-af81-472b-8e2a-88c6001202ed" path="/var/lib/kubelet/pods/7482f1c0-af81-472b-8e2a-88c6001202ed/volumes"
Jul 02 23:45:08.097903 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:45:08.097859    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:45:08.195919 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:45:08.195881    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:45:08.349099 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:45:08.349019    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:45:08.568673 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:45:08.568640    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:45:08.907847 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:45:08.907820    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:45:09.231098 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:45:09.231025    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:45:09.472880 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:45:09.472834    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:45:12.313827 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:45:12.313780    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:45:12.381880 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:45:12.381849    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-shared-a-6d35bd-7986d67dff-6jf8l"]
Jul 02 23:45:12.382235 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:45:12.382213    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7482f1c0-af81-472b-8e2a-88c6001202ed" containerName="cleanup"
Jul 02 23:45:12.382396 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:45:12.382272    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="7482f1c0-af81-472b-8e2a-88c6001202ed" containerName="cleanup"
Jul 02 23:45:12.382396 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:45:12.382310    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="68b99f36-8e70-41e4-b047-b7fbfdec3328" containerName="maas-api"
Jul 02 23:45:12.382396 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:45:12.382336    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="68b99f36-8e70-41e4-b047-b7fbfdec3328" containerName="maas-api"
Jul 02 23:45:12.382562 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:45:12.382465    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="68b99f36-8e70-41e4-b047-b7fbfdec3328" containerName="maas-api"
Jul 02 23:45:12.382562 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:45:12.382497    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="7482f1c0-af81-472b-8e2a-88c6001202ed" containerName="cleanup"
Jul 02 23:45:12.386910 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:45:12.386889    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-a-6d35bd-7986d67dff-6jf8l"
Jul 02 23:45:12.390082 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:45:12.390059    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-shared-a-6d35bd-serving-cert\""
Jul 02 23:45:12.402190 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:45:12.402166    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-6d35bd-7986d67dff-6jf8l"]
Jul 02 23:45:12.405981 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:45:12.405959    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:45:12.474904 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:45:12.474882    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-748vx\" (UniqueName: \"kubernetes.io/projected/5e8f4e80-e86c-4d2c-ab8b-39e7393d6b51-kube-api-access-748vx\") pod \"maas-api-e2e-shared-a-6d35bd-7986d67dff-6jf8l\" (UID: \"5e8f4e80-e86c-4d2c-ab8b-39e7393d6b51\") " pod="opendatahub/maas-api-e2e-shared-a-6d35bd-7986d67dff-6jf8l"
Jul 02 23:45:12.475050 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:45:12.474926    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5e8f4e80-e86c-4d2c-ab8b-39e7393d6b51-openshift-service-ca\") pod \"maas-api-e2e-shared-a-6d35bd-7986d67dff-6jf8l\" (UID: \"5e8f4e80-e86c-4d2c-ab8b-39e7393d6b51\") " pod="opendatahub/maas-api-e2e-shared-a-6d35bd-7986d67dff-6jf8l"
Jul 02 23:45:12.475050 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:45:12.475035    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5e8f4e80-e86c-4d2c-ab8b-39e7393d6b51-maas-api-tls\") pod \"maas-api-e2e-shared-a-6d35bd-7986d67dff-6jf8l\" (UID: \"5e8f4e80-e86c-4d2c-ab8b-39e7393d6b51\") " pod="opendatahub/maas-api-e2e-shared-a-6d35bd-7986d67dff-6jf8l"
Jul 02 23:45:12.486904 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:45:12.486879    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:45:12.576066 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:45:12.575980    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5e8f4e80-e86c-4d2c-ab8b-39e7393d6b51-maas-api-tls\") pod \"maas-api-e2e-shared-a-6d35bd-7986d67dff-6jf8l\" (UID: \"5e8f4e80-e86c-4d2c-ab8b-39e7393d6b51\") " pod="opendatahub/maas-api-e2e-shared-a-6d35bd-7986d67dff-6jf8l"
Jul 02 23:45:12.576209 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:45:12.576075    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-748vx\" (UniqueName: \"kubernetes.io/projected/5e8f4e80-e86c-4d2c-ab8b-39e7393d6b51-kube-api-access-748vx\") pod \"maas-api-e2e-shared-a-6d35bd-7986d67dff-6jf8l\" (UID: \"5e8f4e80-e86c-4d2c-ab8b-39e7393d6b51\") " pod="opendatahub/maas-api-e2e-shared-a-6d35bd-7986d67dff-6jf8l"
Jul 02 23:45:12.576209 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:45:12.576120    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5e8f4e80-e86c-4d2c-ab8b-39e7393d6b51-openshift-service-ca\") pod \"maas-api-e2e-shared-a-6d35bd-7986d67dff-6jf8l\" (UID: \"5e8f4e80-e86c-4d2c-ab8b-39e7393d6b51\") " pod="opendatahub/maas-api-e2e-shared-a-6d35bd-7986d67dff-6jf8l"
Jul 02 23:45:12.576802 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:45:12.576779    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5e8f4e80-e86c-4d2c-ab8b-39e7393d6b51-openshift-service-ca\") pod \"maas-api-e2e-shared-a-6d35bd-7986d67dff-6jf8l\" (UID: \"5e8f4e80-e86c-4d2c-ab8b-39e7393d6b51\") " pod="opendatahub/maas-api-e2e-shared-a-6d35bd-7986d67dff-6jf8l"
Jul 02 23:45:12.578435 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:45:12.578414    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5e8f4e80-e86c-4d2c-ab8b-39e7393d6b51-maas-api-tls\") pod \"maas-api-e2e-shared-a-6d35bd-7986d67dff-6jf8l\" (UID: \"5e8f4e80-e86c-4d2c-ab8b-39e7393d6b51\") " pod="opendatahub/maas-api-e2e-shared-a-6d35bd-7986d67dff-6jf8l"
Jul 02 23:45:12.583996 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:45:12.583965    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:45:12.584756 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:45:12.584735    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-748vx\" (UniqueName: \"kubernetes.io/projected/5e8f4e80-e86c-4d2c-ab8b-39e7393d6b51-kube-api-access-748vx\") pod \"maas-api-e2e-shared-a-6d35bd-7986d67dff-6jf8l\" (UID: \"5e8f4e80-e86c-4d2c-ab8b-39e7393d6b51\") " pod="opendatahub/maas-api-e2e-shared-a-6d35bd-7986d67dff-6jf8l"
Jul 02 23:45:12.697257 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:45:12.697224    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-a-6d35bd-7986d67dff-6jf8l"
Jul 02 23:45:12.829655 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:45:12.829628    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-6d35bd-7986d67dff-6jf8l"]
Jul 02 23:45:12.831846 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:45:12.831814    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e8f4e80_e86c_4d2c_ab8b_39e7393d6b51.slice/crio-e7d262829eb53161077e0c2a8e11f15a399f4c43d82ffd1f00dd28d4e3b1892c WatchSource:0}: Error finding container e7d262829eb53161077e0c2a8e11f15a399f4c43d82ffd1f00dd28d4e3b1892c: Status 404 returned error can't find the container with id e7d262829eb53161077e0c2a8e11f15a399f4c43d82ffd1f00dd28d4e3b1892c
Jul 02 23:45:12.966812 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:45:12.966779    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:45:13.067513 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:45:13.067476    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:45:13.756962 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:45:13.756923    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-a-6d35bd-7986d67dff-6jf8l" event={"ID":"5e8f4e80-e86c-4d2c-ab8b-39e7393d6b51","Type":"ContainerStarted","Data":"48fb9600815e5f2d1ce1920b4d2c845e4acc2f168e93828600150f46b374b9cc"}
Jul 02 23:45:13.757402 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:45:13.756986    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-a-6d35bd-7986d67dff-6jf8l" event={"ID":"5e8f4e80-e86c-4d2c-ab8b-39e7393d6b51","Type":"ContainerStarted","Data":"e7d262829eb53161077e0c2a8e11f15a399f4c43d82ffd1f00dd28d4e3b1892c"}
Jul 02 23:45:13.757402 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:45:13.757035    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-shared-a-6d35bd-7986d67dff-6jf8l"
Jul 02 23:45:13.774608 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:45:13.774568    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-shared-a-6d35bd-7986d67dff-6jf8l" podStartSLOduration=1.341207101 podStartE2EDuration="1.774553171s" totalImagesPullingTime="433.34607ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:45:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:45:13.772745837 +0000 UTC m=+2099.790177028" watchObservedRunningTime="2026-07-02 23:45:13.774553171 +0000 UTC m=+2099.791984369"
Jul 02 23:45:16.789408 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:45:16.789372    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:45:17.124856 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:45:17.124774    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:45:17.431169 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:45:17.431072    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:45:17.533862 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:45:17.533825    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:45:19.767450 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:45:19.767423    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-shared-a-6d35bd-7986d67dff-6jf8l"
Jul 02 23:45:20.346324 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:45:20.346292    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:45:20.442613 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:45:20.442577    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-shared-b-ed05a5-6df8f74f4b-d4pcn"]
Jul 02 23:45:20.446329 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:45:20.446305    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-b-ed05a5-6df8f74f4b-d4pcn"
Jul 02 23:45:20.446740 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:45:20.446717    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:45:20.449284 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:45:20.449265    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-shared-b-ed05a5-serving-cert\""
Jul 02 23:45:20.458582 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:45:20.458558    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-ed05a5-6df8f74f4b-d4pcn"]
Jul 02 23:45:20.522589 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:45:20.522554    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:45:20.549081 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:45:20.549047    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bx9dp\" (UniqueName: \"kubernetes.io/projected/776b1209-6d81-4d0a-b232-3f1cf24e1593-kube-api-access-bx9dp\") pod \"maas-api-e2e-shared-b-ed05a5-6df8f74f4b-d4pcn\" (UID: \"776b1209-6d81-4d0a-b232-3f1cf24e1593\") " pod="opendatahub/maas-api-e2e-shared-b-ed05a5-6df8f74f4b-d4pcn"
Jul 02 23:45:20.549237 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:45:20.549109    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/776b1209-6d81-4d0a-b232-3f1cf24e1593-maas-api-tls\") pod \"maas-api-e2e-shared-b-ed05a5-6df8f74f4b-d4pcn\" (UID: \"776b1209-6d81-4d0a-b232-3f1cf24e1593\") " pod="opendatahub/maas-api-e2e-shared-b-ed05a5-6df8f74f4b-d4pcn"
Jul 02 23:45:20.549237 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:45:20.549131    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/776b1209-6d81-4d0a-b232-3f1cf24e1593-openshift-service-ca\") pod \"maas-api-e2e-shared-b-ed05a5-6df8f74f4b-d4pcn\" (UID: \"776b1209-6d81-4d0a-b232-3f1cf24e1593\") " pod="opendatahub/maas-api-e2e-shared-b-ed05a5-6df8f74f4b-d4pcn"
Jul 02 23:45:20.649764 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:45:20.649688    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bx9dp\" (UniqueName: \"kubernetes.io/projected/776b1209-6d81-4d0a-b232-3f1cf24e1593-kube-api-access-bx9dp\") pod \"maas-api-e2e-shared-b-ed05a5-6df8f74f4b-d4pcn\" (UID: \"776b1209-6d81-4d0a-b232-3f1cf24e1593\") " pod="opendatahub/maas-api-e2e-shared-b-ed05a5-6df8f74f4b-d4pcn"
Jul 02 23:45:20.649764 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:45:20.649757    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/776b1209-6d81-4d0a-b232-3f1cf24e1593-maas-api-tls\") pod \"maas-api-e2e-shared-b-ed05a5-6df8f74f4b-d4pcn\" (UID: \"776b1209-6d81-4d0a-b232-3f1cf24e1593\") " pod="opendatahub/maas-api-e2e-shared-b-ed05a5-6df8f74f4b-d4pcn"
Jul 02 23:45:20.649945 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:45:20.649779    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/776b1209-6d81-4d0a-b232-3f1cf24e1593-openshift-service-ca\") pod \"maas-api-e2e-shared-b-ed05a5-6df8f74f4b-d4pcn\" (UID: \"776b1209-6d81-4d0a-b232-3f1cf24e1593\") " pod="opendatahub/maas-api-e2e-shared-b-ed05a5-6df8f74f4b-d4pcn"
Jul 02 23:45:20.649945 ip-10-0-135-187 kubenswrapper[2580]: E0702 23:45:20.649914    2580 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-shared-b-ed05a5-serving-cert: secret "maas-api-e2e-shared-b-ed05a5-serving-cert" not found
Jul 02 23:45:20.650019 ip-10-0-135-187 kubenswrapper[2580]: E0702 23:45:20.649994    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/776b1209-6d81-4d0a-b232-3f1cf24e1593-maas-api-tls podName:776b1209-6d81-4d0a-b232-3f1cf24e1593 nodeName:}" failed. No retries permitted until 2026-07-02 23:45:21.149971752 +0000 UTC m=+2107.167402934 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/776b1209-6d81-4d0a-b232-3f1cf24e1593-maas-api-tls") pod "maas-api-e2e-shared-b-ed05a5-6df8f74f4b-d4pcn" (UID: "776b1209-6d81-4d0a-b232-3f1cf24e1593") : secret "maas-api-e2e-shared-b-ed05a5-serving-cert" not found
Jul 02 23:45:20.650412 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:45:20.650396    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/776b1209-6d81-4d0a-b232-3f1cf24e1593-openshift-service-ca\") pod \"maas-api-e2e-shared-b-ed05a5-6df8f74f4b-d4pcn\" (UID: \"776b1209-6d81-4d0a-b232-3f1cf24e1593\") " pod="opendatahub/maas-api-e2e-shared-b-ed05a5-6df8f74f4b-d4pcn"
Jul 02 23:45:20.663784 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:45:20.663753    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bx9dp\" (UniqueName: \"kubernetes.io/projected/776b1209-6d81-4d0a-b232-3f1cf24e1593-kube-api-access-bx9dp\") pod \"maas-api-e2e-shared-b-ed05a5-6df8f74f4b-d4pcn\" (UID: \"776b1209-6d81-4d0a-b232-3f1cf24e1593\") " pod="opendatahub/maas-api-e2e-shared-b-ed05a5-6df8f74f4b-d4pcn"
Jul 02 23:45:20.757545 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:45:20.757512    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:45:20.986811 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:45:20.986730    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:45:21.088957 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:45:21.088904    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:45:21.154625 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:45:21.154581    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/776b1209-6d81-4d0a-b232-3f1cf24e1593-maas-api-tls\") pod \"maas-api-e2e-shared-b-ed05a5-6df8f74f4b-d4pcn\" (UID: \"776b1209-6d81-4d0a-b232-3f1cf24e1593\") " pod="opendatahub/maas-api-e2e-shared-b-ed05a5-6df8f74f4b-d4pcn"
Jul 02 23:45:21.157338 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:45:21.157313    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/776b1209-6d81-4d0a-b232-3f1cf24e1593-maas-api-tls\") pod \"maas-api-e2e-shared-b-ed05a5-6df8f74f4b-d4pcn\" (UID: \"776b1209-6d81-4d0a-b232-3f1cf24e1593\") " pod="opendatahub/maas-api-e2e-shared-b-ed05a5-6df8f74f4b-d4pcn"
Jul 02 23:45:21.357175 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:45:21.357143    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-b-ed05a5-6df8f74f4b-d4pcn"
Jul 02 23:45:21.487376 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:45:21.487354    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-ed05a5-6df8f74f4b-d4pcn"]
Jul 02 23:45:21.489132 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:45:21.489104    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod776b1209_6d81_4d0a_b232_3f1cf24e1593.slice/crio-06a208d567a966ae46838d3069e127e82780c61019e28545ba906f8140a60e77 WatchSource:0}: Error finding container 06a208d567a966ae46838d3069e127e82780c61019e28545ba906f8140a60e77: Status 404 returned error can't find the container with id 06a208d567a966ae46838d3069e127e82780c61019e28545ba906f8140a60e77
Jul 02 23:45:21.799157 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:45:21.799123    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-b-ed05a5-6df8f74f4b-d4pcn" event={"ID":"776b1209-6d81-4d0a-b232-3f1cf24e1593","Type":"ContainerStarted","Data":"06a208d567a966ae46838d3069e127e82780c61019e28545ba906f8140a60e77"}
Jul 02 23:45:22.804581 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:45:22.804541    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-b-ed05a5-6df8f74f4b-d4pcn" event={"ID":"776b1209-6d81-4d0a-b232-3f1cf24e1593","Type":"ContainerStarted","Data":"ab4b5f3ff3dd8e2ae10f0c0b058494364f4d49db2acada2e656954314de934e4"}
Jul 02 23:45:22.805064 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:45:22.804651    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-shared-b-ed05a5-6df8f74f4b-d4pcn"
Jul 02 23:45:22.821758 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:45:22.821713    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-shared-b-ed05a5-6df8f74f4b-d4pcn" podStartSLOduration=2.512071267 podStartE2EDuration="2.821700274s" totalImagesPullingTime="309.629007ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:45:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:45:22.820896428 +0000 UTC m=+2108.838327626" watchObservedRunningTime="2026-07-02 23:45:22.821700274 +0000 UTC m=+2108.839131472"
Jul 02 23:45:24.828522 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:45:24.828488    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:45:28.814060 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:45:28.814028    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-shared-b-ed05a5-6df8f74f4b-d4pcn"
Jul 02 23:45:33.734433 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:45:33.734399    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:45:33.835230 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:45:33.835200    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:45:34.108746 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:45:34.108712    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:45:41.676321 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:45:41.676286    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:45:41.776844 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:45:41.776812    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:45:41.876970 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:45:41.876939    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:46:00.185726 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:46:00.185695    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:47:49.146201 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:47:49.146120    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:47:50.349945 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:47:50.349898    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:47:57.120456 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:47:57.120418    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:48:01.311394 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:48:01.311353    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:48:16.180791 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:48:16.180753    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:48:26.414906 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:48:26.414868    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:48:26.527958 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:48:26.527919    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:49:01.795367 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:49:01.795328    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:49:02.719916 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:49:02.719877    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:49:08.610197 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:49:08.610120    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:49:37.119982 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:49:37.119946    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:50:15.260952 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:50:15.260901    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:50:30.108390 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:50:30.108354    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:50:31.007122 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:50:31.007087    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:50:32.086008 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:50:32.085973    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:50:32.511532 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:50:32.511452    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:50:32.614973 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:50:32.614943    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:50:32.712042 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:50:32.711992    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:50:32.806552 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:50:32.806521    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-6d35bd-7986d67dff-6jf8l"]
Jul 02 23:50:32.806785 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:50:32.806747    2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-shared-a-6d35bd-7986d67dff-6jf8l" podUID="5e8f4e80-e86c-4d2c-ab8b-39e7393d6b51" containerName="maas-api" containerID="cri-o://48fb9600815e5f2d1ce1920b4d2c845e4acc2f168e93828600150f46b374b9cc" gracePeriod=30
Jul 02 23:50:32.831625 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:50:32.831596    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:50:33.195261 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:50:33.195213    2580 generic.go:356] "Generic (PLEG): container finished" podID="5e8f4e80-e86c-4d2c-ab8b-39e7393d6b51" containerID="48fb9600815e5f2d1ce1920b4d2c845e4acc2f168e93828600150f46b374b9cc" exitCode=0
Jul 02 23:50:33.195596 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:50:33.195279    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-a-6d35bd-7986d67dff-6jf8l" event={"ID":"5e8f4e80-e86c-4d2c-ab8b-39e7393d6b51","Type":"ContainerDied","Data":"48fb9600815e5f2d1ce1920b4d2c845e4acc2f168e93828600150f46b374b9cc"}
Jul 02 23:50:33.249423 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:50:33.249392    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-a-6d35bd-7986d67dff-6jf8l"
Jul 02 23:50:33.355870 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:50:33.355786    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5e8f4e80-e86c-4d2c-ab8b-39e7393d6b51-openshift-service-ca\") pod \"5e8f4e80-e86c-4d2c-ab8b-39e7393d6b51\" (UID: \"5e8f4e80-e86c-4d2c-ab8b-39e7393d6b51\") "
Jul 02 23:50:33.355870 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:50:33.355839    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5e8f4e80-e86c-4d2c-ab8b-39e7393d6b51-maas-api-tls\") pod \"5e8f4e80-e86c-4d2c-ab8b-39e7393d6b51\" (UID: \"5e8f4e80-e86c-4d2c-ab8b-39e7393d6b51\") "
Jul 02 23:50:33.356073 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:50:33.355936    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-748vx\" (UniqueName: \"kubernetes.io/projected/5e8f4e80-e86c-4d2c-ab8b-39e7393d6b51-kube-api-access-748vx\") pod \"5e8f4e80-e86c-4d2c-ab8b-39e7393d6b51\" (UID: \"5e8f4e80-e86c-4d2c-ab8b-39e7393d6b51\") "
Jul 02 23:50:33.356179 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:50:33.356157    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5e8f4e80-e86c-4d2c-ab8b-39e7393d6b51-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "5e8f4e80-e86c-4d2c-ab8b-39e7393d6b51" (UID: "5e8f4e80-e86c-4d2c-ab8b-39e7393d6b51"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 23:50:33.358014 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:50:33.357989    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5e8f4e80-e86c-4d2c-ab8b-39e7393d6b51-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "5e8f4e80-e86c-4d2c-ab8b-39e7393d6b51" (UID: "5e8f4e80-e86c-4d2c-ab8b-39e7393d6b51"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 23:50:33.358130 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:50:33.358029    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5e8f4e80-e86c-4d2c-ab8b-39e7393d6b51-kube-api-access-748vx" (OuterVolumeSpecName: "kube-api-access-748vx") pod "5e8f4e80-e86c-4d2c-ab8b-39e7393d6b51" (UID: "5e8f4e80-e86c-4d2c-ab8b-39e7393d6b51"). InnerVolumeSpecName "kube-api-access-748vx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 23:50:33.457275 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:50:33.457227    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-748vx\" (UniqueName: \"kubernetes.io/projected/5e8f4e80-e86c-4d2c-ab8b-39e7393d6b51-kube-api-access-748vx\") on node \"ip-10-0-135-187.ec2.internal\" DevicePath \"\""
Jul 02 23:50:33.457275 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:50:33.457270    2580 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5e8f4e80-e86c-4d2c-ab8b-39e7393d6b51-openshift-service-ca\") on node \"ip-10-0-135-187.ec2.internal\" DevicePath \"\""
Jul 02 23:50:33.457425 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:50:33.457280    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5e8f4e80-e86c-4d2c-ab8b-39e7393d6b51-maas-api-tls\") on node \"ip-10-0-135-187.ec2.internal\" DevicePath \"\""
Jul 02 23:50:34.201723 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:50:34.201696    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-a-6d35bd-7986d67dff-6jf8l"
Jul 02 23:50:34.202216 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:50:34.201727    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-a-6d35bd-7986d67dff-6jf8l" event={"ID":"5e8f4e80-e86c-4d2c-ab8b-39e7393d6b51","Type":"ContainerDied","Data":"e7d262829eb53161077e0c2a8e11f15a399f4c43d82ffd1f00dd28d4e3b1892c"}
Jul 02 23:50:34.202216 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:50:34.201786    2580 scope.go:117] "RemoveContainer" containerID="48fb9600815e5f2d1ce1920b4d2c845e4acc2f168e93828600150f46b374b9cc"
Jul 02 23:50:34.225194 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:50:34.225166    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-6d35bd-7986d67dff-6jf8l"]
Jul 02 23:50:34.228733 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:50:34.228713    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-6d35bd-7986d67dff-6jf8l"]
Jul 02 23:50:34.430106 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:50:34.430078    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5e8f4e80-e86c-4d2c-ab8b-39e7393d6b51" path="/var/lib/kubelet/pods/5e8f4e80-e86c-4d2c-ab8b-39e7393d6b51/volumes"
Jul 02 23:50:37.594157 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:50:37.594075    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:50:42.466495 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:50:42.466457    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:50:42.568409 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:50:42.568372    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:51:14.837050 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:51:14.837007    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:51:15.108794 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:51:15.108762    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:51:15.336416 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:51:15.336377    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:51:15.507616 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:51:15.507530    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:51:15.823003 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:51:15.822960    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-ed05a5-6df8f74f4b-d4pcn"]
Jul 02 23:51:15.823309 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:51:15.823262    2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-shared-b-ed05a5-6df8f74f4b-d4pcn" podUID="776b1209-6d81-4d0a-b232-3f1cf24e1593" containerName="maas-api" containerID="cri-o://ab4b5f3ff3dd8e2ae10f0c0b058494364f4d49db2acada2e656954314de934e4" gracePeriod=30
Jul 02 23:51:15.843700 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:51:15.843664    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:51:15.942643 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:51:15.942606    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:51:16.066545 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:51:16.066522    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-b-ed05a5-6df8f74f4b-d4pcn"
Jul 02 23:51:16.143082 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:51:16.142985    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/776b1209-6d81-4d0a-b232-3f1cf24e1593-openshift-service-ca\") pod \"776b1209-6d81-4d0a-b232-3f1cf24e1593\" (UID: \"776b1209-6d81-4d0a-b232-3f1cf24e1593\") "
Jul 02 23:51:16.143082 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:51:16.143025    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/776b1209-6d81-4d0a-b232-3f1cf24e1593-maas-api-tls\") pod \"776b1209-6d81-4d0a-b232-3f1cf24e1593\" (UID: \"776b1209-6d81-4d0a-b232-3f1cf24e1593\") "
Jul 02 23:51:16.143082 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:51:16.143073    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bx9dp\" (UniqueName: \"kubernetes.io/projected/776b1209-6d81-4d0a-b232-3f1cf24e1593-kube-api-access-bx9dp\") pod \"776b1209-6d81-4d0a-b232-3f1cf24e1593\" (UID: \"776b1209-6d81-4d0a-b232-3f1cf24e1593\") "
Jul 02 23:51:16.143408 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:51:16.143332    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/776b1209-6d81-4d0a-b232-3f1cf24e1593-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "776b1209-6d81-4d0a-b232-3f1cf24e1593" (UID: "776b1209-6d81-4d0a-b232-3f1cf24e1593"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 23:51:16.145181 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:51:16.145157    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/776b1209-6d81-4d0a-b232-3f1cf24e1593-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "776b1209-6d81-4d0a-b232-3f1cf24e1593" (UID: "776b1209-6d81-4d0a-b232-3f1cf24e1593"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 23:51:16.145274 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:51:16.145231    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/776b1209-6d81-4d0a-b232-3f1cf24e1593-kube-api-access-bx9dp" (OuterVolumeSpecName: "kube-api-access-bx9dp") pod "776b1209-6d81-4d0a-b232-3f1cf24e1593" (UID: "776b1209-6d81-4d0a-b232-3f1cf24e1593"). InnerVolumeSpecName "kube-api-access-bx9dp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 23:51:16.244595 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:51:16.244558    2580 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/776b1209-6d81-4d0a-b232-3f1cf24e1593-openshift-service-ca\") on node \"ip-10-0-135-187.ec2.internal\" DevicePath \"\""
Jul 02 23:51:16.244595 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:51:16.244589    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/776b1209-6d81-4d0a-b232-3f1cf24e1593-maas-api-tls\") on node \"ip-10-0-135-187.ec2.internal\" DevicePath \"\""
Jul 02 23:51:16.244595 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:51:16.244599    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bx9dp\" (UniqueName: \"kubernetes.io/projected/776b1209-6d81-4d0a-b232-3f1cf24e1593-kube-api-access-bx9dp\") on node \"ip-10-0-135-187.ec2.internal\" DevicePath \"\""
Jul 02 23:51:16.393875 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:51:16.393783    2580 generic.go:356] "Generic (PLEG): container finished" podID="776b1209-6d81-4d0a-b232-3f1cf24e1593" containerID="ab4b5f3ff3dd8e2ae10f0c0b058494364f4d49db2acada2e656954314de934e4" exitCode=0
Jul 02 23:51:16.393875 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:51:16.393833    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-b-ed05a5-6df8f74f4b-d4pcn"
Jul 02 23:51:16.393875 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:51:16.393851    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-b-ed05a5-6df8f74f4b-d4pcn" event={"ID":"776b1209-6d81-4d0a-b232-3f1cf24e1593","Type":"ContainerDied","Data":"ab4b5f3ff3dd8e2ae10f0c0b058494364f4d49db2acada2e656954314de934e4"}
Jul 02 23:51:16.394151 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:51:16.393893    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-b-ed05a5-6df8f74f4b-d4pcn" event={"ID":"776b1209-6d81-4d0a-b232-3f1cf24e1593","Type":"ContainerDied","Data":"06a208d567a966ae46838d3069e127e82780c61019e28545ba906f8140a60e77"}
Jul 02 23:51:16.394151 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:51:16.393915    2580 scope.go:117] "RemoveContainer" containerID="ab4b5f3ff3dd8e2ae10f0c0b058494364f4d49db2acada2e656954314de934e4"
Jul 02 23:51:16.402770 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:51:16.402749    2580 scope.go:117] "RemoveContainer" containerID="ab4b5f3ff3dd8e2ae10f0c0b058494364f4d49db2acada2e656954314de934e4"
Jul 02 23:51:16.403030 ip-10-0-135-187 kubenswrapper[2580]: E0702 23:51:16.403012    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ab4b5f3ff3dd8e2ae10f0c0b058494364f4d49db2acada2e656954314de934e4\": container with ID starting with ab4b5f3ff3dd8e2ae10f0c0b058494364f4d49db2acada2e656954314de934e4 not found: ID does not exist" containerID="ab4b5f3ff3dd8e2ae10f0c0b058494364f4d49db2acada2e656954314de934e4"
Jul 02 23:51:16.403099 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:51:16.403038    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ab4b5f3ff3dd8e2ae10f0c0b058494364f4d49db2acada2e656954314de934e4"} err="failed to get container status \"ab4b5f3ff3dd8e2ae10f0c0b058494364f4d49db2acada2e656954314de934e4\": rpc error: code = NotFound desc = could not find container \"ab4b5f3ff3dd8e2ae10f0c0b058494364f4d49db2acada2e656954314de934e4\": container with ID starting with ab4b5f3ff3dd8e2ae10f0c0b058494364f4d49db2acada2e656954314de934e4 not found: ID does not exist"
Jul 02 23:51:16.415402 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:51:16.415381    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-ed05a5-6df8f74f4b-d4pcn"]
Jul 02 23:51:16.419073 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:51:16.419055    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-ed05a5-6df8f74f4b-d4pcn"]
Jul 02 23:51:16.428816 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:51:16.428790    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="776b1209-6d81-4d0a-b232-3f1cf24e1593" path="/var/lib/kubelet/pods/776b1209-6d81-4d0a-b232-3f1cf24e1593/volumes"
Jul 02 23:51:21.705891 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:51:21.705852    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:51:21.806810 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:51:21.806780    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:51:21.966668 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:51:21.966571    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:51:22.202160 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:51:22.202121    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:51:27.552480 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:51:27.552447    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-6dcf8bb5cc-gm42x_725f8bfd-92e5-4a8e-b7bd-03cd44b0ae15/maas-api/0.log"
Jul 02 23:51:28.267709 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:51:28.267678    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-79946c878f-cqkgw_455ff2b0-80e7-47c2-b6a3-fcbec945ec09/copy-manifests/0.log"
Jul 02 23:51:28.275410 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:51:28.275383    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-79946c878f-cqkgw_455ff2b0-80e7-47c2-b6a3-fcbec945ec09/manager/0.log"
Jul 02 23:51:30.518674 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:51:30.518644    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-nj7bc_c4a5ca63-8c40-4a96-8fa1-4e5a4c81168e/manager/0.log"
Jul 02 23:51:31.232397 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:51:31.232359    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-wprlm_748e06e1-ff7a-4bc8-9e93-4a9e6d3a2f04/discovery/0.log"
Jul 02 23:51:32.372162 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:51:32.372133    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-cw58k_08d4216e-1854-4c7a-8589-cbdd627f774f/main/0.log"
Jul 02 23:51:32.593526 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:51:32.593487    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbj8q9v_a5c19a22-1643-471d-8e84-1c25b434e6b4/main/0.log"
Jul 02 23:51:37.011697 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:51:37.011650    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:51:37.076716 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:51:37.076677    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log" limit=1024
Jul 02 23:51:39.829997 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:51:39.829953    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-x9hkk_203dd5bc-44ec-49b7-9065-d343c88157f1/global-pull-secret-syncer/0.log"
Jul 02 23:51:39.892414 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:51:39.892382    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-dl7lg_6758f85e-f0e3-4322-bae6-bbce4d0ba66f/konnectivity-agent/0.log"
Jul 02 23:51:39.982128 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:51:39.982094    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-135-187.ec2.internal_2a3057b685ec6036d1a84888358dad85/haproxy/0.log"
Jul 02 23:51:45.303336 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:51:45.303300    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-nj7bc_c4a5ca63-8c40-4a96-8fa1-4e5a4c81168e/manager/0.log"
Jul 02 23:51:46.827833 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:51:46.827801    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_6dc35317-db4f-4ac4-be90-b14d7cd9117e/alertmanager/0.log"
Jul 02 23:51:46.848886 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:51:46.848865    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_6dc35317-db4f-4ac4-be90-b14d7cd9117e/config-reloader/0.log"
Jul 02 23:51:46.869155 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:51:46.869131    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_6dc35317-db4f-4ac4-be90-b14d7cd9117e/kube-rbac-proxy-web/0.log"
Jul 02 23:51:46.889038 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:51:46.889021    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_6dc35317-db4f-4ac4-be90-b14d7cd9117e/kube-rbac-proxy/0.log"
Jul 02 23:51:46.909285 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:51:46.909264    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_6dc35317-db4f-4ac4-be90-b14d7cd9117e/kube-rbac-proxy-metric/0.log"
Jul 02 23:51:46.939392 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:51:46.939367    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_6dc35317-db4f-4ac4-be90-b14d7cd9117e/prom-label-proxy/0.log"
Jul 02 23:51:46.954681 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:51:46.954665    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_6dc35317-db4f-4ac4-be90-b14d7cd9117e/init-config-reloader/0.log"
Jul 02 23:51:47.310877 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:51:47.310852    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-bxm98_706d7077-97df-485d-8390-a438278ddcab/node-exporter/0.log"
Jul 02 23:51:47.336071 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:51:47.335996    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-bxm98_706d7077-97df-485d-8390-a438278ddcab/kube-rbac-proxy/0.log"
Jul 02 23:51:47.371757 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:51:47.371707    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-bxm98_706d7077-97df-485d-8390-a438278ddcab/init-textfile/0.log"
Jul 02 23:51:47.579763 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:51:47.579741    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-jwnbq_8dff8496-a608-4f62-a76f-66916a6a5680/kube-rbac-proxy-main/0.log"
Jul 02 23:51:47.602700 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:51:47.602625    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-jwnbq_8dff8496-a608-4f62-a76f-66916a6a5680/kube-rbac-proxy-self/0.log"
Jul 02 23:51:47.626382 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:51:47.626356    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-jwnbq_8dff8496-a608-4f62-a76f-66916a6a5680/openshift-state-metrics/0.log"
Jul 02 23:51:47.669848 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:51:47.669814    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_fc98ab98-c759-47a1-bb7f-6b1f2bfd69a8/prometheus/0.log"
Jul 02 23:51:47.693412 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:51:47.693389    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_fc98ab98-c759-47a1-bb7f-6b1f2bfd69a8/config-reloader/0.log"
Jul 02 23:51:47.713688 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:51:47.713663    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_fc98ab98-c759-47a1-bb7f-6b1f2bfd69a8/thanos-sidecar/0.log"
Jul 02 23:51:47.733899 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:51:47.733878    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_fc98ab98-c759-47a1-bb7f-6b1f2bfd69a8/kube-rbac-proxy-web/0.log"
Jul 02 23:51:47.753134 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:51:47.753118    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_fc98ab98-c759-47a1-bb7f-6b1f2bfd69a8/kube-rbac-proxy/0.log"
Jul 02 23:51:47.773073 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:51:47.773056    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_fc98ab98-c759-47a1-bb7f-6b1f2bfd69a8/kube-rbac-proxy-thanos/0.log"
Jul 02 23:51:47.793414 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:51:47.793397    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_fc98ab98-c759-47a1-bb7f-6b1f2bfd69a8/init-config-reloader/0.log"
Jul 02 23:51:47.902521 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:51:47.902451    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-859fd98467-hj2fr_2e81d3b8-0805-4030-b254-0917876875d1/telemeter-client/0.log"
Jul 02 23:51:47.923585 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:51:47.923565    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-859fd98467-hj2fr_2e81d3b8-0805-4030-b254-0917876875d1/reload/0.log"
Jul 02 23:51:47.945562 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:51:47.945541    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-859fd98467-hj2fr_2e81d3b8-0805-4030-b254-0917876875d1/kube-rbac-proxy/0.log"
Jul 02 23:51:50.206157 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:51:50.206125    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-2r2d9/perf-node-gather-daemonset-gxwv2"]
Jul 02 23:51:50.206573 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:51:50.206508    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5e8f4e80-e86c-4d2c-ab8b-39e7393d6b51" containerName="maas-api"
Jul 02 23:51:50.206573 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:51:50.206520    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="5e8f4e80-e86c-4d2c-ab8b-39e7393d6b51" containerName="maas-api"
Jul 02 23:51:50.206573 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:51:50.206527    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="776b1209-6d81-4d0a-b232-3f1cf24e1593" containerName="maas-api"
Jul 02 23:51:50.206573 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:51:50.206533    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="776b1209-6d81-4d0a-b232-3f1cf24e1593" containerName="maas-api"
Jul 02 23:51:50.206728 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:51:50.206586    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="5e8f4e80-e86c-4d2c-ab8b-39e7393d6b51" containerName="maas-api"
Jul 02 23:51:50.206728 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:51:50.206596    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="776b1209-6d81-4d0a-b232-3f1cf24e1593" containerName="maas-api"
Jul 02 23:51:50.208692 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:51:50.208675    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-2r2d9/perf-node-gather-daemonset-gxwv2"
Jul 02 23:51:50.212028 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:51:50.211996    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-2r2d9\"/\"openshift-service-ca.crt\""
Jul 02 23:51:50.212136 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:51:50.211997    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-2r2d9\"/\"kube-root-ca.crt\""
Jul 02 23:51:50.213197 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:51:50.213179    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-2r2d9\"/\"default-dockercfg-vnk2p\""
Jul 02 23:51:50.219824 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:51:50.219803    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-2r2d9/perf-node-gather-daemonset-gxwv2"]
Jul 02 23:51:50.339934 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:51:50.339904    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/84702732-5d23-446a-b8a7-80585e47cd36-sys\") pod \"perf-node-gather-daemonset-gxwv2\" (UID: \"84702732-5d23-446a-b8a7-80585e47cd36\") " pod="openshift-must-gather-2r2d9/perf-node-gather-daemonset-gxwv2"
Jul 02 23:51:50.340112 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:51:50.339952    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/84702732-5d23-446a-b8a7-80585e47cd36-podres\") pod \"perf-node-gather-daemonset-gxwv2\" (UID: \"84702732-5d23-446a-b8a7-80585e47cd36\") " pod="openshift-must-gather-2r2d9/perf-node-gather-daemonset-gxwv2"
Jul 02 23:51:50.340112 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:51:50.340024    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/84702732-5d23-446a-b8a7-80585e47cd36-proc\") pod \"perf-node-gather-daemonset-gxwv2\" (UID: \"84702732-5d23-446a-b8a7-80585e47cd36\") " pod="openshift-must-gather-2r2d9/perf-node-gather-daemonset-gxwv2"
Jul 02 23:51:50.340112 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:51:50.340049    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-blfwr\" (UniqueName: \"kubernetes.io/projected/84702732-5d23-446a-b8a7-80585e47cd36-kube-api-access-blfwr\") pod \"perf-node-gather-daemonset-gxwv2\" (UID: \"84702732-5d23-446a-b8a7-80585e47cd36\") " pod="openshift-must-gather-2r2d9/perf-node-gather-daemonset-gxwv2"
Jul 02 23:51:50.340112 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:51:50.340074    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/84702732-5d23-446a-b8a7-80585e47cd36-lib-modules\") pod \"perf-node-gather-daemonset-gxwv2\" (UID: \"84702732-5d23-446a-b8a7-80585e47cd36\") " pod="openshift-must-gather-2r2d9/perf-node-gather-daemonset-gxwv2"
Jul 02 23:51:50.441527 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:51:50.441496    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/84702732-5d23-446a-b8a7-80585e47cd36-proc\") pod \"perf-node-gather-daemonset-gxwv2\" (UID: \"84702732-5d23-446a-b8a7-80585e47cd36\") " pod="openshift-must-gather-2r2d9/perf-node-gather-daemonset-gxwv2"
Jul 02 23:51:50.441527 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:51:50.441532    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-blfwr\" (UniqueName: \"kubernetes.io/projected/84702732-5d23-446a-b8a7-80585e47cd36-kube-api-access-blfwr\") pod \"perf-node-gather-daemonset-gxwv2\" (UID: \"84702732-5d23-446a-b8a7-80585e47cd36\") " pod="openshift-must-gather-2r2d9/perf-node-gather-daemonset-gxwv2"
Jul 02 23:51:50.441763 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:51:50.441556    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/84702732-5d23-446a-b8a7-80585e47cd36-lib-modules\") pod \"perf-node-gather-daemonset-gxwv2\" (UID: \"84702732-5d23-446a-b8a7-80585e47cd36\") " pod="openshift-must-gather-2r2d9/perf-node-gather-daemonset-gxwv2"
Jul 02 23:51:50.441763 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:51:50.441600    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/84702732-5d23-446a-b8a7-80585e47cd36-sys\") pod \"perf-node-gather-daemonset-gxwv2\" (UID: \"84702732-5d23-446a-b8a7-80585e47cd36\") " pod="openshift-must-gather-2r2d9/perf-node-gather-daemonset-gxwv2"
Jul 02 23:51:50.441763 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:51:50.441635    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/84702732-5d23-446a-b8a7-80585e47cd36-podres\") pod \"perf-node-gather-daemonset-gxwv2\" (UID: \"84702732-5d23-446a-b8a7-80585e47cd36\") " pod="openshift-must-gather-2r2d9/perf-node-gather-daemonset-gxwv2"
Jul 02 23:51:50.441763 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:51:50.441632    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/84702732-5d23-446a-b8a7-80585e47cd36-proc\") pod \"perf-node-gather-daemonset-gxwv2\" (UID: \"84702732-5d23-446a-b8a7-80585e47cd36\") " pod="openshift-must-gather-2r2d9/perf-node-gather-daemonset-gxwv2"
Jul 02 23:51:50.441763 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:51:50.441753    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/84702732-5d23-446a-b8a7-80585e47cd36-podres\") pod \"perf-node-gather-daemonset-gxwv2\" (UID: \"84702732-5d23-446a-b8a7-80585e47cd36\") " pod="openshift-must-gather-2r2d9/perf-node-gather-daemonset-gxwv2"
Jul 02 23:51:50.441937 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:51:50.441780    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/84702732-5d23-446a-b8a7-80585e47cd36-sys\") pod \"perf-node-gather-daemonset-gxwv2\" (UID: \"84702732-5d23-446a-b8a7-80585e47cd36\") " pod="openshift-must-gather-2r2d9/perf-node-gather-daemonset-gxwv2"
Jul 02 23:51:50.441937 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:51:50.441845    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/84702732-5d23-446a-b8a7-80585e47cd36-lib-modules\") pod \"perf-node-gather-daemonset-gxwv2\" (UID: \"84702732-5d23-446a-b8a7-80585e47cd36\") " pod="openshift-must-gather-2r2d9/perf-node-gather-daemonset-gxwv2"
Jul 02 23:51:50.449932 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:51:50.449911    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-blfwr\" (UniqueName: \"kubernetes.io/projected/84702732-5d23-446a-b8a7-80585e47cd36-kube-api-access-blfwr\") pod \"perf-node-gather-daemonset-gxwv2\" (UID: \"84702732-5d23-446a-b8a7-80585e47cd36\") " pod="openshift-must-gather-2r2d9/perf-node-gather-daemonset-gxwv2"
Jul 02 23:51:50.519111 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:51:50.519028    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-2r2d9/perf-node-gather-daemonset-gxwv2"
Jul 02 23:51:50.643047 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:51:50.643023    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-2r2d9/perf-node-gather-daemonset-gxwv2"]
Jul 02 23:51:50.645297 ip-10-0-135-187 kubenswrapper[2580]: W0702 23:51:50.645270    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod84702732_5d23_446a_b8a7_80585e47cd36.slice/crio-eeb80197f4aea54432a05e3ecc097bfdc8fba0553525a87191ca9f7f7439c29f WatchSource:0}: Error finding container eeb80197f4aea54432a05e3ecc097bfdc8fba0553525a87191ca9f7f7439c29f: Status 404 returned error can't find the container with id eeb80197f4aea54432a05e3ecc097bfdc8fba0553525a87191ca9f7f7439c29f
Jul 02 23:51:51.544357 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:51:51.544321    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-2r2d9/perf-node-gather-daemonset-gxwv2" event={"ID":"84702732-5d23-446a-b8a7-80585e47cd36","Type":"ContainerStarted","Data":"fc3ceeb340c3afb0929c9d956649421e8b9954937ec170e3faf3e581d5033d74"}
Jul 02 23:51:51.544770 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:51:51.544384    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-2r2d9/perf-node-gather-daemonset-gxwv2" event={"ID":"84702732-5d23-446a-b8a7-80585e47cd36","Type":"ContainerStarted","Data":"eeb80197f4aea54432a05e3ecc097bfdc8fba0553525a87191ca9f7f7439c29f"}
Jul 02 23:51:51.544770 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:51:51.544410    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-2r2d9/perf-node-gather-daemonset-gxwv2"
Jul 02 23:51:51.561482 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:51:51.561431    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-2r2d9/perf-node-gather-daemonset-gxwv2" podStartSLOduration=1.561413519 podStartE2EDuration="1.561413519s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 23:51:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:51:51.559392479 +0000 UTC m=+2497.576823678" watchObservedRunningTime="2026-07-02 23:51:51.561413519 +0000 UTC m=+2497.578844716"
Jul 02 23:51:52.174786 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:51:52.174757    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-z7rcb_51071c9b-e670-4233-b73b-4a26ebbc009d/dns/0.log"
Jul 02 23:51:52.195497 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:51:52.195463    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-z7rcb_51071c9b-e670-4233-b73b-4a26ebbc009d/kube-rbac-proxy/0.log"
Jul 02 23:51:52.264173 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:51:52.264143    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-pbxh5_82fa80d2-d1b6-4aed-bd41-c32e9589c4b5/dns-node-resolver/0.log"
Jul 02 23:51:52.805610 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:51:52.805573    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-88f5c7b8f-l5qsg_87da2637-90d0-45b1-b8eb-49ac54703eed/registry/0.log"
Jul 02 23:51:52.877815 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:51:52.877787    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-zd96c_d394571a-8c62-4248-a9eb-9b165f3dfea3/node-ca/0.log"
Jul 02 23:51:53.933142 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:51:53.933104    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-wprlm_748e06e1-ff7a-4bc8-9e93-4a9e6d3a2f04/discovery/0.log"
Jul 02 23:51:54.812527 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:51:54.812496    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-xk6lv_5bebd72f-9864-4ea8-b1ab-279ec44f241c/serve-healthcheck-canary/0.log"
Jul 02 23:51:55.355083 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:51:55.355048    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-rfzg8_5e89b5ea-9091-4b4e-b4af-917db3d3cf7f/kube-rbac-proxy/0.log"
Jul 02 23:51:55.373926 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:51:55.373905    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-rfzg8_5e89b5ea-9091-4b4e-b4af-917db3d3cf7f/exporter/0.log"
Jul 02 23:51:55.393492 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:51:55.393468    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-rfzg8_5e89b5ea-9091-4b4e-b4af-917db3d3cf7f/extractor/0.log"
Jul 02 23:51:57.557578 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:51:57.557554    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-2r2d9/perf-node-gather-daemonset-gxwv2"
Jul 02 23:51:57.725613 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:51:57.725561    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-6dcf8bb5cc-gm42x_725f8bfd-92e5-4a8e-b7bd-03cd44b0ae15/maas-api/0.log"
Jul 02 23:51:57.968265 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:51:57.968170    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-79946c878f-cqkgw_455ff2b0-80e7-47c2-b6a3-fcbec945ec09/manager/0.log"
Jul 02 23:51:57.987819 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:51:57.987800    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-79946c878f-cqkgw_455ff2b0-80e7-47c2-b6a3-fcbec945ec09/copy-manifests/0.log"
Jul 02 23:51:59.578953 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:51:59.578921    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-6898c65679-9rm6g_839c18b2-18bd-46cb-aa18-ab71e455522b/manager/0.log"
Jul 02 23:52:00.853549 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:52:00.853517    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-wprlm_748e06e1-ff7a-4bc8-9e93-4a9e6d3a2f04/discovery/0.log"
Jul 02 23:52:02.475491 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:52:02.475462    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-wprlm_748e06e1-ff7a-4bc8-9e93-4a9e6d3a2f04/discovery/0.log"
Jul 02 23:52:04.764344 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:52:04.764312    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-b9mj9_cc311281-241c-408b-867d-01ae62962aae/migrator/0.log"
Jul 02 23:52:04.782967 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:52:04.782942    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-b9mj9_cc311281-241c-408b-867d-01ae62962aae/graceful-termination/0.log"
Jul 02 23:52:06.390327 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:52:06.390302    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ngnnt_d9adaa10-5793-4280-9f7f-b7ff28a63c56/kube-multus-additional-cni-plugins/0.log"
Jul 02 23:52:06.409169 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:52:06.409143    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ngnnt_d9adaa10-5793-4280-9f7f-b7ff28a63c56/egress-router-binary-copy/0.log"
Jul 02 23:52:06.427570 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:52:06.427550    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ngnnt_d9adaa10-5793-4280-9f7f-b7ff28a63c56/cni-plugins/0.log"
Jul 02 23:52:06.445732 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:52:06.445715    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ngnnt_d9adaa10-5793-4280-9f7f-b7ff28a63c56/bond-cni-plugin/0.log"
Jul 02 23:52:06.463842 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:52:06.463824    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ngnnt_d9adaa10-5793-4280-9f7f-b7ff28a63c56/routeoverride-cni/0.log"
Jul 02 23:52:06.489117 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:52:06.489094    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ngnnt_d9adaa10-5793-4280-9f7f-b7ff28a63c56/whereabouts-cni-bincopy/0.log"
Jul 02 23:52:06.507377 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:52:06.507358    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ngnnt_d9adaa10-5793-4280-9f7f-b7ff28a63c56/whereabouts-cni/0.log"
Jul 02 23:52:06.604502 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:52:06.604475    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-tvqsh_d1f07f77-f80b-40b6-820d-bf77344e6724/kube-multus/0.log"
Jul 02 23:52:06.666802 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:52:06.666736    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-7qztm_8f153fd5-a05d-4f36-8295-6c95914702e9/network-metrics-daemon/0.log"
Jul 02 23:52:06.683923 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:52:06.683903    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-7qztm_8f153fd5-a05d-4f36-8295-6c95914702e9/kube-rbac-proxy/0.log"
Jul 02 23:52:07.922929 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:52:07.922895    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xxshk_76a3ba4e-e12e-4949-a03b-2012fe8f772c/ovn-controller/0.log"
Jul 02 23:52:07.938018 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:52:07.937999    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xxshk_76a3ba4e-e12e-4949-a03b-2012fe8f772c/ovn-acl-logging/0.log"
Jul 02 23:52:07.960694 ip-10-0-135-187 kubenswrapper[2580]: I0702 23:52:07.960672    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xxshk_76a3ba4e-e12e-4949-a03b-2012fe8f772c/kube-rbac-proxy-node/0.log"